[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:24:54.122169  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:37685
I20260709 12:24:54.123711  7261 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:24:54.124756  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:54.140969  7268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:54.141340  7270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:54.142344  7267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:54.142306  7261 server_base.cc:1061] running on GCE node
I20260709 12:24:55.258083  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.258306  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.258535  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599895258509 us; error 0 us; skew 500 ppm
I20260709 12:24:55.259598  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.264987  7261 webserver.cc:533] Webserver started at http://127.7.23.126:39649/ using document root <none> and password file <none>
I20260709 12:24:55.265817  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.266036  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:55.266484  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:55.272209  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.279788  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:55.284806  7276 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.285885  7261 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
I20260709 12:24:55.286221  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.286568  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.335399  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.336961  7261 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:24:55.337397  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.405440  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:37685
I20260709 12:24:55.405493  7327 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:37685 every 8 connection(s)
I20260709 12:24:55.412949  7328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:55.433817  7328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7: Bootstrap starting.
I20260709 12:24:55.439574  7328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:55.441335  7328 log.cc:826] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7: Log is configured to *not* fsync() on all Append() calls
I20260709 12:24:55.445638  7328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7: No bootstrap required, opened a new log
I20260709 12:24:55.465765  7328 raft_consensus.cc:359] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" member_type: VOTER }
I20260709 12:24:55.466303  7328 raft_consensus.cc:385] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:55.466559  7328 raft_consensus.cc:740] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1c3f1cd96ef4e788e4ca5ee369922d7, State: Initialized, Role: FOLLOWER
I20260709 12:24:55.467424  7328 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" member_type: VOTER }
I20260709 12:24:55.467895  7328 raft_consensus.cc:399] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:24:55.468170  7328 raft_consensus.cc:493] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:24:55.468482  7328 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:55.472482  7328 raft_consensus.cc:515] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" member_type: VOTER }
I20260709 12:24:55.473189  7328 leader_election.cc:304] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1c3f1cd96ef4e788e4ca5ee369922d7; no voters: 
I20260709 12:24:55.474834  7328 leader_election.cc:290] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:24:55.475190  7331 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:55.477451  7331 raft_consensus.cc:697] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 1 LEADER]: Becoming Leader. State: Replica: e1c3f1cd96ef4e788e4ca5ee369922d7, State: Running, Role: LEADER
I20260709 12:24:55.478294  7331 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" member_type: VOTER }
I20260709 12:24:55.479285  7328 sys_catalog.cc:565] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:24:55.487768  7332 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" member_type: VOTER } }
I20260709 12:24:55.488480  7332 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:55.488282  7333 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1c3f1cd96ef4e788e4ca5ee369922d7. Latest consensus state: current_term: 1 leader_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1c3f1cd96ef4e788e4ca5ee369922d7" member_type: VOTER } }
I20260709 12:24:55.488888  7333 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:24:55.491750  7340 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:24:55.502584  7340 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:24:55.504710  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:24:55.520190  7340 catalog_manager.cc:1383] Generated new cluster ID: 1fe313bba81842368725a27fad85bfaa
I20260709 12:24:55.520442  7340 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:24:55.536191  7340 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:24:55.537635  7340 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:24:55.549909  7340 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7: Generated new TSK 0
I20260709 12:24:55.550743  7340 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:24:55.571485  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:55.580557  7350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.581683  7351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.584856  7353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.585559  7261 server_base.cc:1061] running on GCE node
I20260709 12:24:55.586303  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.586498  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.586666  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599895586643 us; error 0 us; skew 500 ppm
I20260709 12:24:55.587210  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.590842  7261 webserver.cc:533] Webserver started at http://127.7.23.65:45581/ using document root <none> and password file <none>
I20260709 12:24:55.591352  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.591586  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:55.591849  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:55.593256  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "94a04d8844b34b7383c23a34627de45c"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.598690  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:24:55.602838  7358 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.603627  7261 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:24:55.603894  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "94a04d8844b34b7383c23a34627de45c"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.604159  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.626883  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.628198  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.630656  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:55.634548  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:55.634758  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.635006  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:55.635154  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.729058  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:42273
I20260709 12:24:55.729141  7420 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:42273 every 8 connection(s)
I20260709 12:24:55.735662  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:55.750617  7425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.753528  7426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.757941  7428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.762782  7421 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37685
I20260709 12:24:55.763228  7421 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:55.764185  7421 heartbeater.cc:507] Master 127.7.23.126:37685 requested a full tablet report, sending...
I20260709 12:24:55.766870  7293 ts_manager.cc:194] Registered new tserver with Master: 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273)
I20260709 12:24:55.769153  7293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60466
I20260709 12:24:55.769511  7261 server_base.cc:1061] running on GCE node
I20260709 12:24:55.770442  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.770702  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.770913  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599895770895 us; error 0 us; skew 500 ppm
I20260709 12:24:55.771821  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.774890  7261 webserver.cc:533] Webserver started at http://127.7.23.66:38389/ using document root <none> and password file <none>
I20260709 12:24:55.775388  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.775609  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:55.775866  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:55.776995  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "c0cbf514952047afab98e451831e8866"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.782106  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.006s
I20260709 12:24:55.785425  7433 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.786181  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:24:55.786430  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "c0cbf514952047afab98e451831e8866"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.786687  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.798962  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.800261  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.802260  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:55.805151  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:55.805428  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.805760  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:55.805917  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.887744  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:36325
I20260709 12:24:55.887914  7495 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:36325 every 8 connection(s)
I20260709 12:24:55.894253  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:24:55.902926  7499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:24:55.905663  7500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.906126  7496 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37685
I20260709 12:24:55.906481  7496 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:55.907701  7496 heartbeater.cc:507] Master 127.7.23.126:37685 requested a full tablet report, sending...
I20260709 12:24:55.910126  7293 ts_manager.cc:194] Registered new tserver with Master: c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:55.911904  7293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60480
I20260709 12:24:55.916872  7261 server_base.cc:1061] running on GCE node
W20260709 12:24:55.917079  7502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:24:55.918141  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:24:55.918418  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:24:55.918628  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599895918611 us; error 0 us; skew 500 ppm
I20260709 12:24:55.919374  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:24:55.922000  7261 webserver.cc:533] Webserver started at http://127.7.23.67:36337/ using document root <none> and password file <none>
I20260709 12:24:55.922611  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:24:55.922842  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:24:55.923172  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:24:55.924527  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "1f51b288aafc4fd0929e950d58ca8a93"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.930187  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:24:55.934182  7507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.934944  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:24:55.935268  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "1f51b288aafc4fd0929e950d58ca8a93"
format_stamp: "Formatted at 2026-07-09 12:24:55 on dist-test-slave-ps85"
I20260709 12:24:55.935642  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:24:55.955273  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:24:55.956915  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:24:55.958521  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:24:55.962093  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:24:55.962353  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:55.962625  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:24:55.962824  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:24:56.047127  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:35343
I20260709 12:24:56.047173  7569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:35343 every 8 connection(s)
I20260709 12:24:56.061866  7570 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37685
I20260709 12:24:56.062280  7570 heartbeater.cc:461] Registering TS with master...
I20260709 12:24:56.063115  7570 heartbeater.cc:507] Master 127.7.23.126:37685 requested a full tablet report, sending...
I20260709 12:24:56.065258  7293 ts_manager.cc:194] Registered new tserver with Master: 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:56.065404  7261 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.009706184s
I20260709 12:24:56.067015  7293 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60484
I20260709 12:24:56.122500  7293 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60494:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:24:56.127336  7293 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:24:56.232609  7386 tablet_service.cc:1511] Processing CreateTablet for tablet dd40fb4fad1f47719c47a48c8b576247 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:56.233469  7383 tablet_service.cc:1511] Processing CreateTablet for tablet 10e1f5ce2f8043738b44626b0c4fad10 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:56.234273  7386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40fb4fad1f47719c47a48c8b576247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.236299  7384 tablet_service.cc:1511] Processing CreateTablet for tablet 565d31e2b0eb4b0eb5b0e428ceffb895 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:56.237607  7384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565d31e2b0eb4b0eb5b0e428ceffb895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.238531  7383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e1f5ce2f8043738b44626b0c4fad10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.239108  7535 tablet_service.cc:1511] Processing CreateTablet for tablet dd40fb4fad1f47719c47a48c8b576247 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:56.232610  7385 tablet_service.cc:1511] Processing CreateTablet for tablet 7904e17a661e4e7589cd99ad88fb6391 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:56.243029  7534 tablet_service.cc:1511] Processing CreateTablet for tablet 7904e17a661e4e7589cd99ad88fb6391 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:56.244989  7385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7904e17a661e4e7589cd99ad88fb6391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.245090  7533 tablet_service.cc:1511] Processing CreateTablet for tablet 565d31e2b0eb4b0eb5b0e428ceffb895 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:56.248461  7535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40fb4fad1f47719c47a48c8b576247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.251943  7533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565d31e2b0eb4b0eb5b0e428ceffb895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.253093  7534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7904e17a661e4e7589cd99ad88fb6391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.260296  7532 tablet_service.cc:1511] Processing CreateTablet for tablet 10e1f5ce2f8043738b44626b0c4fad10 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:56.266788  7461 tablet_service.cc:1511] Processing CreateTablet for tablet dd40fb4fad1f47719c47a48c8b576247 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:24:56.267985  7461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40fb4fad1f47719c47a48c8b576247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.271332  7532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e1f5ce2f8043738b44626b0c4fad10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.273682  7531 tablet_service.cc:1511] Processing CreateTablet for tablet 38b45213d6714064b7ca57b6ed47a216 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:56.271384  7382 tablet_service.cc:1511] Processing CreateTablet for tablet 38b45213d6714064b7ca57b6ed47a216 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:56.283564  7459 tablet_service.cc:1511] Processing CreateTablet for tablet 565d31e2b0eb4b0eb5b0e428ceffb895 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:24:56.285295  7457 tablet_service.cc:1511] Processing CreateTablet for tablet 38b45213d6714064b7ca57b6ed47a216 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:24:56.285972  7459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 565d31e2b0eb4b0eb5b0e428ceffb895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.297412  7457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b45213d6714064b7ca57b6ed47a216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.297663  7382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b45213d6714064b7ca57b6ed47a216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.280947  7460 tablet_service.cc:1511] Processing CreateTablet for tablet 7904e17a661e4e7589cd99ad88fb6391 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:24:56.304922  7531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b45213d6714064b7ca57b6ed47a216. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.308128  7460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7904e17a661e4e7589cd99ad88fb6391. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.306819  7458 tablet_service.cc:1511] Processing CreateTablet for tablet 10e1f5ce2f8043738b44626b0c4fad10 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:24:56.321234  7458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10e1f5ce2f8043738b44626b0c4fad10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.324887  7381 tablet_service.cc:1511] Processing CreateTablet for tablet c482ccbd16e2402a8520eb6e45c9cfad (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:56.332293  7456 tablet_service.cc:1511] Processing CreateTablet for tablet c482ccbd16e2402a8520eb6e45c9cfad (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:56.335566  7456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c482ccbd16e2402a8520eb6e45c9cfad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.340121  7381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c482ccbd16e2402a8520eb6e45c9cfad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.342895  7530 tablet_service.cc:1511] Processing CreateTablet for tablet c482ccbd16e2402a8520eb6e45c9cfad (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:24:56.344991  7530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c482ccbd16e2402a8520eb6e45c9cfad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.363019  7383 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe9c8e11056483993c0fa1912f24f7c (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:56.364331  7383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe9c8e11056483993c0fa1912f24f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.373109  7529 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe9c8e11056483993c0fa1912f24f7c (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:56.368579  7588 tablet_bootstrap.cc:492] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.370817  7455 tablet_service.cc:1511] Processing CreateTablet for tablet 9fe9c8e11056483993c0fa1912f24f7c (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:24:56.377718  7455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe9c8e11056483993c0fa1912f24f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.375991  7529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fe9c8e11056483993c0fa1912f24f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.420526  7383 tablet_service.cc:1511] Processing CreateTablet for tablet 791af6451e9e4246bd2a43083e09dc89 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:56.422166  7589 tablet_bootstrap.cc:492] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:56.424108  7383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791af6451e9e4246bd2a43083e09dc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.430507  7460 tablet_service.cc:1511] Processing CreateTablet for tablet 791af6451e9e4246bd2a43083e09dc89 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:56.431977  7460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791af6451e9e4246bd2a43083e09dc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.435582  7589 tablet_bootstrap.cc:654] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.435271  7532 tablet_service.cc:1511] Processing CreateTablet for tablet 791af6451e9e4246bd2a43083e09dc89 (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:24:56.439531  7532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 791af6451e9e4246bd2a43083e09dc89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.447849  7457 tablet_service.cc:1511] Processing CreateTablet for tablet fc6eb4ceadb845eeb3cf11da41044d1d (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:56.448714  7386 tablet_service.cc:1511] Processing CreateTablet for tablet fc6eb4ceadb845eeb3cf11da41044d1d (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:56.449666  7457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6eb4ceadb845eeb3cf11da41044d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.449429  7531 tablet_service.cc:1511] Processing CreateTablet for tablet fc6eb4ceadb845eeb3cf11da41044d1d (DEFAULT_TABLE table=test-workload [id=2bf207322d1143309622e6f334b36296]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:24:56.449847  7386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6eb4ceadb845eeb3cf11da41044d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.450989  7531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6eb4ceadb845eeb3cf11da41044d1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:56.461300  7590 tablet_bootstrap.cc:492] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:56.486790  7588 tablet_bootstrap.cc:654] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:56.496225  7341 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:24:56.499775  7590 tablet_bootstrap.cc:654] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.503830  7588 tablet_bootstrap.cc:492] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.504590  7588 ts_tablet_manager.cc:1403] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.174s	user 0.016s	sys 0.000s
I20260709 12:24:56.508183  7589 tablet_bootstrap.cc:492] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:56.508195  7588 raft_consensus.cc:359] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.508837  7590 tablet_bootstrap.cc:492] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:56.508809  7589 ts_tablet_manager.cc:1403] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.008s
I20260709 12:24:56.509181  7588 raft_consensus.cc:385] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.509374  7590 ts_tablet_manager.cc:1403] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.004s
I20260709 12:24:56.509546  7588 raft_consensus.cc:740] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.510358  7588 consensus_queue.cc:260] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.512192  7589 raft_consensus.cc:359] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.512969  7589 raft_consensus.cc:385] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.512691  7590 raft_consensus.cc:359] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.513334  7589 raft_consensus.cc:740] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.513513  7590 raft_consensus.cc:385] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.513898  7590 raft_consensus.cc:740] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.514377  7589 consensus_queue.cc:260] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.514696  7590 consensus_queue.cc:260] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.519074  7421 heartbeater.cc:499] Master 127.7.23.126:37685 was elected leader, sending a full tablet report...
I20260709 12:24:56.520265  7588 ts_tablet_manager.cc:1434] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
I20260709 12:24:56.521318  7588 tablet_bootstrap.cc:492] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.527791  7588 tablet_bootstrap.cc:654] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.530179  7496 heartbeater.cc:499] Master 127.7.23.126:37685 was elected leader, sending a full tablet report...
I20260709 12:24:56.530243  7570 heartbeater.cc:499] Master 127.7.23.126:37685 was elected leader, sending a full tablet report...
I20260709 12:24:56.534178  7590 ts_tablet_manager.cc:1434] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.010s
I20260709 12:24:56.535203  7590 tablet_bootstrap.cc:492] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:56.536083  7589 ts_tablet_manager.cc:1434] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.007s
I20260709 12:24:56.542088  7590 tablet_bootstrap.cc:654] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.548205  7589 tablet_bootstrap.cc:492] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:56.546799  7588 tablet_bootstrap.cc:492] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.553927  7588 ts_tablet_manager.cc:1403] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
I20260709 12:24:56.554742  7589 tablet_bootstrap.cc:654] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
W20260709 12:24:56.557083  7571 tablet.cc:2406] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:24:56.560747  7588 raft_consensus.cc:359] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.561488  7588 raft_consensus.cc:385] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.561810  7588 raft_consensus.cc:740] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.562569  7588 consensus_queue.cc:260] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.571566  7588 ts_tablet_manager.cc:1434] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:24:56.571996  7590 tablet_bootstrap.cc:492] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:56.572480  7590 ts_tablet_manager.cc:1403] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.011s
I20260709 12:24:56.572649  7588 tablet_bootstrap.cc:492] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.575740  7590 raft_consensus.cc:359] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.576490  7590 raft_consensus.cc:385] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.576808  7590 raft_consensus.cc:740] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.577484  7590 consensus_queue.cc:260] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.579561  7590 ts_tablet_manager.cc:1434] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:24:56.581218  7596 raft_consensus.cc:493] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.581902  7590 tablet_bootstrap.cc:492] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:56.581715  7596 raft_consensus.cc:515] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.583200  7589 tablet_bootstrap.cc:492] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:56.583719  7589 ts_tablet_manager.cc:1403] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.010s
I20260709 12:24:56.585842  7596 leader_election.cc:290] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:56.594574  7589 raft_consensus.cc:359] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.595366  7589 raft_consensus.cc:385] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.595682  7589 raft_consensus.cc:740] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.597750  7589 consensus_queue.cc:260] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.602111  7589 ts_tablet_manager.cc:1434] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:24:56.603139  7589 tablet_bootstrap.cc:492] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:56.605365  7590 tablet_bootstrap.cc:654] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.616214  7588 tablet_bootstrap.cc:654] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.622674  7589 tablet_bootstrap.cc:654] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.627328  7590 tablet_bootstrap.cc:492] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:56.627884  7590 ts_tablet_manager.cc:1403] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.002s
I20260709 12:24:56.630152  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c" is_pre_election: true
I20260709 12:24:56.631192  7588 tablet_bootstrap.cc:492] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.632764  7588 ts_tablet_manager.cc:1403] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.004s
W20260709 12:24:56.632768  7435 leader_election.cc:343] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.635183  7590 raft_consensus.cc:359] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.636036  7590 raft_consensus.cc:385] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.635699  7588 raft_consensus.cc:359] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.635866  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:56.636479  7588 raft_consensus.cc:385] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.636416  7590 raft_consensus.cc:740] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.636847  7588 raft_consensus.cc:740] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
W20260709 12:24:56.637651  7437 leader_election.cc:343] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.637615  7588 consensus_queue.cc:260] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.637756  7590 consensus_queue.cc:260] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.638336  7437 leader_election.cc:304] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbf514952047afab98e451831e8866; no voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c
I20260709 12:24:56.639134  7596 raft_consensus.cc:2749] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:56.640093  7588 ts_tablet_manager.cc:1434] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:56.640869  7590 ts_tablet_manager.cc:1434] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260709 12:24:56.640972  7588 tablet_bootstrap.cc:492] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.641812  7590 tablet_bootstrap.cc:492] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:56.648427  7590 tablet_bootstrap.cc:654] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.651306  7588 tablet_bootstrap.cc:654] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.664595  7590 tablet_bootstrap.cc:492] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:56.664595  7589 tablet_bootstrap.cc:492] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:56.665344  7590 ts_tablet_manager.cc:1403] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 12:24:56.665589  7589 ts_tablet_manager.cc:1403] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.003s
I20260709 12:24:56.666812  7588 tablet_bootstrap.cc:492] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.667289  7588 ts_tablet_manager.cc:1403] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.005s
I20260709 12:24:56.669086  7589 raft_consensus.cc:359] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.669320  7590 raft_consensus.cc:359] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.669891  7589 raft_consensus.cc:385] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.670136  7590 raft_consensus.cc:385] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.670339  7589 raft_consensus.cc:740] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.669920  7588 raft_consensus.cc:359] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.670632  7590 raft_consensus.cc:740] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.670905  7588 raft_consensus.cc:385] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.671236  7588 raft_consensus.cc:740] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.671222  7589 consensus_queue.cc:260] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.671542  7590 consensus_queue.cc:260] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.672091  7588 consensus_queue.cc:260] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.674597  7588 ts_tablet_manager.cc:1434] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:24:56.675530  7588 tablet_bootstrap.cc:492] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.675896  7595 raft_consensus.cc:493] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.676326  7595 raft_consensus.cc:515] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.678346  7589 ts_tablet_manager.cc:1434] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:24:56.684180  7595 leader_election.cc:290] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:56.685220  7589 tablet_bootstrap.cc:492] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:56.699163  7588 tablet_bootstrap.cc:654] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.707264  7590 ts_tablet_manager.cc:1434] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:24:56.708422  7590 tablet_bootstrap.cc:492] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:56.712826  7589 tablet_bootstrap.cc:654] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.714778  7590 tablet_bootstrap.cc:654] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.721309  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c" is_pre_election: true
I20260709 12:24:56.722046  7396 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 0.
I20260709 12:24:56.723675  7509 leader_election.cc:304] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:56.723747  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:56.724594  7595 raft_consensus.cc:2804] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.724526  7471 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 0.
I20260709 12:24:56.724772  7588 tablet_bootstrap.cc:492] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.725028  7595 raft_consensus.cc:493] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.725369  7595 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.725762  7588 ts_tablet_manager.cc:1403] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.004s
I20260709 12:24:56.728688  7588 raft_consensus.cc:359] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.729373  7588 raft_consensus.cc:385] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.729657  7588 raft_consensus.cc:740] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.730309  7588 consensus_queue.cc:260] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.732410  7588 ts_tablet_manager.cc:1434] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:24:56.732465  7595 raft_consensus.cc:515] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.734402  7588 tablet_bootstrap.cc:492] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.735016  7595 leader_election.cc:290] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:56.736063  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:56.736608  7471 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.736567  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:56.737218  7396 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.743950  7396 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 1.
I20260709 12:24:56.745136  7509 leader_election.cc:304] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:56.745994  7595 raft_consensus.cc:2804] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.746359  7471 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 1.
I20260709 12:24:56.749644  7588 tablet_bootstrap.cc:654] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.751585  7590 tablet_bootstrap.cc:492] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:56.752074  7590 ts_tablet_manager.cc:1403] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.004s
I20260709 12:24:56.754319  7589 tablet_bootstrap.cc:492] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:56.754328  7595 raft_consensus.cc:697] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:24:56.754873  7589 ts_tablet_manager.cc:1403] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.000s
I20260709 12:24:56.755553  7595 consensus_queue.cc:237] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.757831  7589 raft_consensus.cc:359] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.758666  7589 raft_consensus.cc:385] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.758981  7589 raft_consensus.cc:740] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.759701  7589 consensus_queue.cc:260] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.761691  7588 tablet_bootstrap.cc:492] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.761801  7589 ts_tablet_manager.cc:1434] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:24:56.762107  7588 ts_tablet_manager.cc:1403] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.009s
I20260709 12:24:56.762755  7589 tablet_bootstrap.cc:492] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:56.764693  7588 raft_consensus.cc:359] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.765491  7588 raft_consensus.cc:385] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.765841  7588 raft_consensus.cc:740] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.766716  7588 consensus_queue.cc:260] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.754894  7590 raft_consensus.cc:359] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.768217  7590 raft_consensus.cc:385] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.768492  7590 raft_consensus.cc:740] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.769392  7588 ts_tablet_manager.cc:1434] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:24:56.769170  7590 consensus_queue.cc:260] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.770483  7588 tablet_bootstrap.cc:492] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.773458  7590 ts_tablet_manager.cc:1434] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:24:56.774333  7590 tablet_bootstrap.cc:492] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:56.777268  7588 tablet_bootstrap.cc:654] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.780366  7596 raft_consensus.cc:493] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.780870  7596 raft_consensus.cc:515] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.782773  7589 tablet_bootstrap.cc:654] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.782967  7596 leader_election.cc:290] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:56.784101  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c" is_pre_election: true
I20260709 12:24:56.785797  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:56.786217  7590 tablet_bootstrap.cc:654] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.786404  7545 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 0.
I20260709 12:24:56.787818  7437 leader_election.cc:304] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:56.784731  7396 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 0.
I20260709 12:24:56.790226  7588 tablet_bootstrap.cc:492] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.790736  7588 ts_tablet_manager.cc:1403] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 12:24:56.791198  7594 raft_consensus.cc:493] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.791456  7596 raft_consensus.cc:2804] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.791814  7596 raft_consensus.cc:493] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.791709  7594 raft_consensus.cc:515] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.792204  7596 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.794258  7594 leader_election.cc:290] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:56.807495  7596 raft_consensus.cc:515] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.809996  7596 leader_election.cc:290] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:56.810178  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:56.813781  7396 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.813553  7291 catalog_manager.cc:5697] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.811606  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:56.812799  7588 raft_consensus.cc:359] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.819468  7588 raft_consensus.cc:385] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.819581  7590 tablet_bootstrap.cc:492] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:56.819512  7545 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.820514  7588 raft_consensus.cc:740] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.820812  7590 ts_tablet_manager.cc:1403] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.006s
I20260709 12:24:56.821295  7588 consensus_queue.cc:260] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.823788  7588 ts_tablet_manager.cc:1434] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.004s
I20260709 12:24:56.823704  7590 raft_consensus.cc:359] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.824458  7590 raft_consensus.cc:385] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.824766  7588 tablet_bootstrap.cc:492] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.827059  7545 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 1.
I20260709 12:24:56.829555  7437 leader_election.cc:304] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:56.830334  7596 raft_consensus.cc:2804] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.832839  7595 raft_consensus.cc:493] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.833370  7595 raft_consensus.cc:515] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.828380  7396 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 1.
I20260709 12:24:56.836898  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:56.837029  7395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c" is_pre_election: true
I20260709 12:24:56.837543  7471 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 0.
I20260709 12:24:56.837656  7395 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 0.
I20260709 12:24:56.837472  7588 tablet_bootstrap.cc:654] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.838945  7510 leader_election.cc:304] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:56.839946  7595 leader_election.cc:290] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:56.840077  7612 raft_consensus.cc:2804] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.824760  7590 raft_consensus.cc:740] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.840549  7612 raft_consensus.cc:493] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.840986  7612 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.850103  7589 tablet_bootstrap.cc:492] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:56.850744  7589 ts_tablet_manager.cc:1403] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.013s
I20260709 12:24:56.853569  7589 raft_consensus.cc:359] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.854279  7589 raft_consensus.cc:385] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.854574  7589 raft_consensus.cc:740] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.855343  7589 consensus_queue.cc:260] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.856395  7588 tablet_bootstrap.cc:492] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.856961  7596 raft_consensus.cc:697] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:24:56.859501  7589 ts_tablet_manager.cc:1434] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:24:56.859757  7596 consensus_queue.cc:237] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.860491  7589 tablet_bootstrap.cc:492] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:56.857175  7612 raft_consensus.cc:515] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.864759  7612 leader_election.cc:290] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:56.865406  7588 ts_tablet_manager.cc:1403] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 12:24:56.866977  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:56.867066  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:56.867616  7396 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.858337  7590 consensus_queue.cc:260] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.867671  7471 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.869580  7590 ts_tablet_manager.cc:1434] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.048s	user 0.002s	sys 0.005s
I20260709 12:24:56.867822  7588 raft_consensus.cc:359] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.871201  7588 raft_consensus.cc:385] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.871465  7588 raft_consensus.cc:740] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.873092  7588 consensus_queue.cc:260] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.874855  7396 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 1.
I20260709 12:24:56.870457  7590 tablet_bootstrap.cc:492] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:56.876127  7589 tablet_bootstrap.cc:654] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.876415  7471 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 1.
I20260709 12:24:56.880066  7510 leader_election.cc:304] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:56.882825  7588 ts_tablet_manager.cc:1434] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.002s
I20260709 12:24:56.883719  7588 tablet_bootstrap.cc:492] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c: Bootstrap starting.
I20260709 12:24:56.884199  7612 raft_consensus.cc:2804] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.884671  7612 raft_consensus.cc:697] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:24:56.885784  7612 consensus_queue.cc:237] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.889389  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:56.890004  7471 raft_consensus.cc:2468] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:56.892232  7361 leader_election.cc:304] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:56.894032  7594 raft_consensus.cc:2804] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.894357  7594 raft_consensus.cc:493] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.894639  7594 raft_consensus.cc:3060] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.894680  7293 catalog_manager.cc:5697] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:56.898303  7590 tablet_bootstrap.cc:654] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.906226  7588 tablet_bootstrap.cc:654] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:56.911304  7589 tablet_bootstrap.cc:492] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:56.911863  7589 ts_tablet_manager.cc:1403] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.052s	user 0.002s	sys 0.012s
I20260709 12:24:56.908294  7594 raft_consensus.cc:515] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.926909  7594 leader_election.cc:290] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:56.931938  7612 raft_consensus.cc:493] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.931519  7589 raft_consensus.cc:359] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.932608  7589 raft_consensus.cc:385] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.932404  7612 raft_consensus.cc:515] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.932891  7589 raft_consensus.cc:740] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.932346  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:56.933640  7589 consensus_queue.cc:260] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.934301  7471 raft_consensus.cc:3060] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.934409  7612 leader_election.cc:290] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:56.936012  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
W20260709 12:24:56.938788  7510 leader_election.cc:343] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbf514952047afab98e451831e8866 (127.7.23.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.936388  7594 raft_consensus.cc:493] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.940027  7290 catalog_manager.cc:5697] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:56.952711  7589 ts_tablet_manager.cc:1434] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:24:56.942816  7594 raft_consensus.cc:515] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.950482  7471 raft_consensus.cc:2468] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:56.960768  7594 leader_election.cc:290] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:56.960836  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c" is_pre_election: true
I20260709 12:24:56.961274  7594 raft_consensus.cc:493] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.961493  7396 raft_consensus.cc:2468] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 0.
I20260709 12:24:56.960659  7361 leader_election.cc:304] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:56.963178  7509 leader_election.cc:304] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: c0cbf514952047afab98e451831e8866
I20260709 12:24:56.962445  7589 tablet_bootstrap.cc:492] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:56.962266  7594 raft_consensus.cc:515] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.964576  7612 raft_consensus.cc:2804] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.964933  7612 raft_consensus.cc:493] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.965648  7612 raft_consensus.cc:3060] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.968065  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:56.966077  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:56.968827  7545 raft_consensus.cc:2468] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:56.969595  7594 leader_election.cc:290] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
W20260709 12:24:56.969794  7361 leader_election.cc:343] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbf514952047afab98e451831e8866 (127.7.23.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:56.967080  7543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:56.967476  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:56.979142  7542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:56.980127  7542 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:56.981248  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:56.981846  7471 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:56.982484  7590 tablet_bootstrap.cc:492] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:56.982945  7590 ts_tablet_manager.cc:1403] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.113s	user 0.006s	sys 0.010s
I20260709 12:24:56.982862  7361 leader_election.cc:304] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:56.983764  7544 raft_consensus.cc:3060] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.984912  7588 tablet_bootstrap.cc:492] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c: No bootstrap required, opened a new log
I20260709 12:24:56.985253  7588 ts_tablet_manager.cc:1403] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c: Time spent bootstrapping tablet: real 0.102s	user 0.008s	sys 0.006s
I20260709 12:24:56.987021  7588 raft_consensus.cc:359] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.987476  7588 raft_consensus.cc:385] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:56.987735  7588 raft_consensus.cc:740] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Initialized, Role: FOLLOWER
I20260709 12:24:56.988309  7588 consensus_queue.cc:260] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.989867  7588 ts_tablet_manager.cc:1434] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:24:56.990504  7594 raft_consensus.cc:2804] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:56.990991  7594 raft_consensus.cc:493] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.991462  7594 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:56.998328  7594 raft_consensus.cc:515] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:56.999594  7628 raft_consensus.cc:2804] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:56.999431  7612 raft_consensus.cc:515] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.001893  7594 leader_election.cc:290] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.002779  7543 raft_consensus.cc:2393] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 94a04d8844b34b7383c23a34627de45c in current term 1: Already voted for candidate 1f51b288aafc4fd0929e950d58ca8a93 in this term.
I20260709 12:24:57.010977  7589 tablet_bootstrap.cc:654] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.003118  7628 raft_consensus.cc:697] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.003314  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:57.012964  7471 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.013489  7362 leader_election.cc:304] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c; no voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866
I20260709 12:24:57.014863  7594 raft_consensus.cc:3060] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.004984  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:57.005937  7612 leader_election.cc:290] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:57.006912  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:57.006938  7590 raft_consensus.cc:359] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.008234  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.019917  7545 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.009567  7544 raft_consensus.cc:2468] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:57.019099  7590 raft_consensus.cc:385] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.024888  7590 raft_consensus.cc:740] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.026109  7590 consensus_queue.cc:260] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
W20260709 12:24:57.026643  7510 leader_election.cc:343] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0cbf514952047afab98e451831e8866 (127.7.23.66:36325): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:24:57.028679  7590 ts_tablet_manager.cc:1434] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.003s
I20260709 12:24:57.029834  7590 tablet_bootstrap.cc:492] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:57.027132  7628 consensus_queue.cc:237] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.034901  7594 raft_consensus.cc:2749] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:57.038311  7589 tablet_bootstrap.cc:492] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:57.038893  7589 ts_tablet_manager.cc:1403] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.013s
I20260709 12:24:57.039840  7545 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:57.043053  7589 raft_consensus.cc:359] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.044229  7589 raft_consensus.cc:385] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.044215  7362 leader_election.cc:304] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:57.041644  7471 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:57.044860  7589 raft_consensus.cc:740] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.045921  7594 raft_consensus.cc:2804] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.045900  7589 consensus_queue.cc:260] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.046666  7590 tablet_bootstrap.cc:654] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.048942  7589 ts_tablet_manager.cc:1434] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:24:57.042522  7396 raft_consensus.cc:2468] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 1.
I20260709 12:24:57.049983  7589 tablet_bootstrap.cc:492] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:57.051224  7509 leader_election.cc:304] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: c0cbf514952047afab98e451831e8866
I20260709 12:24:57.052359  7612 raft_consensus.cc:2804] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.052867  7612 raft_consensus.cc:697] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:24:57.053750  7612 consensus_queue.cc:237] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.056596  7589 tablet_bootstrap.cc:654] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.046722  7594 raft_consensus.cc:697] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.068785  7594 consensus_queue.cc:237] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.073640  7589 tablet_bootstrap.cc:492] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:57.073992  7590 tablet_bootstrap.cc:492] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:57.074155  7589 ts_tablet_manager.cc:1403] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.000s
I20260709 12:24:57.074520  7590 ts_tablet_manager.cc:1403] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.013s
I20260709 12:24:57.076797  7589 raft_consensus.cc:359] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.077509  7589 raft_consensus.cc:385] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.077266  7590 raft_consensus.cc:359] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.078740  7590 raft_consensus.cc:385] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.079120  7590 raft_consensus.cc:740] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.079830  7590 consensus_queue.cc:260] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.077859  7589 raft_consensus.cc:740] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.081768  7590 ts_tablet_manager.cc:1434] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:24:57.081452  7589 consensus_queue.cc:260] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.082656  7590 tablet_bootstrap.cc:492] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866: Bootstrap starting.
I20260709 12:24:57.083771  7589 ts_tablet_manager.cc:1434] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:24:57.084669  7589 tablet_bootstrap.cc:492] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93: Bootstrap starting.
I20260709 12:24:57.088694  7590 tablet_bootstrap.cc:654] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.089972  7589 tablet_bootstrap.cc:654] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93: Neither blocks nor log segments found. Creating new log.
I20260709 12:24:57.083017  7291 catalog_manager.cc:5697] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 1 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.074450  7290 catalog_manager.cc:5697] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:57.109905  7589 tablet_bootstrap.cc:492] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93: No bootstrap required, opened a new log
I20260709 12:24:57.110405  7589 ts_tablet_manager.cc:1403] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.004s
I20260709 12:24:57.111902  7291 catalog_manager.cc:5697] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 1 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.113003  7589 raft_consensus.cc:359] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.113713  7589 raft_consensus.cc:385] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.114017  7589 raft_consensus.cc:740] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.114720  7589 consensus_queue.cc:260] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.116858  7589 ts_tablet_manager.cc:1434] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:24:57.127818  7590 tablet_bootstrap.cc:492] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866: No bootstrap required, opened a new log
I20260709 12:24:57.128187  7590 ts_tablet_manager.cc:1403] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.021s
I20260709 12:24:57.130018  7590 raft_consensus.cc:359] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.130475  7590 raft_consensus.cc:385] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:24:57.130677  7590 raft_consensus.cc:740] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Initialized, Role: FOLLOWER
I20260709 12:24:57.131134  7590 consensus_queue.cc:260] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.132644  7590 ts_tablet_manager.cc:1434] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:24:57.139689  7612 raft_consensus.cc:493] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.140174  7612 raft_consensus.cc:515] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.142153  7612 leader_election.cc:290] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:57.143193  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:57.143448  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c" is_pre_election: true
I20260709 12:24:57.143729  7471 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 0.
I20260709 12:24:57.144093  7396 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 0.
I20260709 12:24:57.144598  7510 leader_election.cc:304] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:57.145290  7612 raft_consensus.cc:2804] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:57.145642  7612 raft_consensus.cc:493] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.145972  7612 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.152180  7612 raft_consensus.cc:515] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.154155  7612 leader_election.cc:290] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:24:57.154851  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:57.155308  7396 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.155210  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:57.155836  7471 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.159446  7396 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 1.
I20260709 12:24:57.160435  7509 leader_election.cc:304] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:57.161386  7612 raft_consensus.cc:2804] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.161960  7471 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 1.
I20260709 12:24:57.162602  7612 raft_consensus.cc:697] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:24:57.163676  7612 consensus_queue.cc:237] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.171083  7290 catalog_manager.cc:5697] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:57.232514  7628 raft_consensus.cc:493] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.233039  7628 raft_consensus.cc:515] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.234674  7612 consensus_queue.cc:1048] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.235013  7628 leader_election.cc:290] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.236543  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:57.236649  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:57.237447  7471 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:57.237474  7545 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:57.239100  7361 leader_election.cc:304] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:57.240370  7628 raft_consensus.cc:2804] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:57.240764  7628 raft_consensus.cc:493] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.241078  7628 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.247694  7628 raft_consensus.cc:515] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.250615  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:57.252825  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.254096  7545 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.253522  7594 raft_consensus.cc:493] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.257375  7594 raft_consensus.cc:515] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.259305  7594 leader_election.cc:290] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.261440  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:57.262029  7544 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:57.263170  7545 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:57.263165  7362 leader_election.cc:304] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:57.264143  7471 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.264624  7362 leader_election.cc:304] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:57.265425  7628 leader_election.cc:290] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.265779  7594 raft_consensus.cc:2804] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.266227  7594 raft_consensus.cc:697] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.266973  7594 consensus_queue.cc:237] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.267788  7612 consensus_queue.cc:1048] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.265528  7629 raft_consensus.cc:2804] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:24:57.270242  7629 raft_consensus.cc:493] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.270577  7629 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.271391  7471 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:57.277012  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866" is_pre_election: true
I20260709 12:24:57.277666  7470 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 0.
I20260709 12:24:57.277855  7629 raft_consensus.cc:515] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.280329  7629 leader_election.cc:290] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.281266  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.281787  7545 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.285486  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:57.286082  7470 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.287680  7290 catalog_manager.cc:5697] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 1 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.293247  7470 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:57.294524  7545 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 1.
I20260709 12:24:57.295976  7362 leader_election.cc:304] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:57.296762  7594 raft_consensus.cc:2804] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:24:57.297302  7594 raft_consensus.cc:697] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.298197  7594 consensus_queue.cc:237] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.306751  7290 catalog_manager.cc:5697] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 0 to 1, leader changed from <none> to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 1 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.339984  7612 consensus_queue.cc:1048] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.366353  7596 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.370534  7644 consensus_queue.cc:1048] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.380744  7621 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.383911  7596 raft_consensus.cc:493] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.384462  7596 raft_consensus.cc:515] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.387296  7395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a04d8844b34b7383c23a34627de45c" is_pre_election: true
I20260709 12:24:57.388154  7395 raft_consensus.cc:2393] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbf514952047afab98e451831e8866 in current term 1: Already voted for candidate 1f51b288aafc4fd0929e950d58ca8a93 in this term.
I20260709 12:24:57.388139  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6eb4ceadb845eeb3cf11da41044d1d" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93" is_pre_election: true
I20260709 12:24:57.390275  7435 leader_election.cc:304] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbf514952047afab98e451831e8866; no voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c
I20260709 12:24:57.391182  7621 raft_consensus.cc:3060] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:24:57.393220  7471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391"
dest_uuid: "c0cbf514952047afab98e451831e8866"
mode: GRACEFUL
new_leader_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:37586
I20260709 12:24:57.393904  7471 raft_consensus.cc:606] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 LEADER]: Received request to transfer leadership to TS 94a04d8844b34b7383c23a34627de45c
I20260709 12:24:57.400259  7596 leader_election.cc:290] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.402680  7621 raft_consensus.cc:2749] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:24:57.422351  7655 raft_consensus.cc:993] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: : Instructing follower 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:24:57.422858  7655 raft_consensus.cc:1081] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 LEADER]: Signalling peer 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:24:57.424674  7395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:24:57.425217  7395 raft_consensus.cc:493] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.425542  7395 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.431983  7395 raft_consensus.cc:515] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.435132  7470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:57.435580  7395 leader_election.cc:290] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 2 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.435683  7470 raft_consensus.cc:3055] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.436419  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.436085  7470 raft_consensus.cc:740] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:24:57.437882  7545 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.438004  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
mode: GRACEFUL
new_leader_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:34694
I20260709 12:24:57.438362  7470 consensus_queue.cc:260] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.438858  7544 raft_consensus.cc:606] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Received request to transfer leadership to TS 94a04d8844b34b7383c23a34627de45c
I20260709 12:24:57.439725  7470 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.444381  7545 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 2.
I20260709 12:24:57.444854  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:34694
I20260709 12:24:57.445436  7362 leader_election.cc:304] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:24:57.445770  7544 raft_consensus.cc:606] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:24:57.446519  7594 raft_consensus.cc:2804] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.446981  7594 raft_consensus.cc:697] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.447764  7594 consensus_queue.cc:237] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.451229  7470 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 2.
I20260709 12:24:57.453184  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:34694
I20260709 12:24:57.454571  7544 raft_consensus.cc:606] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:24:57.458714  7594 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.459049  7293 catalog_manager.cc:5697] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 1 to 2, leader changed from c0cbf514952047afab98e451831e8866 (127.7.23.66) to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 2 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.473412  7644 consensus_queue.cc:1048] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.473919  7395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:48444
I20260709 12:24:57.474514  7395 raft_consensus.cc:606] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:24:57.479774  7628 raft_consensus.cc:993] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.480177  7628 raft_consensus.cc:1081] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.481900  7395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:48444
I20260709 12:24:57.483963  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37582
I20260709 12:24:57.487854  7468 raft_consensus.cc:493] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.488214  7468 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.491222  7395 raft_consensus.cc:606] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:24:57.493013  7629 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.505293  7468 raft_consensus.cc:515] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.513424  7468 leader_election.cc:290] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.513713  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:57.514071  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.514292  7396 raft_consensus.cc:3055] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.514657  7396 raft_consensus.cc:740] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.515671  7396 consensus_queue.cc:260] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.516608  7396 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.517710  7612 consensus_queue.cc:1048] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.520220  7594 consensus_queue.cc:1048] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.530720  7396 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:24:57.534189  7435 leader_election.cc:304] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 1f51b288aafc4fd0929e950d58ca8a93
I20260709 12:24:57.535288  7596 raft_consensus.cc:2804] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.535939  7596 raft_consensus.cc:697] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:24:57.536693  7596 consensus_queue.cc:237] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.568097  7594 consensus_queue.cc:1048] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.569757  7291 catalog_manager.cc:5697] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 1 to 2, leader changed from 94a04d8844b34b7383c23a34627de45c (127.7.23.65) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.627331  7612 consensus_queue.cc:1048] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.633873  7595 raft_consensus.cc:993] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.634317  7644 raft_consensus.cc:1081] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.637497  7471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37572
I20260709 12:24:57.639011  7471 raft_consensus.cc:493] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.640368  7471 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.641491  7644 consensus_queue.cc:1048] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.647652  7471 raft_consensus.cc:515] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.651752  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:57.652341  7396 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.651186  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.653623  7544 raft_consensus.cc:3055] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.653949  7544 raft_consensus.cc:740] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:24:57.654704  7544 consensus_queue.cc:260] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.655797  7544 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.651873  7471 leader_election.cc:290] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.658757  7396 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:24:57.660720  7435 leader_election.cc:304] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:57.661499  7596 raft_consensus.cc:2804] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.661963  7596 raft_consensus.cc:697] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:24:57.662734  7596 consensus_queue.cc:237] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.665179  7544 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:24:57.669322  7293 catalog_manager.cc:5697] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 1 to 2, leader changed from 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.768689  7594 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.780643  7629 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.782317  7612 raft_consensus.cc:993] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.782750  7612 raft_consensus.cc:1081] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.787621  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37572
I20260709 12:24:57.788233  7468 raft_consensus.cc:493] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.788617  7468 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.793093  7629 consensus_queue.cc:1048] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:24:57.798733  7468 raft_consensus.cc:515] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.801184  7468 leader_election.cc:290] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.801913  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.802495  7545 raft_consensus.cc:3055] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.802795  7545 raft_consensus.cc:740] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:24:57.803750  7545 consensus_queue.cc:260] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.804965  7545 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.801467  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:57.818619  7629 consensus_queue.cc:1048] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:24:57.821488  7396 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.809885  7644 raft_consensus.cc:993] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93: : Instructing follower 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:24:57.822626  7644 raft_consensus.cc:1081] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Signalling peer 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:24:57.825892  7395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:48432
I20260709 12:24:57.837926  7395 raft_consensus.cc:493] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.838418  7395 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.841830  7545 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:24:57.843364  7437 leader_election.cc:304] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:57.844262  7656 raft_consensus.cc:2804] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.844704  7656 raft_consensus.cc:697] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:24:57.845501  7656 consensus_queue.cc:237] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.851477  7395 raft_consensus.cc:515] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.852393  7396 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:24:57.856694  7471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:24:57.857204  7395 leader_election.cc:290] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 2 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.857244  7471 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.858023  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.858667  7545 raft_consensus.cc:3055] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.859045  7545 raft_consensus.cc:740] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:24:57.860003  7545 consensus_queue.cc:260] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.861827  7629 raft_consensus.cc:993] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.862231  7629 raft_consensus.cc:1081] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:24:57.863890  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37582
I20260709 12:24:57.864446  7468 raft_consensus.cc:493] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:57.864849  7468 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.865252  7471 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 2.
I20260709 12:24:57.862223  7545 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.866443  7361 leader_election.cc:304] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:57.865792  7290 catalog_manager.cc:5697] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 1 to 2, leader changed from 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.867390  7629 raft_consensus.cc:2804] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.867882  7629 raft_consensus.cc:697] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.868614  7629 consensus_queue.cc:237] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.873044  7545 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 2.
I20260709 12:24:57.878286  7468 raft_consensus.cc:515] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.878666  7290 catalog_manager.cc:5697] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 1 to 2, leader changed from 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67) to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 2 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.880658  7468 leader_election.cc:290] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:24:57.880600  7395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:24:57.882010  7395 raft_consensus.cc:3055] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:57.882369  7395 raft_consensus.cc:740] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:24:57.881309  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:24:57.882949  7545 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.883217  7395 consensus_queue.cc:260] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.884435  7395 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.888862  7545 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:24:57.889815  7437 leader_election.cc:304] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:24:57.890398  7656 raft_consensus.cc:2804] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:57.890766  7656 raft_consensus.cc:697] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:24:57.891377  7395 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:24:57.891541  7656 consensus_queue.cc:237] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:24:57.897022  7290 catalog_manager.cc:5697] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 1 to 2, leader changed from 94a04d8844b34b7383c23a34627de45c (127.7.23.65) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:57.908519  7545 raft_consensus.cc:1275] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.909710  7629 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:57.921948  7468 raft_consensus.cc:1275] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:57.923398  7594 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.035470  7545 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.038048  7395 raft_consensus.cc:1275] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.039893  7656 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.042655  7545 raft_consensus.cc:1275] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.046504  7596 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.060437  7545 raft_consensus.cc:1275] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.061760  7670 consensus_queue.cc:1048] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.069272  7395 raft_consensus.cc:1275] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.071264  7596 consensus_queue.cc:1048] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.258432  7395 raft_consensus.cc:1275] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.259687  7670 consensus_queue.cc:1048] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.262133  7545 raft_consensus.cc:1275] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.263309  7594 consensus_queue.cc:1048] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.267467  7544 raft_consensus.cc:1275] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.269001  7670 consensus_queue.cc:1048] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.275112  7468 raft_consensus.cc:1275] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.279666  7628 consensus_queue.cc:1048] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.357358  7395 raft_consensus.cc:1275] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.358502  7670 consensus_queue.cc:1048] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.364878  7545 raft_consensus.cc:1275] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.366250  7596 consensus_queue.cc:1048] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:00.528419  7261 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:25:00.529132  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:00.546285  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c"
dest_uuid: "c0cbf514952047afab98e451831e8866"
mode: GRACEFUL
new_leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:37598
I20260709 12:25:00.546720  7468 raft_consensus.cc:606] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Received request to transfer leadership to TS 1f51b288aafc4fd0929e950d58ca8a93
I20260709 12:25:00.556078  7395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
mode: GRACEFUL
new_leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:48456
I20260709 12:25:00.556536  7395 raft_consensus.cc:606] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Received request to transfer leadership to TS 1f51b288aafc4fd0929e950d58ca8a93
I20260709 12:25:00.557582  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:00.557961  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:01.005609  7677 raft_consensus.cc:993] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c: : Instructing follower 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:01.006084  7594 raft_consensus.cc:1081] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Signalling peer 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:01.007375  7545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:34688
I20260709 12:25:01.007802  7545 raft_consensus.cc:493] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.008056  7545 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.011765  7545 raft_consensus.cc:515] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:01.013087  7545 leader_election.cc:290] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 2 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:25:01.013841  7395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:01.014147  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:25:01.014413  7395 raft_consensus.cc:3055] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:01.014681  7468 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.014724  7395 raft_consensus.cc:740] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:25:01.015491  7395 consensus_queue.cc:260] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:01.016345  7395 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.019080  7468 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 2.
I20260709 12:25:01.020154  7510 leader_election.cc:304] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:25:01.020632  7395 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 2.
I20260709 12:25:01.020782  7612 raft_consensus.cc:2804] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:01.021973  7612 raft_consensus.cc:697] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:25:01.022714  7612 consensus_queue.cc:237] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:01.029281  7291 catalog_manager.cc:5697] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 1 to 2, leader changed from 94a04d8844b34b7383c23a34627de45c (127.7.23.65) to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.030916  7680 raft_consensus.cc:993] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866: : Instructing follower 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:01.031287  7596 raft_consensus.cc:1081] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Signalling peer 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:01.032783  7545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:34676
I20260709 12:25:01.033165  7545 raft_consensus.cc:493] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:01.033401  7545 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.038550  7545 raft_consensus.cc:515] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:01.040710  7545 leader_election.cc:290] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 3 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:25:01.040961  7395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:01.041445  7395 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.041580  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:25:01.042160  7468 raft_consensus.cc:3055] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:01.042459  7468 raft_consensus.cc:740] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:01.043159  7468 consensus_queue.cc:260] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:01.044030  7468 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.046164  7395 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 3.
I20260709 12:25:01.047438  7509 leader_election.cc:304] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:25:01.048074  7612 raft_consensus.cc:2804] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:01.048527  7612 raft_consensus.cc:697] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:25:01.049324  7468 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 3.
I20260709 12:25:01.049276  7612 consensus_queue.cc:237] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:01.055681  7291 catalog_manager.cc:5697] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 2 to 3, leader changed from c0cbf514952047afab98e451831e8866 (127.7.23.66) to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 3 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.468189  7395 raft_consensus.cc:1275] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.469493  7612 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.483760  7468 raft_consensus.cc:1275] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:01.486270  7688 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:01.503736  7468 raft_consensus.cc:1275] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.504899  7688 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:01.512943  7395 raft_consensus.cc:1275] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:01.514390  7678 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:01.558813  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:01.563745  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:01.564112  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:02.564940  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.569679  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:02.570076  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:03.571038  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:03.575745  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:03.576126  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:04.577143  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:04.582832  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:04.583271  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:05.584349  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:05.588959  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:05.589282  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:06.590106  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:06.594811  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:06.595129  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:07.595938  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:07.600502  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:07.600835  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.601827  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:08.607462  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:08.607904  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:09.608829  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:09.613654  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:09.614051  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:10.640034  7261 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:25:10.644155  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:34694
I20260709 12:25:10.644811  7544 raft_consensus.cc:606] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:25:10.649355  7396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:48444
I20260709 12:25:10.649760  7396 raft_consensus.cc:606] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:25:10.653743  7396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:48444
I20260709 12:25:10.654145  7396 raft_consensus.cc:606] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:25:10.658275  7396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:48444
I20260709 12:25:10.658665  7396 raft_consensus.cc:606] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:25:10.667198  7544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
mode: GRACEFUL
new_leader_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:34694
I20260709 12:25:10.667654  7544 raft_consensus.cc:606] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 LEADER]: Received request to transfer leadership to TS c0cbf514952047afab98e451831e8866
I20260709 12:25:10.721452  7678 raft_consensus.cc:993] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:10.721843  7678 raft_consensus.cc:1081] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:10.723261  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37572
I20260709 12:25:10.723707  7468 raft_consensus.cc:493] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.723964  7468 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.728195  7468 raft_consensus.cc:515] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.729907  7468 leader_election.cc:290] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 3 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:10.730995  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:10.730967  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:10.731844  7544 raft_consensus.cc:3055] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:10.732115  7544 raft_consensus.cc:740] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:25:10.732553  7396 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.732980  7544 consensus_queue.cc:260] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.733973  7544 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.736785  7396 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 3.
I20260709 12:25:10.737865  7435 leader_election.cc:304] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:25:10.738601  7544 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 3.
I20260709 12:25:10.738607  7596 raft_consensus.cc:2804] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:10.739665  7596 raft_consensus.cc:697] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:10.740425  7596 consensus_queue.cc:237] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.748299  7290 catalog_manager.cc:5697] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 2 to 3, leader changed from 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 3 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.857285  7697 raft_consensus.cc:993] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:10.857661  7697 raft_consensus.cc:1081] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:10.858943  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37582
I20260709 12:25:10.859347  7468 raft_consensus.cc:493] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.859658  7468 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.863611  7468 raft_consensus.cc:515] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.864882  7468 leader_election.cc:290] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 3 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:10.865653  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:10.865803  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10e1f5ce2f8043738b44626b0c4fad10" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:10.866081  7396 raft_consensus.cc:3055] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:10.866268  7544 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.866343  7396 raft_consensus.cc:740] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:25:10.866997  7396 consensus_queue.cc:260] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.867830  7396 raft_consensus.cc:3060] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.871565  7544 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 3.
I20260709 12:25:10.871616  7396 raft_consensus.cc:2468] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 3.
I20260709 12:25:10.872682  7437 leader_election.cc:304] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:25:10.873299  7596 raft_consensus.cc:2804] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:10.873697  7596 raft_consensus.cc:697] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:10.874343  7596 consensus_queue.cc:237] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.880514  7290 catalog_manager.cc:5697] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 2 to 3, leader changed from 94a04d8844b34b7383c23a34627de45c (127.7.23.65) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 3 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:10.919508  7705 raft_consensus.cc:993] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:10.920008  7697 raft_consensus.cc:1081] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:10.921314  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37582
I20260709 12:25:10.921700  7468 raft_consensus.cc:493] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.921912  7468 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.925530  7468 raft_consensus.cc:515] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.926812  7468 leader_election.cc:290] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 3 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:10.927501  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:10.927822  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:10.927992  7396 raft_consensus.cc:3055] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:10.928256  7396 raft_consensus.cc:740] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:25:10.928298  7544 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.928814  7396 consensus_queue.cc:260] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.929557  7396 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.932518  7544 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 3.
I20260709 12:25:10.933949  7437 leader_election.cc:304] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:25:10.934180  7396 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 3.
I20260709 12:25:10.934605  7596 raft_consensus.cc:2804] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:10.934949  7596 raft_consensus.cc:697] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:10.936034  7596 consensus_queue.cc:237] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:10.942253  7290 catalog_manager.cc:5697] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 2 to 3, leader changed from 94a04d8844b34b7383c23a34627de45c (127.7.23.65) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 3 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.019368  7698 raft_consensus.cc:993] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:11.019809  7678 raft_consensus.cc:1081] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:11.021169  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37572
I20260709 12:25:11.021629  7468 raft_consensus.cc:493] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.021874  7468 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:11.025532  7468 raft_consensus.cc:515] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:11.026839  7468 leader_election.cc:290] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 4 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:11.027678  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:11.027850  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9fe9c8e11056483993c0fa1912f24f7c" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:11.028090  7396 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:11.028326  7544 raft_consensus.cc:3055] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:11.028585  7544 raft_consensus.cc:740] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:25:11.029212  7544 consensus_queue.cc:260] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:11.030054  7544 raft_consensus.cc:3060] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:11.032318  7396 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 4.
I20260709 12:25:11.033144  7435 leader_election.cc:304] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 94a04d8844b34b7383c23a34627de45c, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:25:11.033792  7596 raft_consensus.cc:2804] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:11.034199  7596 raft_consensus.cc:697] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 4 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:11.034932  7596 consensus_queue.cc:237] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:11.035710  7544 raft_consensus.cc:2468] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 4.
I20260709 12:25:11.040990  7290 catalog_manager.cc:5697] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 3 to 4, leader changed from 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 4 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.214819  7705 raft_consensus.cc:993] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c: : Instructing follower c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:11.215200  7705 raft_consensus.cc:1081] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Signalling peer c0cbf514952047afab98e451831e8866 to start an election
I20260709 12:25:11.216539  7468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895"
dest_uuid: "c0cbf514952047afab98e451831e8866"
 from {username='slave'} at 127.0.0.1:37582
I20260709 12:25:11.216888  7468 raft_consensus.cc:493] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:11.217098  7468 raft_consensus.cc:3060] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.220790  7468 raft_consensus.cc:515] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:11.222004  7468 leader_election.cc:290] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:11.222729  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:11.222985  7544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "565d31e2b0eb4b0eb5b0e428ceffb895" candidate_uuid: "c0cbf514952047afab98e451831e8866" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:11.223300  7396 raft_consensus.cc:3055] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:11.223582  7544 raft_consensus.cc:3060] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.223706  7396 raft_consensus.cc:740] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:25:11.224550  7545 raft_consensus.cc:1275] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.224385  7396 consensus_queue.cc:260] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:11.225479  7396 raft_consensus.cc:3060] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:11.225745  7596 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.228891  7544 raft_consensus.cc:2468] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:25:11.229965  7437 leader_election.cc:304] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:25:11.230791  7596 raft_consensus.cc:2804] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:11.231194  7596 raft_consensus.cc:697] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Leader. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:11.231943  7596 consensus_queue.cc:237] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:11.232831  7396 raft_consensus.cc:2468] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbf514952047afab98e451831e8866 in term 2.
I20260709 12:25:11.242059  7290 catalog_manager.cc:5697] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 reported cstate change: term changed from 1 to 2, leader changed from 94a04d8844b34b7383c23a34627de45c (127.7.23.65) to c0cbf514952047afab98e451831e8866 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c0cbf514952047afab98e451831e8866" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:11.244357  7396 raft_consensus.cc:1275] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.245530  7710 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.336385  7545 raft_consensus.cc:1275] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.337473  7710 consensus_queue.cc:1048] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.345837  7396 raft_consensus.cc:1275] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.347400  7712 consensus_queue.cc:1048] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.399691  7545 raft_consensus.cc:1275] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.400811  7712 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.409535  7396 raft_consensus.cc:1275] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:11.411082  7712 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:11.442790  7396 raft_consensus.cc:1275] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:11.443962  7712 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:11.451764  7545 raft_consensus.cc:1275] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:11.453454  7699 consensus_queue.cc:1048] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:11.775691  7545 raft_consensus.cc:1275] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.776760  7699 consensus_queue.cc:1048] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:11.785147  7396 raft_consensus.cc:1275] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Refusing update from remote peer c0cbf514952047afab98e451831e8866: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:11.786422  7710 consensus_queue.cc:1048] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:13.698997  7261 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:25:13.699679  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.705830  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216"
dest_uuid: "c0cbf514952047afab98e451831e8866"
mode: GRACEFUL
new_leader_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:37598
I20260709 12:25:13.706321  7468 raft_consensus.cc:606] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Received request to transfer leadership to TS 94a04d8844b34b7383c23a34627de45c
I20260709 12:25:13.708395  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391"
dest_uuid: "c0cbf514952047afab98e451831e8866"
mode: GRACEFUL
new_leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:37598
I20260709 12:25:13.708817  7468 raft_consensus.cc:606] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Received request to transfer leadership to TS 1f51b288aafc4fd0929e950d58ca8a93
I20260709 12:25:13.710803  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89"
dest_uuid: "c0cbf514952047afab98e451831e8866"
mode: GRACEFUL
new_leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:37598
I20260709 12:25:13.711177  7468 raft_consensus.cc:606] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Received request to transfer leadership to TS 1f51b288aafc4fd0929e950d58ca8a93
I20260709 12:25:13.713161  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad"
dest_uuid: "c0cbf514952047afab98e451831e8866"
mode: GRACEFUL
new_leader_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:37598
I20260709 12:25:13.713565  7468 raft_consensus.cc:606] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Received request to transfer leadership to TS 94a04d8844b34b7383c23a34627de45c
I20260709 12:25:13.715556  7468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247"
dest_uuid: "c0cbf514952047afab98e451831e8866"
mode: GRACEFUL
new_leader_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:37598
I20260709 12:25:13.715921  7468 raft_consensus.cc:606] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Received request to transfer leadership to TS 94a04d8844b34b7383c23a34627de45c
I20260709 12:25:13.716763  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:13.717300  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:13.844343  7726 raft_consensus.cc:993] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866: : Instructing follower 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:25:13.844771  7725 raft_consensus.cc:1081] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Signalling peer 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:25:13.846115  7396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:25:13.846575  7396 raft_consensus.cc:493] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:13.846832  7396 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:13.850616  7396 raft_consensus.cc:515] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:13.852420  7396 leader_election.cc:290] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 3 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:13.853188  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:25:13.853433  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c482ccbd16e2402a8520eb6e45c9cfad" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:13.853778  7468 raft_consensus.cc:3055] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:13.853894  7545 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:13.854121  7468 raft_consensus.cc:740] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:13.854766  7468 consensus_queue.cc:260] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:13.855880  7468 raft_consensus.cc:3060] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:13.857963  7545 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 3.
I20260709 12:25:13.859023  7362 leader_election.cc:304] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:25:13.860414  7468 raft_consensus.cc:2468] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 3.
I20260709 12:25:13.860653  7727 raft_consensus.cc:2804] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:13.861871  7727 raft_consensus.cc:697] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 3 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:25:13.862085  7726 raft_consensus.cc:993] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: : Instructing follower 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:13.862632  7725 raft_consensus.cc:1081] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Signalling peer 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:13.862903  7727 consensus_queue.cc:237] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:13.864137  7545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:34676
I20260709 12:25:13.864609  7545 raft_consensus.cc:493] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:13.864918  7545 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:13.869078  7545 raft_consensus.cc:515] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:13.869884  7290 catalog_manager.cc:5697] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 2 to 3, leader changed from c0cbf514952047afab98e451831e8866 (127.7.23.66) to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 3 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.870867  7545 leader_election.cc:290] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 4 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:25:13.871549  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:13.871976  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7904e17a661e4e7589cd99ad88fb6391" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:25:13.872052  7396 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:13.872463  7468 raft_consensus.cc:3055] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:13.872771  7468 raft_consensus.cc:740] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:13.873375  7468 consensus_queue.cc:260] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:13.874130  7468 raft_consensus.cc:3060] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:13.877880  7468 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 4.
I20260709 12:25:13.878631  7396 raft_consensus.cc:2468] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 4.
I20260709 12:25:13.878953  7510 leader_election.cc:304] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, c0cbf514952047afab98e451831e8866; no voters: 
I20260709 12:25:13.879729  7678 raft_consensus.cc:2804] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:13.880910  7678 raft_consensus.cc:697] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:25:13.881645  7678 consensus_queue.cc:237] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:13.890040  7291 catalog_manager.cc:5697] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 3 to 4, leader changed from c0cbf514952047afab98e451831e8866 (127.7.23.66) to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 4 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.033162  7726 raft_consensus.cc:993] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866: : Instructing follower 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:14.033645  7725 raft_consensus.cc:1081] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Signalling peer 1f51b288aafc4fd0929e950d58ca8a93 to start an election
I20260709 12:25:14.035128  7545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89"
dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
 from {username='slave'} at 127.0.0.1:34676
I20260709 12:25:14.035573  7545 raft_consensus.cc:493] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.035833  7545 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.040663  7545 raft_consensus.cc:515] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.042058  7545 leader_election.cc:290] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 3 election: Requested vote from peers 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273), c0cbf514952047afab98e451831e8866 (127.7.23.66:36325)
I20260709 12:25:14.042762  7396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "94a04d8844b34b7383c23a34627de45c"
I20260709 12:25:14.042977  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "791af6451e9e4246bd2a43083e09dc89" candidate_uuid: "1f51b288aafc4fd0929e950d58ca8a93" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:25:14.043267  7396 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.043500  7468 raft_consensus.cc:3055] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:14.043785  7468 raft_consensus.cc:740] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:14.044330  7468 consensus_queue.cc:260] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.045083  7468 raft_consensus.cc:3060] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.047327  7396 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 3.
I20260709 12:25:14.048293  7509 leader_election.cc:304] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:25:14.048924  7678 raft_consensus.cc:2804] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:14.049330  7678 raft_consensus.cc:697] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 LEADER]: Becoming Leader. State: Replica: 1f51b288aafc4fd0929e950d58ca8a93, State: Running, Role: LEADER
I20260709 12:25:14.049440  7468 raft_consensus.cc:2468] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f51b288aafc4fd0929e950d58ca8a93 in term 3.
I20260709 12:25:14.050099  7678 consensus_queue.cc:237] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.056366  7726 raft_consensus.cc:993] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866: : Instructing follower 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:25:14.056758  7725 raft_consensus.cc:1081] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Signalling peer 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:25:14.057058  7291 catalog_manager.cc:5697] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 reported cstate change: term changed from 2 to 3, leader changed from c0cbf514952047afab98e451831e8866 (127.7.23.66) to 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67). New cstate: current_term: 3 leader_uuid: "1f51b288aafc4fd0929e950d58ca8a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:14.057964  7396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:25:14.058341  7396 raft_consensus.cc:493] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.058588  7396 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:14.063275  7396 raft_consensus.cc:515] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.064924  7396 leader_election.cc:290] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 4 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:14.065366  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:25:14.065850  7468 raft_consensus.cc:3055] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:14.065929  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40fb4fad1f47719c47a48c8b576247" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:14.066190  7468 raft_consensus.cc:740] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:14.066417  7545 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:14.066871  7468 consensus_queue.cc:260] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.067945  7468 raft_consensus.cc:3060] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:14.072072  7545 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 4.
I20260709 12:25:14.073043  7362 leader_election.cc:304] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:25:14.073501  7468 raft_consensus.cc:2468] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 4.
I20260709 12:25:14.073776  7727 raft_consensus.cc:2804] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:14.074209  7727 raft_consensus.cc:697] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 4 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:25:14.074946  7727 consensus_queue.cc:237] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.081264  7291 catalog_manager.cc:5697] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 3 to 4, leader changed from c0cbf514952047afab98e451831e8866 (127.7.23.66) to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 4 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.100579  7726 raft_consensus.cc:993] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866: : Instructing follower 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:25:14.100948  7725 raft_consensus.cc:1081] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Signalling peer 94a04d8844b34b7383c23a34627de45c to start an election
I20260709 12:25:14.102195  7396 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216"
dest_uuid: "94a04d8844b34b7383c23a34627de45c"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:25:14.102571  7396 raft_consensus.cc:493] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.102789  7396 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.106529  7396 raft_consensus.cc:515] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.107832  7396 leader_election.cc:290] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 3 election: Requested vote from peers c0cbf514952047afab98e451831e8866 (127.7.23.66:36325), 1f51b288aafc4fd0929e950d58ca8a93 (127.7.23.67:35343)
I20260709 12:25:14.108502  7468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0cbf514952047afab98e451831e8866"
I20260709 12:25:14.108716  7545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b45213d6714064b7ca57b6ed47a216" candidate_uuid: "94a04d8844b34b7383c23a34627de45c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f51b288aafc4fd0929e950d58ca8a93"
I20260709 12:25:14.109026  7468 raft_consensus.cc:3055] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:14.109192  7545 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.109350  7468 raft_consensus.cc:740] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0cbf514952047afab98e451831e8866, State: Running, Role: LEADER
I20260709 12:25:14.110128  7468 consensus_queue.cc:260] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.111212  7468 raft_consensus.cc:3060] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.114765  7545 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 3.
I20260709 12:25:14.115736  7362 leader_election.cc:304] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f51b288aafc4fd0929e950d58ca8a93, 94a04d8844b34b7383c23a34627de45c; no voters: 
I20260709 12:25:14.116338  7727 raft_consensus.cc:2804] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:14.116359  7468 raft_consensus.cc:2468] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a04d8844b34b7383c23a34627de45c in term 3.
I20260709 12:25:14.116782  7727 raft_consensus.cc:697] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 3 LEADER]: Becoming Leader. State: Replica: 94a04d8844b34b7383c23a34627de45c, State: Running, Role: LEADER
I20260709 12:25:14.117635  7727 consensus_queue.cc:237] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } }
I20260709 12:25:14.123910  7291 catalog_manager.cc:5697] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c reported cstate change: term changed from 2 to 3, leader changed from c0cbf514952047afab98e451831e8866 (127.7.23.66) to 94a04d8844b34b7383c23a34627de45c (127.7.23.65). New cstate: current_term: 3 leader_uuid: "94a04d8844b34b7383c23a34627de45c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:14.255453  7545 raft_consensus.cc:1275] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.256914  7727 consensus_queue.cc:1048] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:14.263813  7396 raft_consensus.cc:1275] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:14.265532  7678 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:14.270761  7468 raft_consensus.cc:1275] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.272495  7727 consensus_queue.cc:1048] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.292264  7468 raft_consensus.cc:1275] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:14.293776  7678 consensus_queue.cc:1048] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:14.495514  7396 raft_consensus.cc:1275] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.496778  7678 consensus_queue.cc:1048] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a04d8844b34b7383c23a34627de45c" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.505568  7468 raft_consensus.cc:1275] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Refusing update from remote peer 1f51b288aafc4fd0929e950d58ca8a93: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.507165  7749 consensus_queue.cc:1048] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:14.521487  7545 raft_consensus.cc:1275] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:14.522557  7727 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:14.530917  7468 raft_consensus.cc:1275] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:14.532536  7728 consensus_queue.cc:1048] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:14.607095  7545 raft_consensus.cc:1275] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.608314  7468 raft_consensus.cc:1275] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Refusing update from remote peer 94a04d8844b34b7383c23a34627de45c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:14.608228  7728 consensus_queue.cc:1048] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f51b288aafc4fd0929e950d58ca8a93" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 35343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.609422  7742 consensus_queue.cc:1048] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbf514952047afab98e451831e8866" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 36325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:14.718672  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:14.724259  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:14.724669  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:15.725737  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:15.730484  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:15.730871  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.731940  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:16.737653  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:16.738006  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:17.738965  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:17.743458  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:17.743832  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:18.744728  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.749542  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:18.749991  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.771203  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.779157  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:19.779673  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:20.715399  7324 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 7264
W20260709 12:25:20.716238  7324 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 7327
W20260709 12:25:20.717175  7324 debug-util.cc:398] Leaking SignalData structure 0x7b080018d500 after lost signal to thread 7420
W20260709 12:25:20.718035  7324 debug-util.cc:398] Leaking SignalData structure 0x7b08001537e0 after lost signal to thread 7495
W20260709 12:25:20.718974  7324 debug-util.cc:398] Leaking SignalData structure 0x7b08001e90c0 after lost signal to thread 7569
I20260709 12:25:20.781035  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:20.788244  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:20.788750  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:21.789961  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.797049  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:21.797537  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:22.798631  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:22.803189  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:22.803599  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.827807  7261 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:25:23.828485  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
I20260709 12:25:23.848129  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:23.848807  7261 tablet_replica.cc:333] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.849472  7261 raft_consensus.cc:2243] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:23.849960  7261 raft_consensus.cc:2272] T 791af6451e9e4246bd2a43083e09dc89 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:23.852120  7261 tablet_replica.cc:333] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.852731  7261 raft_consensus.cc:2243] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:23.853434  7261 raft_consensus.cc:2272] T c482ccbd16e2402a8520eb6e45c9cfad P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:23.853689  7509 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:25:23.855680  7261 tablet_replica.cc:333] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.856302  7261 raft_consensus.cc:2243] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:23.856684  7261 raft_consensus.cc:2272] T fc6eb4ceadb845eeb3cf11da41044d1d P 94a04d8844b34b7383c23a34627de45c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:23.856766  7509 consensus_peers.cc:597] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 -> Peer 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273): Couldn't send request to peer 94a04d8844b34b7383c23a34627de45c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.858259  7261 tablet_replica.cc:333] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.858752  7261 raft_consensus.cc:2243] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:23.859356  7261 raft_consensus.cc:2272] T dd40fb4fad1f47719c47a48c8b576247 P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:23.860881  7261 tablet_replica.cc:333] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.861310  7261 raft_consensus.cc:2243] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:23.861671  7261 raft_consensus.cc:2272] T 10e1f5ce2f8043738b44626b0c4fad10 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:23.863180  7261 tablet_replica.cc:333] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.863649  7261 raft_consensus.cc:2243] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:23.864040  7261 raft_consensus.cc:2272] T 9fe9c8e11056483993c0fa1912f24f7c P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:23.865573  7261 tablet_replica.cc:333] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.866004  7261 raft_consensus.cc:2243] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:23.866405  7261 raft_consensus.cc:2272] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 94a04d8844b34b7383c23a34627de45c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:23.867944  7261 tablet_replica.cc:333] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.868356  7261 raft_consensus.cc:2243] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:23.868976  7261 raft_consensus.cc:2272] T 38b45213d6714064b7ca57b6ed47a216 P 94a04d8844b34b7383c23a34627de45c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:23.870425  7261 tablet_replica.cc:333] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c: stopping tablet replica
I20260709 12:25:23.870813  7261 raft_consensus.cc:2243] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:23.871161  7261 raft_consensus.cc:2272] T 7904e17a661e4e7589cd99ad88fb6391 P 94a04d8844b34b7383c23a34627de45c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:23.953593  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
W20260709 12:25:23.954095  7509 consensus_peers.cc:597] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 -> Peer 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273): Couldn't send request to peer 94a04d8844b34b7383c23a34627de45c. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:42273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.954437  7509 consensus_peers.cc:597] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 -> Peer 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273): Couldn't send request to peer 94a04d8844b34b7383c23a34627de45c. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:42273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:23.972674  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
W20260709 12:25:23.973011  7435 consensus_peers.cc:597] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 -> Peer 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273): Couldn't send request to peer 94a04d8844b34b7383c23a34627de45c. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:42273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.996874  7510 consensus_peers.cc:597] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 -> Peer c0cbf514952047afab98e451831e8866 (127.7.23.66:36325): Couldn't send request to peer c0cbf514952047afab98e451831e8866. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:23.997519  7435 consensus_peers.cc:597] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 -> Peer 94a04d8844b34b7383c23a34627de45c (127.7.23.65:42273): Couldn't send request to peer 94a04d8844b34b7383c23a34627de45c. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:42273: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:24.000474  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:24.001133  7261 tablet_replica.cc:333] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.001900  7261 raft_consensus.cc:2243] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.002445  7261 raft_consensus.cc:2272] T 791af6451e9e4246bd2a43083e09dc89 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.004427  7261 tablet_replica.cc:333] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.005051  7261 raft_consensus.cc:2243] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.005528  7261 raft_consensus.cc:2272] T c482ccbd16e2402a8520eb6e45c9cfad P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.007237  7261 tablet_replica.cc:333] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.007738  7261 raft_consensus.cc:2243] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:24.008710  7261 raft_consensus.cc:2272] T 565d31e2b0eb4b0eb5b0e428ceffb895 P c0cbf514952047afab98e451831e8866 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.010761  7261 tablet_replica.cc:333] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.011222  7261 raft_consensus.cc:2243] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:24.012068  7261 raft_consensus.cc:2272] T 9fe9c8e11056483993c0fa1912f24f7c P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.014014  7261 tablet_replica.cc:333] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.014515  7261 raft_consensus.cc:2243] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:24.015295  7261 raft_consensus.cc:2272] T 10e1f5ce2f8043738b44626b0c4fad10 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.017450  7261 tablet_replica.cc:333] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.018064  7261 raft_consensus.cc:2243] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.018510  7261 raft_consensus.cc:2272] T 7904e17a661e4e7589cd99ad88fb6391 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.020264  7261 tablet_replica.cc:333] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.020705  7261 raft_consensus.cc:2243] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.021095  7261 raft_consensus.cc:2272] T 38b45213d6714064b7ca57b6ed47a216 P c0cbf514952047afab98e451831e8866 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.022943  7261 tablet_replica.cc:333] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.023437  7261 raft_consensus.cc:2243] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.023900  7261 raft_consensus.cc:2272] T fc6eb4ceadb845eeb3cf11da41044d1d P c0cbf514952047afab98e451831e8866 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.025770  7261 tablet_replica.cc:333] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866: stopping tablet replica
I20260709 12:25:24.026309  7261 raft_consensus.cc:2243] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.026769  7261 raft_consensus.cc:2272] T dd40fb4fad1f47719c47a48c8b576247 P c0cbf514952047afab98e451831e8866 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.053714  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
I20260709 12:25:24.069905  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
W20260709 12:25:24.077217  7510 consensus_peers.cc:597] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 -> Peer c0cbf514952047afab98e451831e8866 (127.7.23.66:36325): Couldn't send request to peer c0cbf514952047afab98e451831e8866. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:36325: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:24.091334  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:24.091965  7261 tablet_replica.cc:333] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.092463  7261 raft_consensus.cc:2243] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:24.093098  7261 raft_consensus.cc:2272] T 791af6451e9e4246bd2a43083e09dc89 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.094696  7261 tablet_replica.cc:333] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.095145  7261 raft_consensus.cc:2243] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.095559  7261 raft_consensus.cc:2272] T c482ccbd16e2402a8520eb6e45c9cfad P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.096967  7261 tablet_replica.cc:333] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.097398  7261 raft_consensus.cc:2243] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.097728  7261 raft_consensus.cc:2272] T 9fe9c8e11056483993c0fa1912f24f7c P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.099181  7261 tablet_replica.cc:333] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.099632  7261 raft_consensus.cc:2243] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.099982  7261 raft_consensus.cc:2272] T 10e1f5ce2f8043738b44626b0c4fad10 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.101418  7261 tablet_replica.cc:333] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.101819  7261 raft_consensus.cc:2243] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:24.102440  7261 raft_consensus.cc:2272] T 7904e17a661e4e7589cd99ad88fb6391 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.103932  7261 tablet_replica.cc:333] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.104350  7261 raft_consensus.cc:2243] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.104676  7261 raft_consensus.cc:2272] T 38b45213d6714064b7ca57b6ed47a216 P 1f51b288aafc4fd0929e950d58ca8a93 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.105973  7261 tablet_replica.cc:333] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.106369  7261 raft_consensus.cc:2243] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.106815  7261 raft_consensus.cc:2272] T dd40fb4fad1f47719c47a48c8b576247 P 1f51b288aafc4fd0929e950d58ca8a93 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.108760  7261 tablet_replica.cc:333] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.109339  7261 raft_consensus.cc:2243] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:24.110112  7261 raft_consensus.cc:2272] T fc6eb4ceadb845eeb3cf11da41044d1d P 1f51b288aafc4fd0929e950d58ca8a93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.111563  7261 tablet_replica.cc:333] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93: stopping tablet replica
I20260709 12:25:24.111946  7261 raft_consensus.cc:2243] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:24.112277  7261 raft_consensus.cc:2272] T 565d31e2b0eb4b0eb5b0e428ceffb895 P 1f51b288aafc4fd0929e950d58ca8a93 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.138084  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
I20260709 12:25:24.154160  7261 master.cc:562] Master@127.7.23.126:37685 shutting down...
I20260709 12:25:24.295310  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:24.296268  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:24.296607  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P e1c3f1cd96ef4e788e4ca5ee369922d7: stopping tablet replica
I20260709 12:25:24.332273  7261 master.cc:584] Master@127.7.23.126:37685 shutdown complete.
1f51b288aafc4fd0929e950d58ca8a93  1
94a04d8844b34b7383c23a34627de45c  4
c0cbf514952047afab98e451831e8866  4
1f51b288aafc4fd0929e950d58ca8a93  3
94a04d8844b34b7383c23a34627de45c  3
c0cbf514952047afab98e451831e8866  3
1f51b288aafc4fd0929e950d58ca8a93  1
94a04d8844b34b7383c23a34627de45c  0
c0cbf514952047afab98e451831e8866  8
1f51b288aafc4fd0929e950d58ca8a93  3
94a04d8844b34b7383c23a34627de45c  3
c0cbf514952047afab98e451831e8866  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30252 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:25:24.371776  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:36399
I20260709 12:25:24.372831  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:24.378154  7773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.378176  7772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.378929  7775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:24.379307  7261 server_base.cc:1061] running on GCE node
I20260709 12:25:24.380175  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:24.380340  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:24.380448  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599924380438 us; error 0 us; skew 500 ppm
I20260709 12:25:24.380875  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:24.383046  7261 webserver.cc:533] Webserver started at http://127.7.23.126:37363/ using document root <none> and password file <none>
I20260709 12:25:24.383514  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:24.383675  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:24.383882  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:24.385080  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "49881dee8f894e5bb55a237f5894106a"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.389230  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:25:24.392225  7780 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.392889  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:24.393127  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "49881dee8f894e5bb55a237f5894106a"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.393353  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:24.413805  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:24.414949  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:24.450558  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:36399
I20260709 12:25:24.450636  7831 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:36399 every 8 connection(s)
I20260709 12:25:24.454274  7832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.463532  7832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a: Bootstrap starting.
I20260709 12:25:24.468082  7832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:24.472024  7832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a: No bootstrap required, opened a new log
I20260709 12:25:24.474069  7832 raft_consensus.cc:359] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49881dee8f894e5bb55a237f5894106a" member_type: VOTER }
I20260709 12:25:24.474489  7832 raft_consensus.cc:385] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:24.474700  7832 raft_consensus.cc:740] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49881dee8f894e5bb55a237f5894106a, State: Initialized, Role: FOLLOWER
I20260709 12:25:24.475265  7832 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49881dee8f894e5bb55a237f5894106a" member_type: VOTER }
I20260709 12:25:24.475751  7832 raft_consensus.cc:399] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:24.475968  7832 raft_consensus.cc:493] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:24.476226  7832 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:24.479995  7832 raft_consensus.cc:515] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49881dee8f894e5bb55a237f5894106a" member_type: VOTER }
I20260709 12:25:24.480458  7832 leader_election.cc:304] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49881dee8f894e5bb55a237f5894106a; no voters: 
I20260709 12:25:24.481462  7832 leader_election.cc:290] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:24.481809  7835 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:24.483038  7835 raft_consensus.cc:697] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 1 LEADER]: Becoming Leader. State: Replica: 49881dee8f894e5bb55a237f5894106a, State: Running, Role: LEADER
I20260709 12:25:24.483635  7835 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49881dee8f894e5bb55a237f5894106a" member_type: VOTER }
I20260709 12:25:24.484189  7832 sys_catalog.cc:565] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:24.490087  7836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49881dee8f894e5bb55a237f5894106a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49881dee8f894e5bb55a237f5894106a" member_type: VOTER } }
I20260709 12:25:24.490278  7837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49881dee8f894e5bb55a237f5894106a. Latest consensus state: current_term: 1 leader_uuid: "49881dee8f894e5bb55a237f5894106a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49881dee8f894e5bb55a237f5894106a" member_type: VOTER } }
I20260709 12:25:24.490851  7836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:24.490955  7837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:24.492594  7845 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:24.497498  7845 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:24.498538  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:24.505709  7845 catalog_manager.cc:1383] Generated new cluster ID: d9f62680205c455382c19de3703aecd1
I20260709 12:25:24.505944  7845 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:24.521603  7845 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:24.522763  7845 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:24.541750  7845 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a: Generated new TSK 0
I20260709 12:25:24.542266  7845 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:24.564952  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:24.570760  7853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.571491  7854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.572854  7856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:24.573185  7261 server_base.cc:1061] running on GCE node
I20260709 12:25:24.574079  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:24.574261  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:24.574420  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599924574403 us; error 0 us; skew 500 ppm
I20260709 12:25:24.574954  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:24.577086  7261 webserver.cc:533] Webserver started at http://127.7.23.65:37083/ using document root <none> and password file <none>
I20260709 12:25:24.577538  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:24.577705  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:24.577965  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:24.579010  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "6a11c60e8742448bb36b6d105fb8cb24"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.583117  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:25:24.586201  7861 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.586848  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:24.587103  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "6a11c60e8742448bb36b6d105fb8cb24"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.587352  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:24.601393  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:24.602520  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:24.603919  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:24.606086  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:24.606267  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.606491  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:24.606657  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.644085  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:42131
I20260709 12:25:24.644168  7923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:42131 every 8 connection(s)
I20260709 12:25:24.648737  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:24.655128  7928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.656644  7929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.658324  7931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:24.660998  7924 heartbeater.cc:344] Connected to a master server at 127.7.23.126:36399
I20260709 12:25:24.661156  7261 server_base.cc:1061] running on GCE node
I20260709 12:25:24.661371  7924 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:24.662108  7924 heartbeater.cc:507] Master 127.7.23.126:36399 requested a full tablet report, sending...
I20260709 12:25:24.662544  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:24.662739  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:24.662910  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599924662891 us; error 0 us; skew 500 ppm
I20260709 12:25:24.663517  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:24.664212  7797 ts_manager.cc:194] Registered new tserver with Master: 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131)
I20260709 12:25:24.666105  7261 webserver.cc:533] Webserver started at http://127.7.23.66:38635/ using document root <none> and password file <none>
I20260709 12:25:24.666435  7797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42832
I20260709 12:25:24.666633  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:24.666862  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:24.667117  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:24.668505  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.672662  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:25:24.675685  7936 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.676330  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:24.676589  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.676838  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:24.709323  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:24.710507  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:24.712206  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:24.714349  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:24.714536  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.714767  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:24.714915  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.751114  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:35399
I20260709 12:25:24.751209  7998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:35399 every 8 connection(s)
I20260709 12:25:24.755499  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:24.762116  8002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.763605  8003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:24.765525  8005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:24.766214  7999 heartbeater.cc:344] Connected to a master server at 127.7.23.126:36399
I20260709 12:25:24.766517  7999 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:24.766731  7261 server_base.cc:1061] running on GCE node
I20260709 12:25:24.767362  7999 heartbeater.cc:507] Master 127.7.23.126:36399 requested a full tablet report, sending...
I20260709 12:25:24.767695  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:24.767942  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:24.768136  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599924768117 us; error 0 us; skew 500 ppm
I20260709 12:25:24.768729  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:24.769390  7797 ts_manager.cc:194] Registered new tserver with Master: bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:24.770877  7797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42836
I20260709 12:25:24.771062  7261 webserver.cc:533] Webserver started at http://127.7.23.67:34135/ using document root <none> and password file <none>
I20260709 12:25:24.771620  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:24.771806  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:24.772059  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:24.773109  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "00cd69f96ebb4807860f7a4adf9926b5"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.777097  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:25:24.780128  8010 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.780773  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:25:24.781020  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "00cd69f96ebb4807860f7a4adf9926b5"
format_stamp: "Formatted at 2026-07-09 12:25:24 on dist-test-slave-ps85"
I20260709 12:25:24.781268  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:24.794138  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:24.795324  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:24.796738  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:24.798826  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:24.799012  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.799224  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:24.799374  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:24.836272  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:41085
I20260709 12:25:24.836366  8072 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:41085 every 8 connection(s)
I20260709 12:25:24.848867  8073 heartbeater.cc:344] Connected to a master server at 127.7.23.126:36399
I20260709 12:25:24.849197  8073 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:24.849874  8073 heartbeater.cc:507] Master 127.7.23.126:36399 requested a full tablet report, sending...
I20260709 12:25:24.851595  7797 ts_manager.cc:194] Registered new tserver with Master: 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:24.852131  7261 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012995442s
I20260709 12:25:24.852830  7797 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42848
I20260709 12:25:24.874598  7797 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42852:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:24.877271  7797 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:24.953351  7889 tablet_service.cc:1511] Processing CreateTablet for tablet 96da851c7beb4d22b1774e7b2ed141ce (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:24.954771  7889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96da851c7beb4d22b1774e7b2ed141ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.956589  8038 tablet_service.cc:1511] Processing CreateTablet for tablet 96da851c7beb4d22b1774e7b2ed141ce (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:24.956633  8036 tablet_service.cc:1511] Processing CreateTablet for tablet 093d8a84cdcb47cbae704f3800be7674 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:24.957968  8038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96da851c7beb4d22b1774e7b2ed141ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.959184  8033 tablet_service.cc:1511] Processing CreateTablet for tablet 34bc111abaf44a139bd81404762479bf (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:24.960508  7888 tablet_service.cc:1511] Processing CreateTablet for tablet b2a1f97f360d445b81e445e3fb4517dd (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:24.961143  8031 tablet_service.cc:1511] Processing CreateTablet for tablet 70cc0a342b2943bd8c3f6cd9101ce92a (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:24.961762  7888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a1f97f360d445b81e445e3fb4517dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.961871  8030 tablet_service.cc:1511] Processing CreateTablet for tablet ce94d8a4ccd2484794a76653e90c8b87 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:24.963001  8034 tablet_service.cc:1511] Processing CreateTablet for tablet 882454296e07428092d0a23c75c2dc2b (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:24.963384  8035 tablet_service.cc:1511] Processing CreateTablet for tablet 88b9c913a6144f65bc61967680f3c7da (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:24.964560  8033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bc111abaf44a139bd81404762479bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.964347  7964 tablet_service.cc:1511] Processing CreateTablet for tablet 96da851c7beb4d22b1774e7b2ed141ce (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:25:24.965317  8030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce94d8a4ccd2484794a76653e90c8b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.965580  7964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96da851c7beb4d22b1774e7b2ed141ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.966122  8034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882454296e07428092d0a23c75c2dc2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.965781  7886 tablet_service.cc:1511] Processing CreateTablet for tablet 88b9c913a6144f65bc61967680f3c7da (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:24.967033  7886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b9c913a6144f65bc61967680f3c7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.968544  7885 tablet_service.cc:1511] Processing CreateTablet for tablet 882454296e07428092d0a23c75c2dc2b (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:24.968999  8035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b9c913a6144f65bc61967680f3c7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.969810  7885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882454296e07428092d0a23c75c2dc2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.972784  7884 tablet_service.cc:1511] Processing CreateTablet for tablet 34bc111abaf44a139bd81404762479bf (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:24.972990  7882 tablet_service.cc:1511] Processing CreateTablet for tablet 70cc0a342b2943bd8c3f6cd9101ce92a (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:24.974047  7884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bc111abaf44a139bd81404762479bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.975085  8032 tablet_service.cc:1511] Processing CreateTablet for tablet 9289119bbaed43a785dc8d934b329ec4 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:24.976408  8037 tablet_service.cc:1511] Processing CreateTablet for tablet b2a1f97f360d445b81e445e3fb4517dd (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:24.977077  7883 tablet_service.cc:1511] Processing CreateTablet for tablet 9289119bbaed43a785dc8d934b329ec4 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:24.978269  7883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9289119bbaed43a785dc8d934b329ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.978430  7880 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef440a066f94470a7e1c471bc09d7c2 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:24.979673  7880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef440a066f94470a7e1c471bc09d7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.964497  7887 tablet_service.cc:1511] Processing CreateTablet for tablet 093d8a84cdcb47cbae704f3800be7674 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:24.980444  7881 tablet_service.cc:1511] Processing CreateTablet for tablet ce94d8a4ccd2484794a76653e90c8b87 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:24.983037  7963 tablet_service.cc:1511] Processing CreateTablet for tablet b2a1f97f360d445b81e445e3fb4517dd (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:25:24.984262  7963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a1f97f360d445b81e445e3fb4517dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.996110  7962 tablet_service.cc:1511] Processing CreateTablet for tablet 093d8a84cdcb47cbae704f3800be7674 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:25:24.997505  7962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093d8a84cdcb47cbae704f3800be7674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.998631  7887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093d8a84cdcb47cbae704f3800be7674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.002408  7959 tablet_service.cc:1511] Processing CreateTablet for tablet 34bc111abaf44a139bd81404762479bf (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:25:25.003690  7959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34bc111abaf44a139bd81404762479bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.006723  7881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce94d8a4ccd2484794a76653e90c8b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.007367  7882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70cc0a342b2943bd8c3f6cd9101ce92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.998339  8031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70cc0a342b2943bd8c3f6cd9101ce92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:24.999922  7961 tablet_service.cc:1511] Processing CreateTablet for tablet 88b9c913a6144f65bc61967680f3c7da (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:25:25.012923  7958 tablet_service.cc:1511] Processing CreateTablet for tablet 9289119bbaed43a785dc8d934b329ec4 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:25:25.013406  7960 tablet_service.cc:1511] Processing CreateTablet for tablet 882454296e07428092d0a23c75c2dc2b (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:25:25.013659  7957 tablet_service.cc:1511] Processing CreateTablet for tablet 70cc0a342b2943bd8c3f6cd9101ce92a (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:25:25.016530  7956 tablet_service.cc:1511] Processing CreateTablet for tablet ce94d8a4ccd2484794a76653e90c8b87 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:25:25.019198  8036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 093d8a84cdcb47cbae704f3800be7674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.019039  7955 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef440a066f94470a7e1c471bc09d7c2 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:25.020417  7955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef440a066f94470a7e1c471bc09d7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.022046  7957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70cc0a342b2943bd8c3f6cd9101ce92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.036013  8035 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef440a066f94470a7e1c471bc09d7c2 (DEFAULT_TABLE table=test-workload [id=44981c54c4ec4c41964132b829160f84]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:25:25.037297  8035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef440a066f94470a7e1c471bc09d7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.039750  8037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2a1f97f360d445b81e445e3fb4517dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.040398  7958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9289119bbaed43a785dc8d934b329ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.042016  8088 tablet_bootstrap.cc:492] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.043567  8032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9289119bbaed43a785dc8d934b329ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.043942  7961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88b9c913a6144f65bc61967680f3c7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.047772  7960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882454296e07428092d0a23c75c2dc2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.051750  7956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce94d8a4ccd2484794a76653e90c8b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:25.066402  8089 tablet_bootstrap.cc:492] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.088769  8088 tablet_bootstrap.cc:654] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.130015  8089 tablet_bootstrap.cc:654] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.156718  8090 tablet_bootstrap.cc:492] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.159312  8088 tablet_bootstrap.cc:492] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.159775  8088 ts_tablet_manager.cc:1403] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.118s	user 0.026s	sys 0.017s
I20260709 12:25:25.163535  8089 tablet_bootstrap.cc:492] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.163975  8089 ts_tablet_manager.cc:1403] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.001s
I20260709 12:25:25.164848  8090 tablet_bootstrap.cc:654] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.166586  8088 raft_consensus.cc:359] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.166739  8089 raft_consensus.cc:359] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.167341  8088 raft_consensus.cc:385] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.167430  8089 raft_consensus.cc:385] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.167770  8088 raft_consensus.cc:740] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.167811  8089 raft_consensus.cc:740] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.168869  8090 tablet_bootstrap.cc:492] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.168591  8088 consensus_queue.cc:260] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.168704  8089 consensus_queue.cc:260] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.169216  8090 ts_tablet_manager.cc:1403] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:25:25.170926  8073 heartbeater.cc:499] Master 127.7.23.126:36399 was elected leader, sending a full tablet report...
I20260709 12:25:25.171542  8088 ts_tablet_manager.cc:1434] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:25.172020  8090 raft_consensus.cc:359] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.172488  8088 tablet_bootstrap.cc:492] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.172708  8090 raft_consensus.cc:385] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.173020  8090 raft_consensus.cc:740] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.173797  8090 consensus_queue.cc:260] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.177646  8089 ts_tablet_manager.cc:1434] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:25:25.178645  8089 tablet_bootstrap.cc:492] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.178828  8088 tablet_bootstrap.cc:654] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.179715  7924 heartbeater.cc:499] Master 127.7.23.126:36399 was elected leader, sending a full tablet report...
I20260709 12:25:25.184930  8089 tablet_bootstrap.cc:654] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.190405  8088 tablet_bootstrap.cc:492] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.190923  8088 ts_tablet_manager.cc:1403] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 12:25:25.190937  8095 raft_consensus.cc:493] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.191847  8095 raft_consensus.cc:515] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.194044  8088 raft_consensus.cc:359] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.194738  8088 raft_consensus.cc:385] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.195026  8088 raft_consensus.cc:740] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.195839  8088 consensus_queue.cc:260] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.198619  8095 leader_election.cc:290] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.217031  7999 heartbeater.cc:499] Master 127.7.23.126:36399 was elected leader, sending a full tablet report...
I20260709 12:25:25.217545  8090 ts_tablet_manager.cc:1434] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.048s	user 0.015s	sys 0.026s
I20260709 12:25:25.220180  8089 tablet_bootstrap.cc:492] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.218565  8090 tablet_bootstrap.cc:492] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.220754  8089 ts_tablet_manager.cc:1403] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.003s
I20260709 12:25:25.223598  8089 raft_consensus.cc:359] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.224347  8089 raft_consensus.cc:385] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.224690  8089 raft_consensus.cc:740] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.225571  8089 consensus_queue.cc:260] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.216982  8096 raft_consensus.cc:493] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.228363  8089 ts_tablet_manager.cc:1434] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:25.229307  8096 raft_consensus.cc:515] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.229893  8089 tablet_bootstrap.cc:492] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.230657  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.233070  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
W20260709 12:25:25.234704  8013 leader_election.cc:343] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:25.235356  8013 leader_election.cc:343] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.235780  8013 leader_election.cc:304] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5; no voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:25.236615  8100 raft_consensus.cc:2749] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.238442  8089 tablet_bootstrap.cc:654] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.238829  8088 ts_tablet_manager.cc:1434] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.048s	user 0.013s	sys 0.007s
I20260709 12:25:25.239434  8096 leader_election.cc:290] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.239771  8088 tablet_bootstrap.cc:492] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.226543  8090 tablet_bootstrap.cc:654] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.246068  8088 tablet_bootstrap.cc:654] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.250357  8089 tablet_bootstrap.cc:492] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.250885  8089 ts_tablet_manager.cc:1403] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.014s
I20260709 12:25:25.253690  8089 raft_consensus.cc:359] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.254588  8089 raft_consensus.cc:385] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.254935  8089 raft_consensus.cc:740] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.255828  8089 consensus_queue.cc:260] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.258250  8089 ts_tablet_manager.cc:1434] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:25.259279  8089 tablet_bootstrap.cc:492] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.261981  8100 raft_consensus.cc:493] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.262450  8100 raft_consensus.cc:515] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.264623  8100 leader_election.cc:290] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.265364  8090 tablet_bootstrap.cc:492] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.265542  8089 tablet_bootstrap.cc:654] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.265822  8090 ts_tablet_manager.cc:1403] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.047s	user 0.009s	sys 0.004s
I20260709 12:25:25.266319  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.267879  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
W20260709 12:25:25.269615  8013 leader_election.cc:343] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:25.272646  8013 leader_election.cc:343] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.273088  8013 leader_election.cc:304] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5; no voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:25.273854  8100 raft_consensus.cc:2749] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.276158  8090 raft_consensus.cc:359] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.276842  8090 raft_consensus.cc:385] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.277123  8090 raft_consensus.cc:740] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.277539  8089 tablet_bootstrap.cc:492] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.278039  8089 ts_tablet_manager.cc:1403] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:25:25.277793  8090 consensus_queue.cc:260] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.281122  8089 raft_consensus.cc:359] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.282523  8089 raft_consensus.cc:385] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.282877  8089 raft_consensus.cc:740] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.283749  8089 consensus_queue.cc:260] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.284417  8090 ts_tablet_manager.cc:1434] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 12:25:25.285287  8090 tablet_bootstrap.cc:492] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.287773  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
I20260709 12:25:25.288357  7899 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 0.
I20260709 12:25:25.289026  8089 ts_tablet_manager.cc:1434] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:25.287108  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.290117  8089 tablet_bootstrap.cc:492] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
W20260709 12:25:25.290802  7939 leader_election.cc:343] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.291589  7939 leader_election.cc:304] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 00cd69f96ebb4807860f7a4adf9926b5
I20260709 12:25:25.292375  8096 raft_consensus.cc:2804] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.292729  8096 raft_consensus.cc:493] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.292992  8090 tablet_bootstrap.cc:654] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.293046  8096 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.297111  8089 tablet_bootstrap.cc:654] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.300215  8096 raft_consensus.cc:515] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.302585  8096 leader_election.cc:290] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.304076  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:25.304481  8090 tablet_bootstrap.cc:492] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.304644  7899 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.304997  8090 ts_tablet_manager.cc:1403] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.002s
I20260709 12:25:25.307904  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.307988  8090 raft_consensus.cc:359] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.308761  8090 raft_consensus.cc:385] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.309068  8090 raft_consensus.cc:740] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
W20260709 12:25:25.309305  7939 leader_election.cc:343] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.310066  8090 consensus_queue.cc:260] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.312369  8090 ts_tablet_manager.cc:1434] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:25:25.313794  7899 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 1.
I20260709 12:25:25.314783  8090 tablet_bootstrap.cc:492] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.314956  7939 leader_election.cc:304] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 00cd69f96ebb4807860f7a4adf9926b5
I20260709 12:25:25.315742  8089 tablet_bootstrap.cc:492] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.316028  8096 raft_consensus.cc:2804] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.316248  8089 ts_tablet_manager.cc:1403] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.008s
I20260709 12:25:25.317162  8096 raft_consensus.cc:697] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:25.318282  8088 tablet_bootstrap.cc:492] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.318742  8088 ts_tablet_manager.cc:1403] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.016s
I20260709 12:25:25.319543  8089 raft_consensus.cc:359] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.320298  8089 raft_consensus.cc:385] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.320628  8089 raft_consensus.cc:740] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.317973  8096 consensus_queue.cc:237] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.321470  8088 raft_consensus.cc:359] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.321534  8089 consensus_queue.cc:260] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.322257  8088 raft_consensus.cc:385] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.322587  8088 raft_consensus.cc:740] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.323256  8088 consensus_queue.cc:260] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.325392  8088 ts_tablet_manager.cc:1434] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:25.326324  8088 tablet_bootstrap.cc:492] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.326713  8089 ts_tablet_manager.cc:1434] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:25.327728  8089 tablet_bootstrap.cc:492] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.328020  8090 tablet_bootstrap.cc:654] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.335259  8088 tablet_bootstrap.cc:654] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.340418  8089 tablet_bootstrap.cc:654] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.346494  8088 tablet_bootstrap.cc:492] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.346959  8088 ts_tablet_manager.cc:1403] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.011s
I20260709 12:25:25.349784  8088 raft_consensus.cc:359] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.350371  8088 raft_consensus.cc:385] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.350618  8088 raft_consensus.cc:740] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.351502  8090 tablet_bootstrap.cc:492] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.350728  7795 catalog_manager.cc:5697] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.351361  8088 consensus_queue.cc:260] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.351965  8090 ts_tablet_manager.cc:1403] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.019s
I20260709 12:25:25.353456  8088 ts_tablet_manager.cc:1434] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.006s
I20260709 12:25:25.354374  8088 tablet_bootstrap.cc:492] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.354765  8090 raft_consensus.cc:359] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.355443  8090 raft_consensus.cc:385] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.355722  8090 raft_consensus.cc:740] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.356526  8090 consensus_queue.cc:260] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.358901  8090 ts_tablet_manager.cc:1434] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:25.359758  8090 tablet_bootstrap.cc:492] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.360874  8088 tablet_bootstrap.cc:654] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.365674  8090 tablet_bootstrap.cc:654] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.366427  8089 tablet_bootstrap.cc:492] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.366884  8089 ts_tablet_manager.cc:1403] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.006s
I20260709 12:25:25.371611  8100 raft_consensus.cc:493] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.371891  8088 tablet_bootstrap.cc:492] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.371497  8089 raft_consensus.cc:359] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.372114  8100 raft_consensus.cc:515] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.372416  8088 ts_tablet_manager.cc:1403] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.009s
I20260709 12:25:25.372437  8089 raft_consensus.cc:385] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.373082  8089 raft_consensus.cc:740] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.373826  8089 consensus_queue.cc:260] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.374217  8100 leader_election.cc:290] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.375303  8088 raft_consensus.cc:359] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.375895  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.376016  8088 raft_consensus.cc:385] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.376413  8088 raft_consensus.cc:740] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.376523  7974 raft_consensus.cc:2468] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 0.
I20260709 12:25:25.377276  8088 consensus_queue.cc:260] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.377815  8013 leader_election.cc:304] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.378364  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
I20260709 12:25:25.378580  8095 raft_consensus.cc:2804] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.378958  8095 raft_consensus.cc:493] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.379282  8095 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:25.379853  8013 leader_election.cc:343] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.381584  8089 ts_tablet_manager.cc:1434] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:25:25.382614  8089 tablet_bootstrap.cc:492] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.386109  8095 raft_consensus.cc:515] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.389016  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:25.390054  8089 tablet_bootstrap.cc:654] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:25.390846  8013 leader_election.cc:343] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.391307  8090 tablet_bootstrap.cc:492] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.391816  8090 ts_tablet_manager.cc:1403] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.008s
I20260709 12:25:25.392391  8088 ts_tablet_manager.cc:1434] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 12:25:25.393666  8095 leader_election.cc:290] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.394274  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:25.394888  7974 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.396395  8088 tablet_bootstrap.cc:492] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.402158  7974 raft_consensus.cc:2468] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 1.
I20260709 12:25:25.403542  8013 leader_election.cc:304] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:25.404264  8088 tablet_bootstrap.cc:654] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.404673  8095 raft_consensus.cc:2804] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.404388  8090 raft_consensus.cc:359] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.405174  8090 raft_consensus.cc:385] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.405488  8090 raft_consensus.cc:740] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.406049  8095 raft_consensus.cc:697] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:25.406344  8090 consensus_queue.cc:260] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.406957  8095 consensus_queue.cc:237] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.410291  8094 raft_consensus.cc:493] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.410742  8094 raft_consensus.cc:515] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.411442  8090 ts_tablet_manager.cc:1434] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 12:25:25.412410  8090 tablet_bootstrap.cc:492] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.413165  8094 leader_election.cc:290] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.418584  8090 tablet_bootstrap.cc:654] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.422412  7797 catalog_manager.cc:5697] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.425558  8089 tablet_bootstrap.cc:492] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.426071  8089 ts_tablet_manager.cc:1403] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.011s
I20260709 12:25:25.428993  8089 raft_consensus.cc:359] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.429734  8089 raft_consensus.cc:385] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.430011  8089 raft_consensus.cc:740] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.436280  8088 tablet_bootstrap.cc:492] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.436126  8089 consensus_queue.cc:260] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.436760  8088 ts_tablet_manager.cc:1403] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.022s
I20260709 12:25:25.439123  8090 tablet_bootstrap.cc:492] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.439388  8089 ts_tablet_manager.cc:1434] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:25:25.439622  8090 ts_tablet_manager.cc:1403] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.010s
I20260709 12:25:25.440471  8089 tablet_bootstrap.cc:492] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.440426  8088 raft_consensus.cc:359] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.441203  8088 raft_consensus.cc:385] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.441488  8088 raft_consensus.cc:740] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.442350  8090 raft_consensus.cc:359] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.442361  8088 consensus_queue.cc:260] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.443185  8090 raft_consensus.cc:385] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.443532  8090 raft_consensus.cc:740] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.444245  8090 consensus_queue.cc:260] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.446663  8090 ts_tablet_manager.cc:1434] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:25.447479  8089 tablet_bootstrap.cc:654] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.447595  8090 tablet_bootstrap.cc:492] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.451532  8088 ts_tablet_manager.cc:1434] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:25:25.452198  8096 raft_consensus.cc:493] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.452471  8088 tablet_bootstrap.cc:492] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.452633  8096 raft_consensus.cc:515] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.453848  8090 tablet_bootstrap.cc:654] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.454636  8096 leader_election.cc:290] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.455302  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
I20260709 12:25:25.455931  7899 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 0.
I20260709 12:25:25.457228  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.457841  8048 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 0.
I20260709 12:25:25.461995  7939 leader_election.cc:304] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.463320  8096 raft_consensus.cc:2804] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.463696  8096 raft_consensus.cc:493] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.464000  8096 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.470291  8088 tablet_bootstrap.cc:654] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.470383  8096 raft_consensus.cc:515] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.473248  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:25.473331  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.473829  7899 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:25.474602  7864 leader_election.cc:343] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.475987  8090 tablet_bootstrap.cc:492] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.476436  8090 ts_tablet_manager.cc:1403] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.007s
I20260709 12:25:25.478437  8088 tablet_bootstrap.cc:492] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.478874  8088 ts_tablet_manager.cc:1403] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 12:25:25.480525  7899 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 1.
I20260709 12:25:25.480727  8090 raft_consensus.cc:359] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.481472  8090 raft_consensus.cc:385] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.481835  8090 raft_consensus.cc:740] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.481534  8088 raft_consensus.cc:359] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.481737  7939 leader_election.cc:304] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.482832  8101 raft_consensus.cc:2804] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.482789  8090 consensus_queue.cc:260] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.482717  8088 raft_consensus.cc:385] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.483747  8088 raft_consensus.cc:740] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.484369  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.484866  8096 leader_election.cc:290] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.484920  8048 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.486147  8101 raft_consensus.cc:697] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:25.486649  8089 tablet_bootstrap.cc:492] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.487147  8089 ts_tablet_manager.cc:1403] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.004s
I20260709 12:25:25.487025  8101 consensus_queue.cc:237] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.489970  8090 ts_tablet_manager.cc:1434] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:25:25.489969  8089 raft_consensus.cc:359] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.490849  8089 raft_consensus.cc:385] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.491089  8090 tablet_bootstrap.cc:492] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.491186  8089 raft_consensus.cc:740] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.492115  8089 consensus_queue.cc:260] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.493170  8048 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 1.
I20260709 12:25:25.493383  8047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.494280  8089 ts_tablet_manager.cc:1434] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:25:25.494553  7844 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:25.495242  8089 tablet_bootstrap.cc:492] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.495131  8088 consensus_queue.cc:260] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.499388  8088 ts_tablet_manager.cc:1434] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:25:25.500334  8088 tablet_bootstrap.cc:492] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.500597  8090 tablet_bootstrap.cc:654] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.502632  8089 tablet_bootstrap.cc:654] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.506570  8088 tablet_bootstrap.cc:654] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.507867  8090 tablet_bootstrap.cc:492] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.508270  8090 ts_tablet_manager.cc:1403] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 12:25:25.508843  8125 raft_consensus.cc:493] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.509318  8125 raft_consensus.cc:515] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
W20260709 12:25:25.509709  7864 leader_election.cc:343] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.510147  7864 leader_election.cc:304] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24; no voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:25.512542  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
W20260709 12:25:25.513881  7939 leader_election.cc:343] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.514509  8125 leader_election.cc:290] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.516062  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.516386  8094 raft_consensus.cc:2749] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.516685  8048 raft_consensus.cc:2468] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 0.
I20260709 12:25:25.517681  8089 tablet_bootstrap.cc:492] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.517918  7939 leader_election.cc:304] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:25.518087  8089 ts_tablet_manager.cc:1403] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.005s
I20260709 12:25:25.518563  8101 raft_consensus.cc:2804] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.518910  8101 raft_consensus.cc:493] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.519239  8101 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.520599  8089 raft_consensus.cc:359] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.521284  8089 raft_consensus.cc:385] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.520934  8090 raft_consensus.cc:359] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.521555  8089 raft_consensus.cc:740] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.521649  8090 raft_consensus.cc:385] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.521965  8090 raft_consensus.cc:740] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.522671  8089 consensus_queue.cc:260] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.523797  8090 consensus_queue.cc:260] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.525928  8090 ts_tablet_manager.cc:1434] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:25:25.526183  8101 raft_consensus.cc:515] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.526801  8090 tablet_bootstrap.cc:492] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.528509  8089 ts_tablet_manager.cc:1434] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:25.528678  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:25.528338  7797 catalog_manager.cc:5697] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.529357  8089 tablet_bootstrap.cc:492] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24: Bootstrap starting.
I20260709 12:25:25.529978  8094 raft_consensus.cc:493] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.530396  8094 raft_consensus.cc:515] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.532259  8094 leader_election.cc:290] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.532474  8090 tablet_bootstrap.cc:654] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.534003  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.534929  8089 tablet_bootstrap.cc:654] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:25.535169  7939 leader_election.cc:343] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:25.536409  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.537204  7974 raft_consensus.cc:2393] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a11c60e8742448bb36b6d105fb8cb24 in current term 1: Already voted for candidate 00cd69f96ebb4807860f7a4adf9926b5 in this term.
I20260709 12:25:25.539037  7864 leader_election.cc:304] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24; no voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:25.540143  8094 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.540621  8088 tablet_bootstrap.cc:492] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.541086  8088 ts_tablet_manager.cc:1403] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.011s
I20260709 12:25:25.543592  8088 raft_consensus.cc:359] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.544229  8088 raft_consensus.cc:385] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.544550  8088 raft_consensus.cc:740] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.545194  8088 consensus_queue.cc:260] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.547333  8088 ts_tablet_manager.cc:1434] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:25:25.548316  8088 tablet_bootstrap.cc:492] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.553982  8088 tablet_bootstrap.cc:654] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.554919  8125 raft_consensus.cc:493] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.556553  8101 leader_election.cc:290] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.558261  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.558871  8048 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.555353  8125 raft_consensus.cc:515] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.561374  8125 leader_election.cc:290] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.563185  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
I20260709 12:25:25.563848  7899 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 0.
I20260709 12:25:25.565307  8047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.565927  8047 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 0.
I20260709 12:25:25.568306  7939 leader_election.cc:304] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.568542  8094 raft_consensus.cc:2749] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:25.570966  8125 raft_consensus.cc:2804] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.576326  8125 raft_consensus.cc:493] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.576673  8125 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.585446  8090 tablet_bootstrap.cc:492] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.585764  8089 tablet_bootstrap.cc:492] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24: No bootstrap required, opened a new log
I20260709 12:25:25.586262  8089 ts_tablet_manager.cc:1403] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.018s
I20260709 12:25:25.586313  8094 raft_consensus.cc:493] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.585896  8090 ts_tablet_manager.cc:1403] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.027s
I20260709 12:25:25.587800  8125 raft_consensus.cc:515] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.593123  8094 raft_consensus.cc:515] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.594547  8088 tablet_bootstrap.cc:492] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.595016  8088 ts_tablet_manager.cc:1403] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.047s	user 0.019s	sys 0.012s
I20260709 12:25:25.586431  8048 raft_consensus.cc:2468] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 1.
I20260709 12:25:25.595721  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:25.596266  7899 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.596627  8125 leader_election.cc:290] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.597289  8089 raft_consensus.cc:359] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.597963  8089 raft_consensus.cc:385] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.597820  8088 raft_consensus.cc:359] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.598256  8089 raft_consensus.cc:740] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.598469  8088 raft_consensus.cc:385] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.598752  8088 raft_consensus.cc:740] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.598940  8089 consensus_queue.cc:260] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.599421  8088 consensus_queue.cc:260] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.600066  8090 raft_consensus.cc:359] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.600718  8090 raft_consensus.cc:385] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.601016  8090 raft_consensus.cc:740] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.601706  8090 consensus_queue.cc:260] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.602548  7939 leader_election.cc:304] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:25.603323  8125 raft_consensus.cc:2804] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.603868  8125 raft_consensus.cc:697] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:25.604697  8125 consensus_queue.cc:237] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.605698  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.606290  7974 raft_consensus.cc:2468] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 0.
I20260709 12:25:25.607331  8090 ts_tablet_manager.cc:1434] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 12:25:25.607698  7864 leader_election.cc:304] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.609781  7899 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 1.
I20260709 12:25:25.610918  7939 leader_election.cc:304] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.611807  8101 raft_consensus.cc:2804] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.612282  8101 raft_consensus.cc:697] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:25.612979  8088 ts_tablet_manager.cc:1434] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:25:25.613106  8101 consensus_queue.cc:237] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.615306  8090 tablet_bootstrap.cc:492] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Bootstrap starting.
I20260709 12:25:25.608887  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.618296  8048 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.621162  8088 tablet_bootstrap.cc:492] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5: Bootstrap starting.
I20260709 12:25:25.624063  8094 leader_election.cc:290] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.626224  8135 raft_consensus.cc:2804] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.628612  8135 raft_consensus.cc:493] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.629019  8135 raft_consensus.cc:3060] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.631335  8048 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 1.
I20260709 12:25:25.627399  8088 tablet_bootstrap.cc:654] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.627923  8047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.632808  8047 raft_consensus.cc:2468] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 0.
I20260709 12:25:25.632419  8090 tablet_bootstrap.cc:654] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:25.643471  7797 catalog_manager.cc:5697] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.643877  8135 raft_consensus.cc:515] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.645092  7797 catalog_manager.cc:5697] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.646804  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:25.647333  7974 raft_consensus.cc:3060] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.653614  7974 raft_consensus.cc:2468] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 1.
I20260709 12:25:25.654776  7864 leader_election.cc:304] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.656591  8094 raft_consensus.cc:493] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.657059  8094 raft_consensus.cc:515] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.659250  8047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.659943  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882454296e07428092d0a23c75c2dc2b" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.660538  8094 leader_election.cc:290] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.660092  8047 raft_consensus.cc:3060] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.660627  7974 raft_consensus.cc:2468] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 0.
I20260709 12:25:25.661056  8094 raft_consensus.cc:2804] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.661530  8094 raft_consensus.cc:697] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:25.662320  8094 consensus_queue.cc:237] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.662711  7864 leader_election.cc:304] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.664211  8095 raft_consensus.cc:493] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.658921  8135 leader_election.cc:290] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.664531  8139 raft_consensus.cc:493] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.664693  8095 raft_consensus.cc:515] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.665001  8139 raft_consensus.cc:515] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.666549  8090 tablet_bootstrap.cc:492] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2: No bootstrap required, opened a new log
I20260709 12:25:25.666683  8095 leader_election.cc:290] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.669267  8089 ts_tablet_manager.cc:1434] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24: Time spent starting tablet: real 0.076s	user 0.018s	sys 0.050s
I20260709 12:25:25.669939  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
I20260709 12:25:25.671037  8090 ts_tablet_manager.cc:1403] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.003s
I20260709 12:25:25.667786  8135 raft_consensus.cc:2804] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.670580  7899 raft_consensus.cc:2468] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 0.
I20260709 12:25:25.673010  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.672298  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882454296e07428092d0a23c75c2dc2b" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.673095  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5" is_pre_election: true
I20260709 12:25:25.671765  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.674693  8013 leader_election.cc:304] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:25.676445  8095 raft_consensus.cc:2804] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.674049  8135 raft_consensus.cc:493] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.677275  8095 raft_consensus.cc:493] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.677464  8135 raft_consensus.cc:3060] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.674377  8046 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 0.
I20260709 12:25:25.675227  7974 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 0.
I20260709 12:25:25.677721  8095 raft_consensus.cc:3060] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.681197  8090 raft_consensus.cc:359] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.683359  8090 raft_consensus.cc:385] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.683848  8090 raft_consensus.cc:740] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.684592  8090 consensus_queue.cc:260] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.685034  7864 leader_election.cc:304] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:25.686247  7973 raft_consensus.cc:2468] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 0.
I20260709 12:25:25.687063  8090 ts_tablet_manager.cc:1434] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:25.691313  8047 raft_consensus.cc:2468] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 1.
I20260709 12:25:25.691941  8095 raft_consensus.cc:515] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.696573  8088 tablet_bootstrap.cc:492] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5: No bootstrap required, opened a new log
I20260709 12:25:25.697024  8088 ts_tablet_manager.cc:1403] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.031s
I20260709 12:25:25.674296  8048 raft_consensus.cc:2468] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 0.
I20260709 12:25:25.699537  8088 raft_consensus.cc:359] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.700155  8088 raft_consensus.cc:385] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:25.700404  8095 leader_election.cc:290] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.700416  8088 raft_consensus.cc:740] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Initialized, Role: FOLLOWER
I20260709 12:25:25.701499  8088 consensus_queue.cc:260] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.701968  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:25.702486  7899 raft_consensus.cc:3060] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.703553  8088 ts_tablet_manager.cc:1434] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:25:25.706130  8135 raft_consensus.cc:515] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.708505  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:25.708798  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882454296e07428092d0a23c75c2dc2b" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:25.709125  7973 raft_consensus.cc:3060] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.709350  7974 raft_consensus.cc:3060] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.709034  7899 raft_consensus.cc:2468] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 1.
I20260709 12:25:25.712934  8013 leader_election.cc:304] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:25.671741  8139 leader_election.cc:290] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.714675  8139 raft_consensus.cc:2804] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.716015  7974 raft_consensus.cc:2468] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 1.
I20260709 12:25:25.717259  8139 raft_consensus.cc:493] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.718019  8139 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.717856  7864 leader_election.cc:304] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:25.715993  8100 raft_consensus.cc:493] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.718797  8133 raft_consensus.cc:2804] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.719058  8100 raft_consensus.cc:515] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.719676  8133 raft_consensus.cc:697] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:25.720646  8133 consensus_queue.cc:237] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.720930  7794 catalog_manager.cc:5697] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.721168  8100 leader_election.cc:290] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.722402  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24" is_pre_election: true
I20260709 12:25:25.723009  7899 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 0.
I20260709 12:25:25.724581  7974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" is_pre_election: true
I20260709 12:25:25.724705  8013 leader_election.cc:304] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:25.725190  7974 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 0.
I20260709 12:25:25.725467  8100 raft_consensus.cc:2804] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:25.725811  8100 raft_consensus.cc:493] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.726128  8100 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.726495  8095 raft_consensus.cc:2804] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.726787  8139 raft_consensus.cc:515] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.729974  7972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:25.730374  8135 leader_election.cc:290] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.730546  7972 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.730962  8139 leader_election.cc:290] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:25.732247  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.732818  8048 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.740335  8047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882454296e07428092d0a23c75c2dc2b" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.740732  8048 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 1.
I20260709 12:25:25.740907  8047 raft_consensus.cc:3060] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.741937  7864 leader_election.cc:304] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:25.742839  8139 raft_consensus.cc:2804] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.743323  8139 raft_consensus.cc:697] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:25.744213  8139 consensus_queue.cc:237] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.746724  7972 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 1.
I20260709 12:25:25.747013  8047 raft_consensus.cc:2468] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 1.
I20260709 12:25:25.740291  8095 raft_consensus.cc:697] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:25.748695  8095 consensus_queue.cc:237] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.752233  8100 raft_consensus.cc:515] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.753110  7797 catalog_manager.cc:5697] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.754206  8100 leader_election.cc:290] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.758121  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:25.758641  7899 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.730000  7973 raft_consensus.cc:2468] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 1.
I20260709 12:25:25.771286  7899 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 1.
I20260709 12:25:25.763079  7972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:25.772308  7972 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.772641  8013 leader_election.cc:304] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:25.773558  8100 raft_consensus.cc:2804] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:25.774044  8100 raft_consensus.cc:697] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:25.774869  8100 consensus_queue.cc:237] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:25.779484  7797 catalog_manager.cc:5697] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.781142  7972 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 1.
I20260709 12:25:25.789207  7794 catalog_manager.cc:5697] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.799867  7794 catalog_manager.cc:5697] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:25.835603  8100 consensus_queue.cc:1048] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.848321  8095 consensus_queue.cc:1048] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.863050  7972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:44368
I20260709 12:25:25.863720  7972 raft_consensus.cc:606] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:25.875702  8047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:38134
I20260709 12:25:25.876140  8047 raft_consensus.cc:606] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:25.882573  7972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:44368
I20260709 12:25:25.883093  7972 raft_consensus.cc:606] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:25.893699  8047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
mode: GRACEFUL
new_leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 12:25:25.894131  8047 raft_consensus.cc:606] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Received request to transfer leadership to TS bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:25.898005  8047 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
mode: GRACEFUL
new_leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:38134
I20260709 12:25:25.898581  8047 raft_consensus.cc:606] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Received request to transfer leadership to TS bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:25.899605  8048 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.908339  8101 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.911615  7899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
mode: GRACEFUL
new_leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:47712
I20260709 12:25:25.912103  7899 raft_consensus.cc:606] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Received request to transfer leadership to TS 00cd69f96ebb4807860f7a4adf9926b5
I20260709 12:25:25.918285  8096 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:25.926074  8125 raft_consensus.cc:993] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:25.926466  8096 raft_consensus.cc:1081] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:25.927906  7899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47710
I20260709 12:25:25.928467  7899 raft_consensus.cc:493] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.928812  7899 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.933094  7899 raft_consensus.cc:515] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.934964  7899 leader_election.cc:290] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Requested vote from peers 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:25.935738  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:25.935953  7972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:25.936308  8048 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.936443  7972 raft_consensus.cc:3055] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:25.936800  7972 raft_consensus.cc:740] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:25.937570  7972 consensus_queue.cc:260] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.938862  7972 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:25.942690  8048 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:25.943703  7864 leader_election.cc:304] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:25.944324  8139 raft_consensus.cc:2804] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:25.944675  7972 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:25.944779  8139 raft_consensus.cc:697] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:25.945529  8139 consensus_queue.cc:237] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:25.950989  7797 catalog_manager.cc:5697] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 1 to 2, leader changed from bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.990962  7899 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:25.996583  8125 consensus_queue.cc:1048] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.002476  8096 raft_consensus.cc:993] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:26.003093  8124 raft_consensus.cc:1081] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:26.004841  7898 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47710
I20260709 12:25:26.006511  7898 raft_consensus.cc:493] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.006896  7898 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.008100  8096 consensus_queue.cc:1048] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.016579  7898 raft_consensus.cc:515] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.023790  7972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:26.024377  7972 raft_consensus.cc:3055] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:26.024708  7972 raft_consensus.cc:740] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:26.025460  7972 consensus_queue.cc:260] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.026521  7972 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.027740  7898 leader_election.cc:290] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:26.028915  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:26.029488  8048 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.033502  7972 raft_consensus.cc:2468] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:26.034898  7864 leader_election.cc:304] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:26.035773  8048 raft_consensus.cc:2468] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:26.035786  8139 raft_consensus.cc:2804] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:26.036448  8139 raft_consensus.cc:697] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:26.037245  8139 consensus_queue.cc:237] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.044509  7797 catalog_manager.cc:5697] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 1 to 2, leader changed from bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.046212  8096 consensus_queue.cc:1048] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.055905  8124 consensus_queue.cc:1048] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.064599  8124 consensus_queue.cc:1048] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.077517  8096 consensus_queue.cc:1048] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.090215  8139 consensus_queue.cc:1048] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.099267  8133 consensus_queue.cc:1048] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.108141  8133 raft_consensus.cc:993] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24: : Instructing follower 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:26.108582  8135 raft_consensus.cc:1081] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Signalling peer 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:26.109974  8048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:38126
I20260709 12:25:26.110461  8048 raft_consensus.cc:493] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.110750  8048 raft_consensus.cc:3060] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.115521  8048 raft_consensus.cc:515] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.117373  8048 leader_election.cc:290] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 2 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:26.118479  7898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:26.118425  7972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef440a066f94470a7e1c471bc09d7c2" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:26.119074  7898 raft_consensus.cc:3055] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:26.119144  7972 raft_consensus.cc:3060] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.119359  7898 raft_consensus.cc:740] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:26.120157  7898 consensus_queue.cc:260] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.121058  7898 raft_consensus.cc:3060] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.124605  7972 raft_consensus.cc:2468] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 2.
I20260709 12:25:26.125519  8013 leader_election.cc:304] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:26.125821  7898 raft_consensus.cc:2468] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 2.
I20260709 12:25:26.126230  8095 raft_consensus.cc:2804] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:26.126576  8095 raft_consensus.cc:697] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:26.127321  8095 consensus_queue.cc:237] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.133069  7794 catalog_manager.cc:5697] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 1 to 2, leader changed from 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65) to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.178167  8135 consensus_queue.cc:1048] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.187885  8094 consensus_queue.cc:1048] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.196439  8095 consensus_queue.cc:1048] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.205963  8143 consensus_queue.cc:1048] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.213349  8094 consensus_queue.cc:1048] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.213690  8100 raft_consensus.cc:993] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:26.214226  8143 raft_consensus.cc:1081] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:26.215952  7899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47698
I20260709 12:25:26.216372  7899 raft_consensus.cc:493] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.216634  7899 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.222875  7899 raft_consensus.cc:515] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.225328  8094 consensus_queue.cc:1048] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.227674  7899 leader_election.cc:290] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:26.228875  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:26.229369  7973 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.228231  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:26.235211  8048 raft_consensus.cc:3055] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:26.235574  8048 raft_consensus.cc:740] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:26.236678  8048 consensus_queue.cc:260] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.236943  7973 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:26.237614  8048 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.238044  7864 leader_election.cc:304] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:26.238766  8139 raft_consensus.cc:2804] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:26.239231  8139 raft_consensus.cc:697] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:26.240018  8139 consensus_queue.cc:237] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.242172  8048 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:26.246124  8143 consensus_queue.cc:1048] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.246923  7797 catalog_manager.cc:5697] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 1 to 2, leader changed from 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.252861  8100 raft_consensus.cc:993] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5: : Instructing follower bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:26.253288  8100 raft_consensus.cc:1081] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Signalling peer bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:26.254858  7972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:44354
I20260709 12:25:26.255362  7972 raft_consensus.cc:493] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.255738  7972 raft_consensus.cc:3060] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.260934  7972 raft_consensus.cc:515] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.261835  7973 raft_consensus.cc:1240] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Rejecting Update request from peer 00cd69f96ebb4807860f7a4adf9926b5 for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:26.262784  7972 leader_election.cc:290] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 2 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:26.262939  8095 consensus_queue.cc:1048] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:26.264222  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:26.264772  8048 raft_consensus.cc:3055] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:26.265069  8048 raft_consensus.cc:740] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:26.265784  8048 consensus_queue.cc:260] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.266805  8048 raft_consensus.cc:3060] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.271726  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce94d8a4ccd2484794a76653e90c8b87" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:26.272169  7899 raft_consensus.cc:3060] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.273083  8048 raft_consensus.cc:2468] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 2.
I20260709 12:25:26.274240  7939 leader_election.cc:304] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:26.274919  8125 raft_consensus.cc:2804] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:26.275386  8125 raft_consensus.cc:697] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:26.276182  8125 consensus_queue.cc:237] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.277475  7899 raft_consensus.cc:2468] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 2.
I20260709 12:25:26.282796  7794 catalog_manager.cc:5697] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 1 to 2, leader changed from 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67) to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.348001  8143 raft_consensus.cc:993] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5: : Instructing follower bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:26.348395  8095 raft_consensus.cc:1081] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Signalling peer bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:26.349787  7972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:44354
I20260709 12:25:26.350225  7972 raft_consensus.cc:493] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:26.350502  7972 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.356881  7972 raft_consensus.cc:515] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.358870  7972 leader_election.cc:290] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 2 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:26.359843  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:26.360056  8048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:26.360349  7899 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.360657  8048 raft_consensus.cc:3055] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:26.360921  8048 raft_consensus.cc:740] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:26.361527  8048 consensus_queue.cc:260] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.362351  8048 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:26.365170  7899 raft_consensus.cc:2468] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 2.
I20260709 12:25:26.366199  7939 leader_election.cc:304] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:26.366930  8125 raft_consensus.cc:2804] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:26.367270  8048 raft_consensus.cc:2468] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 2.
I20260709 12:25:26.367285  8125 raft_consensus.cc:697] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:26.368264  8125 consensus_queue.cc:237] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:26.373811  7794 catalog_manager.cc:5697] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 1 to 2, leader changed from 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67) to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:26.443382  8048 raft_consensus.cc:1275] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.444593  8094 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.451370  7972 raft_consensus.cc:1275] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.452979  8094 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.500434  8048 raft_consensus.cc:1275] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.501624  8094 consensus_queue.cc:1048] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.511004  7972 raft_consensus.cc:1275] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.512279  8133 consensus_queue.cc:1048] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.567013  7899 raft_consensus.cc:1275] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.568162  8143 consensus_queue.cc:1048] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.574848  7972 raft_consensus.cc:1275] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.576174  8095 consensus_queue.cc:1048] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.629556  7972 raft_consensus.cc:1275] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.630708  8133 consensus_queue.cc:1048] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.637585  8048 raft_consensus.cc:1275] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.639110  8139 consensus_queue.cc:1048] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.683904  7899 raft_consensus.cc:1275] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.685066  8172 consensus_queue.cc:1048] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.691869  8048 raft_consensus.cc:1275] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.693348  8125 consensus_queue.cc:1048] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.857775  8048 raft_consensus.cc:1275] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.858990  8125 consensus_queue.cc:1048] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:26.866518  7899 raft_consensus.cc:1275] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:26.868176  8172 consensus_queue.cc:1048] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:28.941360  7261 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:25:28.942179  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:28.957216  7899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
mode: GRACEFUL
new_leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:25:28.957669  7899 raft_consensus.cc:606] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Received request to transfer leadership to TS 00cd69f96ebb4807860f7a4adf9926b5
I20260709 12:25:28.959755  7899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
mode: GRACEFUL
new_leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:25:28.960139  7899 raft_consensus.cc:606] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Received request to transfer leadership to TS 00cd69f96ebb4807860f7a4adf9926b5
I20260709 12:25:28.960958  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:28.961341  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:29.049237  8139 raft_consensus.cc:993] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24: : Instructing follower 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:29.049639  8178 raft_consensus.cc:1081] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Signalling peer 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:29.050963  8048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:38126
I20260709 12:25:29.051380  8048 raft_consensus.cc:493] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:29.051616  8048 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:29.055517  8048 raft_consensus.cc:515] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:29.056792  8048 leader_election.cc:290] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 3 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:29.057534  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:29.057830  7972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:29.057961  7899 raft_consensus.cc:3055] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:29.058291  7899 raft_consensus.cc:740] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:29.058300  7972 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:29.058939  7899 consensus_queue.cc:260] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:29.059741  7899 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:29.062722  7972 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 3.
I20260709 12:25:29.063269  7899 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 3.
I20260709 12:25:29.063702  8013 leader_election.cc:304] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:29.064404  8100 raft_consensus.cc:2804] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:29.065649  8100 raft_consensus.cc:697] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:29.066434  8100 consensus_queue.cc:237] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:29.066870  8139 raft_consensus.cc:993] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24: : Instructing follower 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:29.067251  8178 raft_consensus.cc:1081] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Signalling peer 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:29.071229  8048 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:38126
I20260709 12:25:29.072785  8048 raft_consensus.cc:493] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:29.073135  8048 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:29.073820  7794 catalog_manager.cc:5697] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 2 to 3, leader changed from 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65) to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 3 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:29.077190  8048 raft_consensus.cc:515] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:29.078565  8048 leader_election.cc:290] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 2 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:29.079667  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:29.079759  7972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:29.080250  7899 raft_consensus.cc:3055] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:29.080372  7972 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:29.080561  7899 raft_consensus.cc:740] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:29.081261  7899 consensus_queue.cc:260] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:29.082427  7899 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:29.086997  7972 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 2.
I20260709 12:25:29.088229  8013 leader_election.cc:304] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:29.089449  7899 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 2.
I20260709 12:25:29.089407  8100 raft_consensus.cc:2804] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:29.090464  8100 raft_consensus.cc:697] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:29.091223  8100 consensus_queue.cc:237] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:29.097669  7794 catalog_manager.cc:5697] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 1 to 2, leader changed from 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65) to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:29.463187  7899 raft_consensus.cc:1275] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:29.464337  8100 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:29.472929  7972 raft_consensus.cc:1275] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:29.476805  8100 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:29.528612  7899 raft_consensus.cc:1275] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:29.529750  8100 consensus_queue.cc:1048] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:29.540431  7972 raft_consensus.cc:1275] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:29.542189  8179 consensus_queue.cc:1048] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:29.962236  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:29.967772  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:29.968178  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:30.968982  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:30.974890  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:30.975292  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:31.976174  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:31.981799  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:31.982194  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:32.983063  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.989338  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:32.989789  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:33.990741  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.996658  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:33.997084  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:34.998189  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:35.003754  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:35.004179  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:36.005357  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:36.011860  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:36.012270  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:37.013159  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:37.018776  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:37.019189  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:38.020133  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.025319  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:38.025750  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:39.054813  7261 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:25:39.059235  8048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:38134
I20260709 12:25:39.059978  8048 raft_consensus.cc:606] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:39.067344  8048 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:38134
I20260709 12:25:39.067857  8048 raft_consensus.cc:606] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:39.076972  7973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34bc111abaf44a139bd81404762479bf"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:44368
I20260709 12:25:39.077488  7973 raft_consensus.cc:606] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:39.082033  7973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:44368
I20260709 12:25:39.082679  7973 raft_consensus.cc:606] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:39.087064  7973 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
mode: GRACEFUL
new_leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:44368
I20260709 12:25:39.087543  7973 raft_consensus.cc:606] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 LEADER]: Received request to transfer leadership to TS 6a11c60e8742448bb36b6d105fb8cb24
I20260709 12:25:39.311925  8175 raft_consensus.cc:993] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.312397  8202 raft_consensus.cc:1081] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.313882  7899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47710
I20260709 12:25:39.314301  7899 raft_consensus.cc:493] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.314580  7899 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.319366  7899 raft_consensus.cc:515] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.320861  7899 leader_election.cc:290] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:39.321743  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:39.322089  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:39.322365  7973 raft_consensus.cc:3055] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:39.322570  8046 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.322651  7973 raft_consensus.cc:740] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:39.323535  7973 consensus_queue.cc:260] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.324561  7973 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.327724  8046 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:39.328888  7864 leader_election.cc:304] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:39.329493  7973 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:39.329591  8199 raft_consensus.cc:2804] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:39.330566  8199 raft_consensus.cc:697] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:39.331499  8199 consensus_queue.cc:237] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.337913  7794 catalog_manager.cc:5697] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 1 to 2, leader changed from bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.350729  8175 raft_consensus.cc:993] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.351118  8202 raft_consensus.cc:1081] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.352449  7899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47710
I20260709 12:25:39.352819  7899 raft_consensus.cc:493] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.353094  7899 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.357120  7899 raft_consensus.cc:515] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.358323  7899 leader_election.cc:290] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 3 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:39.359095  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:39.359333  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70cc0a342b2943bd8c3f6cd9101ce92a" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:39.359592  7973 raft_consensus.cc:3055] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:39.359813  8046 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.359889  7973 raft_consensus.cc:740] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:39.360658  7973 consensus_queue.cc:260] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.361524  7973 raft_consensus.cc:3060] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.364655  8046 raft_consensus.cc:2468] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 3.
I20260709 12:25:39.365654  7864 leader_election.cc:304] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:39.366052  8175 raft_consensus.cc:993] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.366483  8175 raft_consensus.cc:1081] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.366539  8199 raft_consensus.cc:2804] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:39.367002  8199 raft_consensus.cc:697] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:39.367084  7973 raft_consensus.cc:2468] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 3.
I20260709 12:25:39.368201  7899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34bc111abaf44a139bd81404762479bf"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47710
I20260709 12:25:39.367894  8199 consensus_queue.cc:237] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.368670  7899 raft_consensus.cc:493] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.369029  7899 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.373831  7899 raft_consensus.cc:515] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.375511  7899 leader_election.cc:290] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:39.376108  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:39.375607  7794 catalog_manager.cc:5697] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 2 to 3, leader changed from bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.376430  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:39.376672  7973 raft_consensus.cc:3055] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:39.376964  8046 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.377008  7973 raft_consensus.cc:740] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:39.377931  7973 consensus_queue.cc:260] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.379079  7973 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:39.384608  8046 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:39.385591  7864 leader_election.cc:304] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, 6a11c60e8742448bb36b6d105fb8cb24; no voters: 
I20260709 12:25:39.385637  7973 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 2.
I20260709 12:25:39.386217  8199 raft_consensus.cc:2804] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:25:39.386648  8199 raft_consensus.cc:697] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:39.387557  8199 consensus_queue.cc:237] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.394308  7794 catalog_manager.cc:5697] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 1 to 2, leader changed from bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.425863  8193 raft_consensus.cc:993] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.426353  8211 raft_consensus.cc:1081] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.427709  7899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47698
I20260709 12:25:39.428125  7899 raft_consensus.cc:493] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.428373  7899 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.432269  7899 raft_consensus.cc:515] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:39.433660  7899 leader_election.cc:290] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 4 election: Requested vote from peers 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:39.434337  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:39.434779  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96da851c7beb4d22b1774e7b2ed141ce" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:39.434849  8046 raft_consensus.cc:3055] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:39.435227  8046 raft_consensus.cc:740] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:39.435232  7973 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.436141  8046 consensus_queue.cc:260] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:39.437335  8046 raft_consensus.cc:3060] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:39.440250  7973 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 4.
I20260709 12:25:39.441056  7864 leader_election.cc:304] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:39.441607  8199 raft_consensus.cc:2804] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:39.441992  8046 raft_consensus.cc:2468] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 4.
I20260709 12:25:39.442022  8199 raft_consensus.cc:697] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 4 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:39.443117  8199 consensus_queue.cc:237] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } }
I20260709 12:25:39.449508  7794 catalog_manager.cc:5697] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 3 to 4, leader changed from 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 4 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.481184  8193 raft_consensus.cc:993] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5: : Instructing follower 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.481582  8211 raft_consensus.cc:1081] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 LEADER]: Signalling peer 6a11c60e8742448bb36b6d105fb8cb24 to start an election
I20260709 12:25:39.482787  7899 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
 from {username='slave'} at 127.0.0.1:47698
I20260709 12:25:39.483199  7899 raft_consensus.cc:493] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.483474  7899 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.487443  7899 raft_consensus.cc:515] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.488771  7899 leader_election.cc:290] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 3 election: Requested vote from peers bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:39.489483  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:39.489722  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "093d8a84cdcb47cbae704f3800be7674" candidate_uuid: "6a11c60e8742448bb36b6d105fb8cb24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:39.490041  7973 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.490221  8046 raft_consensus.cc:3055] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:39.490545  8046 raft_consensus.cc:740] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:39.491331  8046 consensus_queue.cc:260] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.492540  8046 raft_consensus.cc:3060] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:39.496480  7973 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 3.
I20260709 12:25:39.497546  7864 leader_election.cc:304] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a11c60e8742448bb36b6d105fb8cb24, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:39.498247  8199 raft_consensus.cc:2804] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:39.498624  8199 raft_consensus.cc:697] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 LEADER]: Becoming Leader. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:39.498759  8046 raft_consensus.cc:2468] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a11c60e8742448bb36b6d105fb8cb24 in term 3.
I20260709 12:25:39.499476  8199 consensus_queue.cc:237] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:39.506076  7794 catalog_manager.cc:5697] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 reported cstate change: term changed from 2 to 3, leader changed from 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67) to 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "6a11c60e8742448bb36b6d105fb8cb24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:39.763470  7973 raft_consensus.cc:1275] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.764745  8199 consensus_queue.cc:1048] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.774883  8046 raft_consensus.cc:1275] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.777061  8216 consensus_queue.cc:1048] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.839111  7973 raft_consensus.cc:1275] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.840232  8216 consensus_queue.cc:1048] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.848917  8046 raft_consensus.cc:1275] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.850267  8216 consensus_queue.cc:1048] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.865130  7973 raft_consensus.cc:1275] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 4 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:39.866192  8199 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:39.873805  8046 raft_consensus.cc:1275] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 4 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:39.874993  8203 consensus_queue.cc:1048] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:39.883754  8046 raft_consensus.cc:1275] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.884761  8203 consensus_queue.cc:1048] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.890199  8046 raft_consensus.cc:1275] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.893324  8199 consensus_queue.cc:1048] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:39.893347  7973 raft_consensus.cc:1275] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:39.895874  7972 raft_consensus.cc:1275] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Refusing update from remote peer 6a11c60e8742448bb36b6d105fb8cb24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:39.896534  8199 consensus_queue.cc:1048] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:39.899335  8216 consensus_queue.cc:1048] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:25:42.120116  7261 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:25:42.120707  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:42.127596  7899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34bc111abaf44a139bd81404762479bf"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
mode: GRACEFUL
new_leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:25:42.128010  7899 raft_consensus.cc:606] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Received request to transfer leadership to TS 00cd69f96ebb4807860f7a4adf9926b5
I20260709 12:25:42.130131  7899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
mode: GRACEFUL
new_leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:25:42.130498  7899 raft_consensus.cc:606] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Received request to transfer leadership to TS bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:42.132407  7899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
mode: GRACEFUL
new_leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:25:42.132799  7899 raft_consensus.cc:606] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Received request to transfer leadership to TS bc82f2ae9bbd41768bb8bf689a5d6cc2
I20260709 12:25:42.134624  7899 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd"
dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
mode: GRACEFUL
new_leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:47718
I20260709 12:25:42.134964  7899 raft_consensus.cc:606] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Received request to transfer leadership to TS 00cd69f96ebb4807860f7a4adf9926b5
I20260709 12:25:42.135777  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:42.136165  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:42.201294  8230 raft_consensus.cc:993] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24: : Instructing follower bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:42.201716  8199 raft_consensus.cc:1081] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Signalling peer bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:42.202898  7972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:44360
I20260709 12:25:42.203270  7972 raft_consensus.cc:493] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.203531  7972 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.207849  7972 raft_consensus.cc:515] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.209589  7972 leader_election.cc:290] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 3 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:42.210311  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:42.210505  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9289119bbaed43a785dc8d934b329ec4" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:42.210794  7899 raft_consensus.cc:3055] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:42.211018  8046 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.211073  7899 raft_consensus.cc:740] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:42.211855  7899 consensus_queue.cc:260] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.212634  7899 raft_consensus.cc:3060] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.216140  8046 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 3.
I20260709 12:25:42.217271  7939 leader_election.cc:304] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:42.217347  7899 raft_consensus.cc:2468] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 3.
I20260709 12:25:42.217851  8228 raft_consensus.cc:2804] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:42.218713  8228 raft_consensus.cc:697] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:42.219309  8228 consensus_queue.cc:237] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.224828  7794 catalog_manager.cc:5697] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 2 to 3, leader changed from 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65) to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 3 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.449323  8230 raft_consensus.cc:993] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24: : Instructing follower 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:42.449771  8199 raft_consensus.cc:1081] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Signalling peer 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:42.451119  8046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:38126
I20260709 12:25:42.451592  8046 raft_consensus.cc:493] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.451867  8046 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.455374  8230 raft_consensus.cc:993] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24: : Instructing follower bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:42.455827  8199 raft_consensus.cc:1081] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Signalling peer bc82f2ae9bbd41768bb8bf689a5d6cc2 to start an election
I20260709 12:25:42.456719  8046 raft_consensus.cc:515] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.457103  7972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da"
dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
 from {username='slave'} at 127.0.0.1:44360
I20260709 12:25:42.457556  7972 raft_consensus.cc:493] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.457827  7972 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.459055  8046 leader_election.cc:290] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 3 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:42.459648  7899 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:42.459959  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2a1f97f360d445b81e445e3fb4517dd" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:42.460225  7899 raft_consensus.cc:3055] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:42.460574  7973 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.460570  7899 raft_consensus.cc:740] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:42.461434  7899 consensus_queue.cc:260] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.462538  7899 raft_consensus.cc:3060] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.463047  7972 raft_consensus.cc:515] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.465548  7898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:42.465883  7972 leader_election.cc:290] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 3 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67:41085)
I20260709 12:25:42.466055  7898 raft_consensus.cc:3055] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:42.466367  7898 raft_consensus.cc:740] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:42.466523  7973 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 3.
I20260709 12:25:42.467124  7898 consensus_queue.cc:260] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.467680  8013 leader_election.cc:304] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:42.468305  7898 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.468423  8211 raft_consensus.cc:2804] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:42.468700  8046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88b9c913a6144f65bc61967680f3c7da" candidate_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
I20260709 12:25:42.469152  8046 raft_consensus.cc:3060] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.469763  8211 raft_consensus.cc:697] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:42.470634  8211 consensus_queue.cc:237] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.474061  8046 raft_consensus.cc:2468] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 3.
I20260709 12:25:42.468276  7899 raft_consensus.cc:2468] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 3.
I20260709 12:25:42.475134  7898 raft_consensus.cc:2468] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc82f2ae9bbd41768bb8bf689a5d6cc2 in term 3.
I20260709 12:25:42.476410  7939 leader_election.cc:304] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:42.477599  8228 raft_consensus.cc:2804] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:42.478018  8228 raft_consensus.cc:697] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 LEADER]: Becoming Leader. State: Replica: bc82f2ae9bbd41768bb8bf689a5d6cc2, State: Running, Role: LEADER
I20260709 12:25:42.479204  8230 raft_consensus.cc:993] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24: : Instructing follower 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:42.478838  8228 consensus_queue.cc:237] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.478665  7794 catalog_manager.cc:5697] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 2 to 3, leader changed from 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65) to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 3 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.479665  8230 raft_consensus.cc:1081] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Signalling peer 00cd69f96ebb4807860f7a4adf9926b5 to start an election
I20260709 12:25:42.481108  8046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34bc111abaf44a139bd81404762479bf"
dest_uuid: "00cd69f96ebb4807860f7a4adf9926b5"
 from {username='slave'} at 127.0.0.1:38126
I20260709 12:25:42.481523  8046 raft_consensus.cc:493] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:42.481789  8046 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.487001  7797 catalog_manager.cc:5697] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 reported cstate change: term changed from 2 to 3, leader changed from 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65) to bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66). New cstate: current_term: 3 leader_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:42.490729  8046 raft_consensus.cc:515] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.492559  8046 leader_election.cc:290] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 3 election: Requested vote from peers 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131), bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399)
I20260709 12:25:42.493530  7973 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2"
I20260709 12:25:42.493533  7898 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34bc111abaf44a139bd81404762479bf" candidate_uuid: "00cd69f96ebb4807860f7a4adf9926b5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6a11c60e8742448bb36b6d105fb8cb24"
I20260709 12:25:42.494163  7973 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.494259  7898 raft_consensus.cc:3055] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:42.494645  7898 raft_consensus.cc:740] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6a11c60e8742448bb36b6d105fb8cb24, State: Running, Role: LEADER
I20260709 12:25:42.495357  7898 consensus_queue.cc:260] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.496369  7898 raft_consensus.cc:3060] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:42.498674  7973 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 3.
I20260709 12:25:42.499948  8013 leader_election.cc:304] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00cd69f96ebb4807860f7a4adf9926b5, bc82f2ae9bbd41768bb8bf689a5d6cc2; no voters: 
I20260709 12:25:42.500633  8211 raft_consensus.cc:2804] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:42.501035  8211 raft_consensus.cc:697] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Becoming Leader. State: Replica: 00cd69f96ebb4807860f7a4adf9926b5, State: Running, Role: LEADER
I20260709 12:25:42.501807  7898 raft_consensus.cc:2468] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00cd69f96ebb4807860f7a4adf9926b5 in term 3.
I20260709 12:25:42.501713  8211 consensus_queue.cc:237] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } }
I20260709 12:25:42.508495  7797 catalog_manager.cc:5697] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 reported cstate change: term changed from 2 to 3, leader changed from 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65) to 00cd69f96ebb4807860f7a4adf9926b5 (127.7.23.67). New cstate: current_term: 3 leader_uuid: "00cd69f96ebb4807860f7a4adf9926b5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.616647  7898 raft_consensus.cc:1275] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.617676  8228 consensus_queue.cc:1048] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:42.626130  8046 raft_consensus.cc:1275] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.628198  8231 consensus_queue.cc:1048] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:42.861012  8046 raft_consensus.cc:1275] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.862229  8231 consensus_queue.cc:1048] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00cd69f96ebb4807860f7a4adf9926b5" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:42.870769  7898 raft_consensus.cc:1275] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Refusing update from remote peer bc82f2ae9bbd41768bb8bf689a5d6cc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.873649  8228 consensus_queue.cc:1048] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:42.949481  7898 raft_consensus.cc:1275] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.950572  8211 consensus_queue.cc:1048] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:42.958895  7973 raft_consensus.cc:1275] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:42.960299  8237 consensus_queue.cc:1048] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:43.086122  7973 raft_consensus.cc:1275] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:43.087159  8237 consensus_queue.cc:1048] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc82f2ae9bbd41768bb8bf689a5d6cc2" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 35399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:43.096472  7898 raft_consensus.cc:1275] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Refusing update from remote peer 00cd69f96ebb4807860f7a4adf9926b5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:43.097548  8237 consensus_queue.cc:1048] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a11c60e8742448bb36b6d105fb8cb24" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:43.137045  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:43.142385  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:43.142823  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.143802  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.149190  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:44.149637  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:45.150739  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.156399  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:45.156803  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.157752  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:46.162950  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:46.163363  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:47.164266  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:47.169564  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:47.169977  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:48.170879  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:48.176198  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:48.176646  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.177497  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.183256  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:49.183660  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:50.269795  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.274923  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:50.275287  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:50.567922  7828 debug-util.cc:398] Leaking SignalData structure 0x7b08000520a0 after lost signal to thread 7264
W20260709 12:25:50.568735  7828 debug-util.cc:398] Leaking SignalData structure 0x7b0800052780 after lost signal to thread 7831
W20260709 12:25:50.569526  7828 debug-util.cc:398] Leaking SignalData structure 0x7b080018d340 after lost signal to thread 7923
W20260709 12:25:50.570211  7828 debug-util.cc:398] Leaking SignalData structure 0x7b080011faa0 after lost signal to thread 7998
W20260709 12:25:50.570899  7828 debug-util.cc:398] Leaking SignalData structure 0x7b08000ec0a0 after lost signal to thread 8072
I20260709 12:25:51.276154  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.281975  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:25:51.282500  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:52.312953  7261 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:25:52.313571  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
I20260709 12:25:52.339052  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:52.339926  7261 tablet_replica.cc:333] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.340975  7261 raft_consensus.cc:2243] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.341969  7261 raft_consensus.cc:2272] T 2ef440a066f94470a7e1c471bc09d7c2 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.345050  7261 tablet_replica.cc:333] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.345763  7261 raft_consensus.cc:2243] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.346707  7261 raft_consensus.cc:2272] T 70cc0a342b2943bd8c3f6cd9101ce92a P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.349154  7261 tablet_replica.cc:333] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.349876  7261 raft_consensus.cc:2243] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.350427  7261 raft_consensus.cc:2272] T 88b9c913a6144f65bc61967680f3c7da P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.352917  7261 tablet_replica.cc:333] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.353612  7261 raft_consensus.cc:2243] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.354147  7261 raft_consensus.cc:2272] T b2a1f97f360d445b81e445e3fb4517dd P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.356820  7261 tablet_replica.cc:333] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.357525  7261 raft_consensus.cc:2243] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.358078  7261 raft_consensus.cc:2272] T ce94d8a4ccd2484794a76653e90c8b87 P 6a11c60e8742448bb36b6d105fb8cb24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.360452  7261 tablet_replica.cc:333] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.361146  7261 raft_consensus.cc:2243] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.361667  7261 raft_consensus.cc:2272] T 34bc111abaf44a139bd81404762479bf P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.363974  7261 tablet_replica.cc:333] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.364626  7261 raft_consensus.cc:2243] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.365583  7261 raft_consensus.cc:2272] T 96da851c7beb4d22b1774e7b2ed141ce P 6a11c60e8742448bb36b6d105fb8cb24 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.367955  7261 tablet_replica.cc:333] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.368543  7261 raft_consensus.cc:2243] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.369503  7261 raft_consensus.cc:2272] T 882454296e07428092d0a23c75c2dc2b P 6a11c60e8742448bb36b6d105fb8cb24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.371745  7261 tablet_replica.cc:333] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.372327  7261 raft_consensus.cc:2243] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.372821  7261 raft_consensus.cc:2272] T 9289119bbaed43a785dc8d934b329ec4 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.375030  7261 tablet_replica.cc:333] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24: stopping tablet replica
I20260709 12:25:52.375603  7261 raft_consensus.cc:2243] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.376565  7261 raft_consensus.cc:2272] T 093d8a84cdcb47cbae704f3800be7674 P 6a11c60e8742448bb36b6d105fb8cb24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.412423  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
I20260709 12:25:52.434804  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
I20260709 12:25:52.462301  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:52.463001  7261 tablet_replica.cc:333] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.463860  7261 raft_consensus.cc:2243] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.464496  7261 raft_consensus.cc:2272] T 2ef440a066f94470a7e1c471bc09d7c2 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.466589  7261 tablet_replica.cc:333] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.467280  7261 raft_consensus.cc:2243] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.467844  7261 raft_consensus.cc:2272] T b2a1f97f360d445b81e445e3fb4517dd P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:52.468694  8013 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 12:25:52.470216  7261 tablet_replica.cc:333] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.471067  7261 raft_consensus.cc:2243] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.472030  7261 raft_consensus.cc:2272] T 88b9c913a6144f65bc61967680f3c7da P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:52.472214  8013 consensus_peers.cc:597] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 -> Peer bc82f2ae9bbd41768bb8bf689a5d6cc2 (127.7.23.66:35399): Couldn't send request to peer bc82f2ae9bbd41768bb8bf689a5d6cc2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.473933  7261 tablet_replica.cc:333] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.474579  7261 raft_consensus.cc:2243] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.475013  7261 raft_consensus.cc:2272] T 093d8a84cdcb47cbae704f3800be7674 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.476800  7261 tablet_replica.cc:333] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.477262  7261 raft_consensus.cc:2243] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.477989  7261 raft_consensus.cc:2272] T 9289119bbaed43a785dc8d934b329ec4 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.479710  7261 tablet_replica.cc:333] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.480281  7261 raft_consensus.cc:2243] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.480789  7261 raft_consensus.cc:2272] T 70cc0a342b2943bd8c3f6cd9101ce92a P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.483114  7261 tablet_replica.cc:333] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.483745  7261 raft_consensus.cc:2243] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.484632  7261 raft_consensus.cc:2272] T ce94d8a4ccd2484794a76653e90c8b87 P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:52.486011  8013 consensus_peers.cc:597] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 -> Peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Couldn't send request to peer 6a11c60e8742448bb36b6d105fb8cb24. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.486720  7261 tablet_replica.cc:333] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.487181  7261 raft_consensus.cc:2243] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.487612  7261 raft_consensus.cc:2272] T 34bc111abaf44a139bd81404762479bf P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.489372  7261 tablet_replica.cc:333] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.489821  7261 raft_consensus.cc:2243] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.490222  7261 raft_consensus.cc:2272] T 882454296e07428092d0a23c75c2dc2b P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.491997  7261 tablet_replica.cc:333] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2: stopping tablet replica
I20260709 12:25:52.492445  7261 raft_consensus.cc:2243] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.492875  7261 raft_consensus.cc:2272] T 96da851c7beb4d22b1774e7b2ed141ce P bc82f2ae9bbd41768bb8bf689a5d6cc2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.522459  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
W20260709 12:25:52.526051  8013 consensus_peers.cc:597] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 -> Peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Couldn't send request to peer 6a11c60e8742448bb36b6d105fb8cb24. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:25:52.530781  8013 consensus_peers.cc:597] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 -> Peer 6a11c60e8742448bb36b6d105fb8cb24 (127.7.23.65:42131): Couldn't send request to peer 6a11c60e8742448bb36b6d105fb8cb24. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.546682  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
I20260709 12:25:52.573448  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:25:52.574270  7261 tablet_replica.cc:333] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.575121  7261 raft_consensus.cc:2243] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.575769  7261 raft_consensus.cc:2272] T 9289119bbaed43a785dc8d934b329ec4 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.578224  7261 tablet_replica.cc:333] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.578892  7261 raft_consensus.cc:2243] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.579383  7261 raft_consensus.cc:2272] T 093d8a84cdcb47cbae704f3800be7674 P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.581650  7261 tablet_replica.cc:333] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.582293  7261 raft_consensus.cc:2243] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.582839  7261 raft_consensus.cc:2272] T 70cc0a342b2943bd8c3f6cd9101ce92a P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.585191  7261 tablet_replica.cc:333] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.585850  7261 raft_consensus.cc:2243] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.586730  7261 raft_consensus.cc:2272] T 2ef440a066f94470a7e1c471bc09d7c2 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.588996  7261 tablet_replica.cc:333] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.589632  7261 raft_consensus.cc:2243] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.590145  7261 raft_consensus.cc:2272] T 96da851c7beb4d22b1774e7b2ed141ce P 00cd69f96ebb4807860f7a4adf9926b5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.592393  7261 tablet_replica.cc:333] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.593005  7261 raft_consensus.cc:2243] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.593459  7261 raft_consensus.cc:2272] T 882454296e07428092d0a23c75c2dc2b P 00cd69f96ebb4807860f7a4adf9926b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.595659  7261 tablet_replica.cc:333] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.596288  7261 raft_consensus.cc:2243] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.596787  7261 raft_consensus.cc:2272] T ce94d8a4ccd2484794a76653e90c8b87 P 00cd69f96ebb4807860f7a4adf9926b5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.598941  7261 tablet_replica.cc:333] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.599552  7261 raft_consensus.cc:2243] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.600435  7261 raft_consensus.cc:2272] T 34bc111abaf44a139bd81404762479bf P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.602643  7261 tablet_replica.cc:333] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.603307  7261 raft_consensus.cc:2243] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.604238  7261 raft_consensus.cc:2272] T b2a1f97f360d445b81e445e3fb4517dd P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.606338  7261 tablet_replica.cc:333] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5: stopping tablet replica
I20260709 12:25:52.606896  7261 raft_consensus.cc:2243] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:52.607481  7261 raft_consensus.cc:2272] T 88b9c913a6144f65bc61967680f3c7da P 00cd69f96ebb4807860f7a4adf9926b5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.640720  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
I20260709 12:25:52.661604  7261 master.cc:562] Master@127.7.23.126:36399 shutting down...
I20260709 12:25:52.681855  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:25:52.682391  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:52.682687  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P 49881dee8f894e5bb55a237f5894106a: stopping tablet replica
I20260709 12:25:52.716997  7261 master.cc:584] Master@127.7.23.126:36399 shutdown complete.
00cd69f96ebb4807860f7a4adf9926b5  1
6a11c60e8742448bb36b6d105fb8cb24  5
bc82f2ae9bbd41768bb8bf689a5d6cc2  4
00cd69f96ebb4807860f7a4adf9926b5  3
6a11c60e8742448bb36b6d105fb8cb24  3
bc82f2ae9bbd41768bb8bf689a5d6cc2  4
00cd69f96ebb4807860f7a4adf9926b5  1
6a11c60e8742448bb36b6d105fb8cb24  8
bc82f2ae9bbd41768bb8bf689a5d6cc2  1
00cd69f96ebb4807860f7a4adf9926b5  3
6a11c60e8742448bb36b6d105fb8cb24  4
bc82f2ae9bbd41768bb8bf689a5d6cc2  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28382 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:25:52.754081  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:36193
I20260709 12:25:52.755146  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:52.760645  8270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.761243  8273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.761240  8271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.762112  7261 server_base.cc:1061] running on GCE node
I20260709 12:25:52.763044  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:52.763214  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:52.763365  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599952763347 us; error 0 us; skew 500 ppm
I20260709 12:25:52.764158  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:52.766367  7261 webserver.cc:533] Webserver started at http://127.7.23.126:43683/ using document root <none> and password file <none>
I20260709 12:25:52.766825  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:52.766995  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:52.767238  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:52.768347  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "fda1d6ce844f48669763ced7af1542be"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-ps85"
I20260709 12:25:52.772403  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:25:52.775513  8278 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.776177  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:52.776427  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "fda1d6ce844f48669763ced7af1542be"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-ps85"
I20260709 12:25:52.776711  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:52.790593  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:52.791788  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:52.828539  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:36193
I20260709 12:25:52.828625  8329 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:36193 every 8 connection(s)
I20260709 12:25:52.832293  8330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:52.841578  8330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Bootstrap starting.
I20260709 12:25:52.845954  8330 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:52.850024  8330 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: No bootstrap required, opened a new log
I20260709 12:25:52.852120  8330 raft_consensus.cc:359] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda1d6ce844f48669763ced7af1542be" member_type: VOTER }
I20260709 12:25:52.852530  8330 raft_consensus.cc:385] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:52.852737  8330 raft_consensus.cc:740] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fda1d6ce844f48669763ced7af1542be, State: Initialized, Role: FOLLOWER
I20260709 12:25:52.853258  8330 consensus_queue.cc:260] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda1d6ce844f48669763ced7af1542be" member_type: VOTER }
I20260709 12:25:52.853693  8330 raft_consensus.cc:399] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:25:52.853900  8330 raft_consensus.cc:493] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:25:52.854141  8330 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:52.858037  8330 raft_consensus.cc:515] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda1d6ce844f48669763ced7af1542be" member_type: VOTER }
I20260709 12:25:52.858511  8330 leader_election.cc:304] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fda1d6ce844f48669763ced7af1542be; no voters: 
I20260709 12:25:52.859635  8330 leader_election.cc:290] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:25:52.859926  8333 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:52.861161  8333 raft_consensus.cc:697] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 1 LEADER]: Becoming Leader. State: Replica: fda1d6ce844f48669763ced7af1542be, State: Running, Role: LEADER
I20260709 12:25:52.861797  8333 consensus_queue.cc:237] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda1d6ce844f48669763ced7af1542be" member_type: VOTER }
I20260709 12:25:52.862418  8330 sys_catalog.cc:565] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:25:52.866398  8335 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [sys.catalog]: SysCatalogTable state changed. Reason: New leader fda1d6ce844f48669763ced7af1542be. Latest consensus state: current_term: 1 leader_uuid: "fda1d6ce844f48669763ced7af1542be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda1d6ce844f48669763ced7af1542be" member_type: VOTER } }
I20260709 12:25:52.866571  8334 sys_catalog.cc:455] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fda1d6ce844f48669763ced7af1542be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fda1d6ce844f48669763ced7af1542be" member_type: VOTER } }
I20260709 12:25:52.867069  8335 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:52.867251  8334 sys_catalog.cc:458] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [sys.catalog]: This master's current role is: LEADER
I20260709 12:25:52.872179  8340 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:25:52.876956  8340 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:25:52.880864  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:25:52.885313  8340 catalog_manager.cc:1383] Generated new cluster ID: aeeff23a93494b70bc7f4b48b8818800
I20260709 12:25:52.885560  8340 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:25:52.901196  8340 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:25:52.902415  8340 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:25:52.913527  8340 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Generated new TSK 0
I20260709 12:25:52.914031  8340 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:25:52.947053  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:52.952706  8351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:52.953464  8352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.955475  7261 server_base.cc:1061] running on GCE node
W20260709 12:25:52.955655  8354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:52.956557  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:52.956738  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:52.956904  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599952956886 us; error 0 us; skew 500 ppm
I20260709 12:25:52.957403  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:52.959697  7261 webserver.cc:533] Webserver started at http://127.7.23.65:41731/ using document root <none> and password file <none>
I20260709 12:25:52.960147  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:52.960314  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:52.960561  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:52.961548  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "21c151c99bcf4cbeb819de06e68d95bf"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-ps85"
I20260709 12:25:52.965692  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:25:52.968711  8359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.969367  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:25:52.969631  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "21c151c99bcf4cbeb819de06e68d95bf"
format_stamp: "Formatted at 2026-07-09 12:25:52 on dist-test-slave-ps85"
I20260709 12:25:52.969892  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:52.988010  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:52.989158  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:52.990602  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:52.992849  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:52.993034  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:52.993245  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:52.993410  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.031198  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:38641
I20260709 12:25:53.031294  8421 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:38641 every 8 connection(s)
I20260709 12:25:53.035877  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:53.043008  8426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:53.044107  8427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:53.047464  8429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:53.048082  7261 server_base.cc:1061] running on GCE node
I20260709 12:25:53.049304  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:53.049554  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:53.049743  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599953049727 us; error 0 us; skew 500 ppm
I20260709 12:25:53.050325  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:53.051020  8422 heartbeater.cc:344] Connected to a master server at 127.7.23.126:36193
I20260709 12:25:53.051448  8422 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:53.052273  8422 heartbeater.cc:507] Master 127.7.23.126:36193 requested a full tablet report, sending...
I20260709 12:25:53.052974  7261 webserver.cc:533] Webserver started at http://127.7.23.66:45391/ using document root <none> and password file <none>
I20260709 12:25:53.053543  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:53.053779  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:53.054067  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:53.054594  8295 ts_manager.cc:194] Registered new tserver with Master: 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:25:53.055198  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
format_stamp: "Formatted at 2026-07-09 12:25:53 on dist-test-slave-ps85"
I20260709 12:25:53.056301  8295 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35636
I20260709 12:25:53.060076  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:25:53.063179  8434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.063879  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:25:53.064153  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
format_stamp: "Formatted at 2026-07-09 12:25:53 on dist-test-slave-ps85"
I20260709 12:25:53.064400  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:53.072671  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:53.073719  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:53.075091  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:53.077185  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:53.077356  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.077575  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:53.077715  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.115492  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:41641
I20260709 12:25:53.115573  8496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:41641 every 8 connection(s)
I20260709 12:25:53.120111  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:25:53.126636  8500 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:25:53.127779  8501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:53.130409  7261 server_base.cc:1061] running on GCE node
W20260709 12:25:53.131036  8503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:25:53.131682  8497 heartbeater.cc:344] Connected to a master server at 127.7.23.126:36193
I20260709 12:25:53.131999  8497 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:53.132084  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:25:53.132326  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:25:53.132483  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599953132465 us; error 0 us; skew 500 ppm
I20260709 12:25:53.132721  8497 heartbeater.cc:507] Master 127.7.23.126:36193 requested a full tablet report, sending...
I20260709 12:25:53.133024  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:25:53.134696  8295 ts_manager.cc:194] Registered new tserver with Master: 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:53.136011  8295 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35638
I20260709 12:25:53.137123  7261 webserver.cc:533] Webserver started at http://127.7.23.67:38693/ using document root <none> and password file <none>
I20260709 12:25:53.137602  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:25:53.137777  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:25:53.138013  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:25:53.139094  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "aef8c9f023564378a04e3e1e6171930d"
format_stamp: "Formatted at 2026-07-09 12:25:53 on dist-test-slave-ps85"
I20260709 12:25:53.143126  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 12:25:53.146103  8508 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.146721  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:25:53.146975  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "aef8c9f023564378a04e3e1e6171930d"
format_stamp: "Formatted at 2026-07-09 12:25:53 on dist-test-slave-ps85"
I20260709 12:25:53.147228  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:25:53.168699  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:25:53.169834  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:25:53.171211  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:25:53.173379  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:25:53.173566  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.173780  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:25:53.173926  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:25:53.212540  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:37713
I20260709 12:25:53.212674  8570 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:37713 every 8 connection(s)
I20260709 12:25:53.224881  8571 heartbeater.cc:344] Connected to a master server at 127.7.23.126:36193
I20260709 12:25:53.225244  8571 heartbeater.cc:461] Registering TS with master...
I20260709 12:25:53.225903  8571 heartbeater.cc:507] Master 127.7.23.126:36193 requested a full tablet report, sending...
I20260709 12:25:53.227692  8295 ts_manager.cc:194] Registered new tserver with Master: aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:53.228529  7261 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013142877s
I20260709 12:25:53.228945  8295 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35652
I20260709 12:25:53.251895  8295 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35666:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:25:53.257771  8295 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:25:53.446166  8462 tablet_service.cc:1511] Processing CreateTablet for tablet aeb63cbffbd24922b72419df5ee40899 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:53.446460  8461 tablet_service.cc:1511] Processing CreateTablet for tablet 046c03262b594a9c8af1b19c581fb4b6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:53.447499  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb63cbffbd24922b72419df5ee40899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.448047  8461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 046c03262b594a9c8af1b19c581fb4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.448786  8460 tablet_service.cc:1511] Processing CreateTablet for tablet f2739228b32f48d7a73d1704fa1bfe5b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:53.450033  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2739228b32f48d7a73d1704fa1bfe5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.455281  8459 tablet_service.cc:1511] Processing CreateTablet for tablet c7efab53f2634a5abbadd798832d128c (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:53.456537  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7efab53f2634a5abbadd798832d128c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.460562  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 78f588f9461a426ebd4a55bd3ade3583 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:53.461957  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f588f9461a426ebd4a55bd3ade3583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.468132  8387 tablet_service.cc:1511] Processing CreateTablet for tablet aeb63cbffbd24922b72419df5ee40899 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:53.468904  8457 tablet_service.cc:1511] Processing CreateTablet for tablet df155d204dc041d7b2ce5467f8825efd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:53.469435  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb63cbffbd24922b72419df5ee40899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.470842  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df155d204dc041d7b2ce5467f8825efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.473213  8386 tablet_service.cc:1511] Processing CreateTablet for tablet 046c03262b594a9c8af1b19c581fb4b6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:53.473688  8385 tablet_service.cc:1511] Processing CreateTablet for tablet f2739228b32f48d7a73d1704fa1bfe5b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:53.474897  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2739228b32f48d7a73d1704fa1bfe5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.477761  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 9ddabc2a2d42405c9f529c8489fdf71b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:53.478979  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ddabc2a2d42405c9f529c8489fdf71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.480557  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 046c03262b594a9c8af1b19c581fb4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.481925  8455 tablet_service.cc:1511] Processing CreateTablet for tablet fea9eaca8b50473cb6788b0928b3f8c4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:53.483161  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea9eaca8b50473cb6788b0928b3f8c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.486071  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 5899a880ee09417eb2739689c0d74579 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:53.489249  8453 tablet_service.cc:1511] Processing CreateTablet for tablet dec3215185474277adc36392bd1a7eda (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:53.490504  8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec3215185474277adc36392bd1a7eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.495103  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5899a880ee09417eb2739689c0d74579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.499584  8384 tablet_service.cc:1511] Processing CreateTablet for tablet c7efab53f2634a5abbadd798832d128c (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:53.500866  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7efab53f2634a5abbadd798832d128c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.504938  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 78f588f9461a426ebd4a55bd3ade3583 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:53.506191  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f588f9461a426ebd4a55bd3ade3583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.506562  8378 tablet_service.cc:1511] Processing CreateTablet for tablet 5899a880ee09417eb2739689c0d74579 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:53.508054  8378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5899a880ee09417eb2739689c0d74579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.508527  8382 tablet_service.cc:1511] Processing CreateTablet for tablet df155d204dc041d7b2ce5467f8825efd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:53.509727  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df155d204dc041d7b2ce5467f8825efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.512537  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 7ae3eef998ef416f8ebd3e8c21b20834 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:53.513787  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae3eef998ef416f8ebd3e8c21b20834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.516521  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 9ddabc2a2d42405c9f529c8489fdf71b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:53.517729  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ddabc2a2d42405c9f529c8489fdf71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.520539  8379 tablet_service.cc:1511] Processing CreateTablet for tablet fea9eaca8b50473cb6788b0928b3f8c4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:53.521781  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea9eaca8b50473cb6788b0928b3f8c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.523705  8461 tablet_service.cc:1511] Processing CreateTablet for tablet 7ae3eef998ef416f8ebd3e8c21b20834 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:53.538324  8461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae3eef998ef416f8ebd3e8c21b20834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.538962  8387 tablet_service.cc:1511] Processing CreateTablet for tablet dec3215185474277adc36392bd1a7eda (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:53.540247  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec3215185474277adc36392bd1a7eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.543300  8386 tablet_service.cc:1511] Processing CreateTablet for tablet 688c3b409a5a44acae5413866342b3c4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:53.552706  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688c3b409a5a44acae5413866342b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.558084  8462 tablet_service.cc:1511] Processing CreateTablet for tablet 688c3b409a5a44acae5413866342b3c4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:53.559530  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688c3b409a5a44acae5413866342b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.565656  8587 tablet_bootstrap.cc:492] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:53.568324  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:53.569548  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.571265  8536 tablet_service.cc:1511] Processing CreateTablet for tablet aeb63cbffbd24922b72419df5ee40899 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:25:53.571768  8587 tablet_bootstrap.cc:654] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.572537  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aeb63cbffbd24922b72419df5ee40899. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.574313  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 7ae3eef998ef416f8ebd3e8c21b20834 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:25:53.575284  8528 tablet_service.cc:1511] Processing CreateTablet for tablet fea9eaca8b50473cb6788b0928b3f8c4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:25:53.576512  8535 tablet_service.cc:1511] Processing CreateTablet for tablet 046c03262b594a9c8af1b19c581fb4b6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:25:53.579829  8533 tablet_service.cc:1511] Processing CreateTablet for tablet c7efab53f2634a5abbadd798832d128c (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:25:53.582082  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 78f588f9461a426ebd4a55bd3ade3583 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:25:53.586501  8531 tablet_service.cc:1511] Processing CreateTablet for tablet df155d204dc041d7b2ce5467f8825efd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:25:53.587165  8534 tablet_service.cc:1511] Processing CreateTablet for tablet f2739228b32f48d7a73d1704fa1bfe5b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:25:53.591740  8586 tablet_bootstrap.cc:492] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:53.591579  8527 tablet_service.cc:1511] Processing CreateTablet for tablet 5899a880ee09417eb2739689c0d74579 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:25:53.587095  8529 tablet_service.cc:1511] Processing CreateTablet for tablet 9ddabc2a2d42405c9f529c8489fdf71b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:25:53.593140  8378 tablet_service.cc:1511] Processing CreateTablet for tablet ea5d246a744e484fa3414c038a792b99 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:53.601614  8378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5d246a744e484fa3414c038a792b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.593832  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae3eef998ef416f8ebd3e8c21b20834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.608004  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7efab53f2634a5abbadd798832d128c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.610452  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df155d204dc041d7b2ce5467f8825efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.611850  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5899a880ee09417eb2739689c0d74579. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.614133  8454 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1cdb4d1a4411f9717ef7b1d0b1b94 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:53.615823  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ddabc2a2d42405c9f529c8489fdf71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.617542  8535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 046c03262b594a9c8af1b19c581fb4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.623762  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2739228b32f48d7a73d1704fa1bfe5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.627785  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea9eaca8b50473cb6788b0928b3f8c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.623447  8460 tablet_service.cc:1511] Processing CreateTablet for tablet dabecae7023948069d48a04cefe25522 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:53.615330  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1cdb4d1a4411f9717ef7b1d0b1b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.633888  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78f588f9461a426ebd4a55bd3ade3583. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.585557  8458 tablet_service.cc:1511] Processing CreateTablet for tablet ea5d246a744e484fa3414c038a792b99 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:53.651470  8456 tablet_service.cc:1511] Processing CreateTablet for tablet ea8ca6961a884db3b196c76ca97b049a (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:53.660923  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabecae7023948069d48a04cefe25522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.664827  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ca6961a884db3b196c76ca97b049a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.674587  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 28f6deaf14d94befa991497fcc0de1f5 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:53.678089  8384 tablet_service.cc:1511] Processing CreateTablet for tablet dabecae7023948069d48a04cefe25522 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:53.679136  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f6deaf14d94befa991497fcc0de1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.680214  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:53.681124  8385 tablet_service.cc:1511] Processing CreateTablet for tablet ea8ca6961a884db3b196c76ca97b049a (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:53.685956  8378 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1cdb4d1a4411f9717ef7b1d0b1b94 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:53.686510  8386 tablet_service.cc:1511] Processing CreateTablet for tablet 28f6deaf14d94befa991497fcc0de1f5 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:53.679363  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabecae7023948069d48a04cefe25522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.689471  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.698544  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ca6961a884db3b196c76ca97b049a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.699625  8453 tablet_service.cc:1511] Processing CreateTablet for tablet 5164be0f063b4907aae5b6f874361ca3 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:53.700825  8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5164be0f063b4907aae5b6f874361ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.704849  8587 tablet_bootstrap.cc:492] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:53.705325  8587 ts_tablet_manager.cc:1403] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.141s	user 0.044s	sys 0.033s
I20260709 12:25:53.706074  8533 tablet_service.cc:1511] Processing CreateTablet for tablet dec3215185474277adc36392bd1a7eda (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:25:53.707294  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dec3215185474277adc36392bd1a7eda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.708231  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5d246a744e484fa3414c038a792b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.713893  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 5164be0f063b4907aae5b6f874361ca3 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:53.714957  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 15e2fa2b1330485fb8fbc9b08f54955b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:53.715294  8379 tablet_service.cc:1511] Processing CreateTablet for tablet d3541cfbddb54a3dbef569666e60ffb4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:53.718057  8587 raft_consensus.cc:359] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:53.718782  8587 raft_consensus.cc:385] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:53.719086  8587 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.719486  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 9a231323db194487a6ca917e91cb1389 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:53.721431  8459 tablet_service.cc:1511] Processing CreateTablet for tablet d3541cfbddb54a3dbef569666e60ffb4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:53.721865  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f6deaf14d94befa991497fcc0de1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.721985  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 3594f197bee04c33b4ae361b87965bd6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:53.722633  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3541cfbddb54a3dbef569666e60ffb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.730598  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e2fa2b1330485fb8fbc9b08f54955b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.731179  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5164be0f063b4907aae5b6f874361ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.730974  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 9a231323db194487a6ca917e91cb1389 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:53.731798  8378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1cdb4d1a4411f9717ef7b1d0b1b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.732280  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a231323db194487a6ca917e91cb1389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.732441  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3541cfbddb54a3dbef569666e60ffb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.733820  8536 tablet_service.cc:1511] Processing CreateTablet for tablet 688c3b409a5a44acae5413866342b3c4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:25:53.735034  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 688c3b409a5a44acae5413866342b3c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.742195  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a231323db194487a6ca917e91cb1389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.720646  8587 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:53.825054  8422 heartbeater.cc:499] Master 127.7.23.126:36193 was elected leader, sending a full tablet report...
I20260709 12:25:53.782579  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3594f197bee04c33b4ae361b87965bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.757740  8462 tablet_service.cc:1511] Processing CreateTablet for tablet 3594f197bee04c33b4ae361b87965bd6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:53.762884  8527 tablet_service.cc:1511] Processing CreateTablet for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:25:53.825922  8587 ts_tablet_manager.cc:1434] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.000s
I20260709 12:25:53.859685  8587 tablet_bootstrap.cc:492] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:53.811496  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 28f6deaf14d94befa991497fcc0de1f5 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:25:53.858654  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.860546  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f6deaf14d94befa991497fcc0de1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.801251  8586 tablet_bootstrap.cc:654] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.809165  8460 tablet_service.cc:1511] Processing CreateTablet for tablet c6fb68f59621452b8e81b4fbe2cda697 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:53.765532  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 8974a3bbc8c3420f95c2b151405bd386 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:53.778950  8589 tablet_bootstrap.cc:492] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:53.820792  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 3d674c56f11d4d76a575c52d1a0e66bd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:53.803588  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 8974a3bbc8c3420f95c2b151405bd386 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:53.751340  8532 tablet_service.cc:1511] Processing CreateTablet for tablet ea5d246a744e484fa3414c038a792b99 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:25:53.767325  8459 tablet_service.cc:1511] Processing CreateTablet for tablet 15e2fa2b1330485fb8fbc9b08f54955b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:53.866963  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 80def59f123c433b90d8ddb5d7e620c6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:53.820722  8529 tablet_service.cc:1511] Processing CreateTablet for tablet 5164be0f063b4907aae5b6f874361ca3 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:25:53.869602  8387 tablet_service.cc:1511] Processing CreateTablet for tablet ec5712a692fb47d3aaf9c8440b1a75a1 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:53.849049  8379 tablet_service.cc:1511] Processing CreateTablet for tablet 3d674c56f11d4d76a575c52d1a0e66bd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:53.757000  8534 tablet_service.cc:1511] Processing CreateTablet for tablet dabecae7023948069d48a04cefe25522 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:25:53.800092  8531 tablet_service.cc:1511] Processing CreateTablet for tablet eaf1cdb4d1a4411f9717ef7b1d0b1b94 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:25:53.774230  8535 tablet_service.cc:1511] Processing CreateTablet for tablet ea8ca6961a884db3b196c76ca97b049a (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:25:53.872663  8455 tablet_service.cc:1511] Processing CreateTablet for tablet ec5712a692fb47d3aaf9c8440b1a75a1 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:53.828414  8461 tablet_service.cc:1511] Processing CreateTablet for tablet 80def59f123c433b90d8ddb5d7e620c6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:53.874588  8530 tablet_service.cc:1511] Processing CreateTablet for tablet d3541cfbddb54a3dbef569666e60ffb4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:25:53.865968  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5d246a744e484fa3414c038a792b99. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.878759  8535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8ca6961a884db3b196c76ca97b049a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.766717  8386 tablet_service.cc:1511] Processing CreateTablet for tablet c6fb68f59621452b8e81b4fbe2cda697 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:53.879492  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dabecae7023948069d48a04cefe25522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.858577  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3594f197bee04c33b4ae361b87965bd6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:53.880321  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:53.864740  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8974a3bbc8c3420f95c2b151405bd386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.881176  8459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e2fa2b1330485fb8fbc9b08f54955b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.881414  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80def59f123c433b90d8ddb5d7e620c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.883701  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaf1cdb4d1a4411f9717ef7b1d0b1b94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.883724  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8974a3bbc8c3420f95c2b151405bd386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.887441  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5164be0f063b4907aae5b6f874361ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.887723  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d674c56f11d4d76a575c52d1a0e66bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.889220  8461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80def59f123c433b90d8ddb5d7e620c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.890292  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5712a692fb47d3aaf9c8440b1a75a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.891700  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3541cfbddb54a3dbef569666e60ffb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.894737  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fb68f59621452b8e81b4fbe2cda697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.896780  8589 tablet_bootstrap.cc:654] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:53.907559  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5712a692fb47d3aaf9c8440b1a75a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.907474  8536 tablet_service.cc:1511] Processing CreateTablet for tablet 9a231323db194487a6ca917e91cb1389 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:25:53.923207  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d674c56f11d4d76a575c52d1a0e66bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.916682  8533 tablet_service.cc:1511] Processing CreateTablet for tablet c6fb68f59621452b8e81b4fbe2cda697 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:25:53.931077  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a231323db194487a6ca917e91cb1389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.932056  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 88ee35c47e0d403393cb03f68a432b98 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:53.933290  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ee35c47e0d403393cb03f68a432b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.935865  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 39e8dc02425a4fafb53164fd99fe0d0d (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:53.937067  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e8dc02425a4fafb53164fd99fe0d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.936883  8453 tablet_service.cc:1511] Processing CreateTablet for tablet 2a26f17e57344b8bba537d4b071c49be (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:53.943111  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fb68f59621452b8e81b4fbe2cda697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.948386  8453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a26f17e57344b8bba537d4b071c49be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.961658  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 3594f197bee04c33b4ae361b87965bd6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:25:53.962371  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6fb68f59621452b8e81b4fbe2cda697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.965025  8382 tablet_service.cc:1511] Processing CreateTablet for tablet 2a26f17e57344b8bba537d4b071c49be (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:53.969885  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 0f58d6d40fe4445e95211f397d2e4e00 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:53.962692  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 15e2fa2b1330485fb8fbc9b08f54955b (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:25:53.982272  8384 tablet_service.cc:1511] Processing CreateTablet for tablet 88ee35c47e0d403393cb03f68a432b98 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:53.980611  8586 tablet_bootstrap.cc:492] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:54.001824  8586 ts_tablet_manager.cc:1403] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.410s	user 0.014s	sys 0.007s
I20260709 12:25:54.004518  8586 raft_consensus.cc:359] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.005224  8586 raft_consensus.cc:385] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.005512  8586 raft_consensus.cc:740] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:53.988713  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e2fa2b1330485fb8fbc9b08f54955b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.006839  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3594f197bee04c33b4ae361b87965bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.008793  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 8974a3bbc8c3420f95c2b151405bd386 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:25:54.009155  8527 tablet_service.cc:1511] Processing CreateTablet for tablet 3d674c56f11d4d76a575c52d1a0e66bd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:25:53.982995  8382 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a26f17e57344b8bba537d4b071c49be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:53.989818  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 0f58d6d40fe4445e95211f397d2e4e00 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:53.992930  8589 tablet_bootstrap.cc:492] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:54.013144  8589 ts_tablet_manager.cc:1403] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.266s	user 0.024s	sys 0.006s
I20260709 12:25:54.012693  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f58d6d40fe4445e95211f397d2e4e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.018396  8534 tablet_service.cc:1511] Processing CreateTablet for tablet 80def59f123c433b90d8ddb5d7e620c6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:25:54.019753  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f58d6d40fe4445e95211f397d2e4e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.020328  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ee35c47e0d403393cb03f68a432b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.023105  8589 raft_consensus.cc:359] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.023926  8589 raft_consensus.cc:385] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.024261  8589 raft_consensus.cc:740] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.025161  8589 consensus_queue.cc:260] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:53.972846  8587 tablet_bootstrap.cc:654] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:54.037732  8423 tablet.cc:2406] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:25:54.043143  8529 tablet_service.cc:1511] Processing CreateTablet for tablet ec5712a692fb47d3aaf9c8440b1a75a1 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:25:54.044166  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 39e8dc02425a4fafb53164fd99fe0d0d (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:54.045481  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e8dc02425a4fafb53164fd99fe0d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.041875  8586 consensus_queue.cc:260] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.010392  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d674c56f11d4d76a575c52d1a0e66bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.054562  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8974a3bbc8c3420f95c2b151405bd386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.054687  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 158edb8122f9489398444d919f25cbce (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:54.055918  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158edb8122f9489398444d919f25cbce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.059355  8383 tablet_service.cc:1511] Processing CreateTablet for tablet abbf9b71c617406c9d2be1cd987a6a94 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:54.060570  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbf9b71c617406c9d2be1cd987a6a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.060340  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 158edb8122f9489398444d919f25cbce (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:54.061523  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158edb8122f9489398444d919f25cbce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.066596  8534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80def59f123c433b90d8ddb5d7e620c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.067539  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 88ee35c47e0d403393cb03f68a432b98 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:25:54.068728  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ee35c47e0d403393cb03f68a432b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.074602  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec5712a692fb47d3aaf9c8440b1a75a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.078002  8458 tablet_service.cc:1511] Processing CreateTablet for tablet abbf9b71c617406c9d2be1cd987a6a94 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:54.079396  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbf9b71c617406c9d2be1cd987a6a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.081188  8535 tablet_service.cc:1511] Processing CreateTablet for tablet 39e8dc02425a4fafb53164fd99fe0d0d (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:25:54.082468  8535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39e8dc02425a4fafb53164fd99fe0d0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.085680  8571 heartbeater.cc:499] Master 127.7.23.126:36193 was elected leader, sending a full tablet report...
I20260709 12:25:54.094645  8590 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.095155  8590 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.122336  8587 tablet_bootstrap.cc:492] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:54.122871  8587 ts_tablet_manager.cc:1403] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.263s	user 0.012s	sys 0.003s
I20260709 12:25:54.129861  8589 ts_tablet_manager.cc:1434] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.116s	user 0.008s	sys 0.021s
I20260709 12:25:54.130982  8589 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:54.146751  8586 ts_tablet_manager.cc:1434] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.145s	user 0.002s	sys 0.009s
I20260709 12:25:54.145488  8497 heartbeater.cc:499] Master 127.7.23.126:36193 was elected leader, sending a full tablet report...
I20260709 12:25:54.133080  8590 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:54.151177  8587 raft_consensus.cc:359] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.150398  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 6a180f2cda394b6eb7ca0ecbbc583c75 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:54.195113  8586 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:54.195233  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a180f2cda394b6eb7ca0ecbbc583c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.143218  8455 tablet_service.cc:1511] Processing CreateTablet for tablet f7de1dd05702461da4c0319fda01a7ca (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:54.179446  8454 tablet_service.cc:1511] Processing CreateTablet for tablet d2e76be6a4cb43fdaee395073ab103da (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:54.180311  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 6a180f2cda394b6eb7ca0ecbbc583c75 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:54.198053  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7de1dd05702461da4c0319fda01a7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.198990  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e76be6a4cb43fdaee395073ab103da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.202291  8594 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.202792  8594 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.205443  8594 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:54.182801  8536 tablet_service.cc:1511] Processing CreateTablet for tablet 0f58d6d40fe4445e95211f397d2e4e00 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:25:54.189340  8386 tablet_service.cc:1511] Processing CreateTablet for tablet bf567c52be7141c5b7edac250f385cc4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:54.146276  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 2a26f17e57344b8bba537d4b071c49be (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:25:54.198096  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a180f2cda394b6eb7ca0ecbbc583c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.182205  8379 tablet_service.cc:1511] Processing CreateTablet for tablet d2e76be6a4cb43fdaee395073ab103da (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:54.194280  8587 raft_consensus.cc:385] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.217270  8586 tablet_bootstrap.cc:654] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.219504  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e76be6a4cb43fdaee395073ab103da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.220324  8380 tablet_service.cc:1511] Processing CreateTablet for tablet f7de1dd05702461da4c0319fda01a7ca (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:54.221658  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7de1dd05702461da4c0319fda01a7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.223717  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf567c52be7141c5b7edac250f385cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.223985  8593 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.224488  8593 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.240021  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a26f17e57344b8bba537d4b071c49be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.243950  8593 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:54.214141  8587 raft_consensus.cc:740] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.278079  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f58d6d40fe4445e95211f397d2e4e00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.285329  8454 tablet_service.cc:1511] Processing CreateTablet for tablet bf567c52be7141c5b7edac250f385cc4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:54.286625  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf567c52be7141c5b7edac250f385cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.293408  8589 tablet_bootstrap.cc:654] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.262948  8532 tablet_service.cc:1511] Processing CreateTablet for tablet 158edb8122f9489398444d919f25cbce (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:25:54.318482  8457 tablet_service.cc:1511] Processing CreateTablet for tablet f27995e97dd24420a9a7efc50ed48941 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:54.319815  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27995e97dd24420a9a7efc50ed48941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.266270  8527 tablet_service.cc:1511] Processing CreateTablet for tablet abbf9b71c617406c9d2be1cd987a6a94 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:25:54.331604  8587 consensus_queue.cc:260] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.332990  8532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 158edb8122f9489398444d919f25cbce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.333856  8587 ts_tablet_manager.cc:1434] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.211s	user 0.007s	sys 0.002s
I20260709 12:25:54.337014  8587 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:54.336900  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:54.337641  8546 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:54.339496  8436 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:54.340512  8599 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.340891  8599 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.341208  8599 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.360096  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:54.365574  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 6a180f2cda394b6eb7ca0ecbbc583c75 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:25:54.366266  8527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbf9b71c617406c9d2be1cd987a6a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.367095  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a180f2cda394b6eb7ca0ecbbc583c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.371168  8586 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:54.371672  8586 ts_tablet_manager.cc:1403] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.010s
I20260709 12:25:54.374411  8586 raft_consensus.cc:359] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.375075  8586 raft_consensus.cc:385] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.376767  8529 tablet_service.cc:1511] Processing CreateTablet for tablet f27995e97dd24420a9a7efc50ed48941 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:54.377972  8529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27995e97dd24420a9a7efc50ed48941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.375349  8586 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.380084  8533 tablet_service.cc:1511] Processing CreateTablet for tablet f7de1dd05702461da4c0319fda01a7ca (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:25:54.380412  8586 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.380801  8530 tablet_service.cc:1511] Processing CreateTablet for tablet bf567c52be7141c5b7edac250f385cc4 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:25:54.381428  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7de1dd05702461da4c0319fda01a7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.383574  8599 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.387717  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf567c52be7141c5b7edac250f385cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.388532  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:54.389089  8546 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.382480  8586 ts_tablet_manager.cc:1434] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:25:54.379346  8587 tablet_bootstrap.cc:654] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.390087  8599 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:54.396087  8586 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:54.415498  8535 tablet_service.cc:1511] Processing CreateTablet for tablet d2e76be6a4cb43fdaee395073ab103da (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:25:54.416961  8535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2e76be6a4cb43fdaee395073ab103da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.429260  8586 tablet_bootstrap.cc:654] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.502535  8457 tablet_service.cc:1511] Processing CreateTablet for tablet b9ce4c75067748ad84434b89f28725b0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:54.504529  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ce4c75067748ad84434b89f28725b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.432385  8546 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
W20260709 12:25:54.463310  8361 leader_election.cc:343] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:54.513279  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50328.3us
I20260709 12:25:54.477888  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 2219cc30a0424600b771d733ba9974e1 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:54.483130  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 2219cc30a0424600b771d733ba9974e1 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:54.515105  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2219cc30a0424600b771d733ba9974e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.515349  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2219cc30a0424600b771d733ba9974e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.486399  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:54.520622  8436 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:54.529173  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:54.530831  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.512516  8587 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:54.519315  8472 raft_consensus.cc:2393] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:25:54.533393  8599 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.534016  8599 raft_consensus.cc:697] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:54.535014  8599 consensus_queue.cc:237] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.536980  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:54.536832  8387 tablet_service.cc:1511] Processing CreateTablet for tablet b9ce4c75067748ad84434b89f28725b0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:54.538307  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ce4c75067748ad84434b89f28725b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.510267  8589 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:54.540067  8589 ts_tablet_manager.cc:1403] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.409s	user 0.026s	sys 0.027s
I20260709 12:25:54.540719  8379 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:54.542091  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.543371  8589 raft_consensus.cc:359] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.544190  8589 raft_consensus.cc:385] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.544546  8589 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.548702  8535 tablet_service.cc:1511] Processing CreateTablet for tablet b9ce4c75067748ad84434b89f28725b0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:25:54.548943  8589 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.550024  8535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ce4c75067748ad84434b89f28725b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.532320  8587 ts_tablet_manager.cc:1403] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.196s	user 0.010s	sys 0.003s
I20260709 12:25:54.555076  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 2219cc30a0424600b771d733ba9974e1 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:25:54.556392  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2219cc30a0424600b771d733ba9974e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.556587  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:25:54.557852  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.559463  8386 tablet_service.cc:1511] Processing CreateTablet for tablet f27995e97dd24420a9a7efc50ed48941 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:25:54.560708  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f27995e97dd24420a9a7efc50ed48941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.566846  8589 ts_tablet_manager.cc:1434] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.006s
I20260709 12:25:54.567806  8593 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.568162  8586 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:54.568696  8586 ts_tablet_manager.cc:1403] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.173s	user 0.011s	sys 0.001s
I20260709 12:25:54.568291  8593 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.572389  8460 tablet_service.cc:1511] Processing CreateTablet for tablet c9d00e01c4bf4fa69c5d6648a287de68 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:54.573689  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d00e01c4bf4fa69c5d6648a287de68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.573746  8593 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:54.575059  8536 tablet_service.cc:1511] Processing CreateTablet for tablet c9d00e01c4bf4fa69c5d6648a287de68 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:54.575717  8586 raft_consensus.cc:359] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.576339  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d00e01c4bf4fa69c5d6648a287de68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.576474  8586 raft_consensus.cc:385] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.576818  8586 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.577170  8587 raft_consensus.cc:359] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.578027  8587 raft_consensus.cc:385] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.578478  8587 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.580313  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:25:54.581938  8511 leader_election.cc:343] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.582231  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 016be601898642f5bfd00376e81080bd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:54.583745  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016be601898642f5bfd00376e81080bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.577561  8586 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.586687  8586 ts_tablet_manager.cc:1434] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:25:54.593564  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:54.602914  8397 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:54.603156  8586 tablet_bootstrap.cc:492] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:54.595685  8587 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.600428  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:54.609866  8586 tablet_bootstrap.cc:654] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.610211  8587 ts_tablet_manager.cc:1434] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.057s	user 0.001s	sys 0.005s
I20260709 12:25:54.568041  8589 tablet_bootstrap.cc:492] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:54.601807  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:54.611773  8395 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:54.612290  8587 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:54.619103  8587 tablet_bootstrap.cc:654] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.619794  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:54.620398  8396 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.626086  8396 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:54.626560  8589 tablet_bootstrap.cc:654] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.627928  8379 tablet_service.cc:1511] Processing CreateTablet for tablet c9d00e01c4bf4fa69c5d6648a287de68 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:25:54.628077  8380 tablet_service.cc:1511] Processing CreateTablet for tablet 016be601898642f5bfd00376e81080bd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:54.629294  8379 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d00e01c4bf4fa69c5d6648a287de68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.629930  8380 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016be601898642f5bfd00376e81080bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:54.639248  8362 leader_election.cc:343] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.639765  8362 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:54.644899  8536 tablet_service.cc:1511] Processing CreateTablet for tablet 016be601898642f5bfd00376e81080bd (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:25:54.646209  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016be601898642f5bfd00376e81080bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.648669  8533 tablet_service.cc:1511] Processing CreateTablet for tablet 145eb7997c78480db629215c6acac8ef (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:54.649610  8454 tablet_service.cc:1511] Processing CreateTablet for tablet 145eb7997c78480db629215c6acac8ef (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:54.650010  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145eb7997c78480db629215c6acac8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.650815  8454 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145eb7997c78480db629215c6acac8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.653219  8590 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.653622  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 605e001ede544f519292071c2eeb41fb (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:54.654779  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e001ede544f519292071c2eeb41fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.655448  8512 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:54.656258  8593 raft_consensus.cc:2764] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 12:25:54.656908  8512 leader_election.cc:343] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.657330  8512 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:54.658017  8593 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:54.661339  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 145eb7997c78480db629215c6acac8ef (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:25:54.652513  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 605e001ede544f519292071c2eeb41fb (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:54.662550  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 145eb7997c78480db629215c6acac8ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.662743  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e001ede544f519292071c2eeb41fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.664549  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 605e001ede544f519292071c2eeb41fb (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:25:54.665772  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605e001ede544f519292071c2eeb41fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.670396  8587 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:54.670970  8587 ts_tablet_manager.cc:1403] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.005s
I20260709 12:25:54.673593  8455 tablet_service.cc:1511] Processing CreateTablet for tablet e78864d1ef6947eca56a20b30fc482a6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:54.674803  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78864d1ef6947eca56a20b30fc482a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.673844  8587 raft_consensus.cc:359] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.677167  8587 raft_consensus.cc:385] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.677857  8587 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.678941  8587 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.679198  8531 tablet_service.cc:1511] Processing CreateTablet for tablet e78864d1ef6947eca56a20b30fc482a6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:54.680783  8384 tablet_service.cc:1511] Processing CreateTablet for tablet 2bfca2ec0c4f47349d091a6486b08139 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:54.681522  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78864d1ef6947eca56a20b30fc482a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.681978  8384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bfca2ec0c4f47349d091a6486b08139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.681598  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 225b79a42b074c48a583a96802a0f532 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:54.682844  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225b79a42b074c48a583a96802a0f532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.682654  8460 tablet_service.cc:1511] Processing CreateTablet for tablet 225b79a42b074c48a583a96802a0f532 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:54.679967  8383 tablet_service.cc:1511] Processing CreateTablet for tablet e78864d1ef6947eca56a20b30fc482a6 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:25:54.683827  8460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225b79a42b074c48a583a96802a0f532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.684029  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78864d1ef6947eca56a20b30fc482a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.680753  8530 tablet_service.cc:1511] Processing CreateTablet for tablet 225b79a42b074c48a583a96802a0f532 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:25:54.689000  8530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 225b79a42b074c48a583a96802a0f532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.699012  8587 ts_tablet_manager.cc:1434] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.003s
I20260709 12:25:54.723173  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 2bfca2ec0c4f47349d091a6486b08139 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:54.724464  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bfca2ec0c4f47349d091a6486b08139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.732327  8535 tablet_service.cc:1511] Processing CreateTablet for tablet 2bfca2ec0c4f47349d091a6486b08139 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:25:54.733605  8535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bfca2ec0c4f47349d091a6486b08139. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.732612  8386 tablet_service.cc:1511] Processing CreateTablet for tablet 73c51b6166884e0287dbdff730d29a1f (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:54.740553  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c51b6166884e0287dbdff730d29a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.742391  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 73c51b6166884e0287dbdff730d29a1f (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:54.743664  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c51b6166884e0287dbdff730d29a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.752641  8587 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:54.757231  8294 catalog_manager.cc:5697] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:54.772836  8586 tablet_bootstrap.cc:492] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:54.773327  8586 ts_tablet_manager.cc:1403] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.170s	user 0.022s	sys 0.057s
I20260709 12:25:54.779863  8385 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4ad78594dd4320b4c04e2f4e775e85 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:54.781107  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4ad78594dd4320b4c04e2f4e775e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.782215  8587 tablet_bootstrap.cc:654] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.781889  8586 raft_consensus.cc:359] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.782619  8586 raft_consensus.cc:385] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.782909  8586 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.784204  8586 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.796941  8589 tablet_bootstrap.cc:492] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:54.797443  8589 ts_tablet_manager.cc:1403] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.230s	user 0.022s	sys 0.001s
I20260709 12:25:54.800504  8590 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.800964  8590 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.802649  8589 raft_consensus.cc:359] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.803066  8590 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:54.803393  8589 raft_consensus.cc:385] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.805866  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:54.806404  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:54.806797  8533 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4ad78594dd4320b4c04e2f4e775e85 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:54.807633  8472 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:54.808218  8533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4ad78594dd4320b4c04e2f4e775e85. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:54.808302  8361 leader_election.cc:343] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.808996  8362 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:54.810173  8590 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:54.810551  8590 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.810878  8590 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.806988  8586 ts_tablet_manager.cc:1434] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:25:54.808943  8589 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.813776  8589 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.816627  8589 ts_tablet_manager.cc:1434] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:25:54.817669  8589 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:54.818791  8590 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.820000  8586 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:54.823258  8536 tablet_service.cc:1511] Processing CreateTablet for tablet 73c51b6166884e0287dbdff730d29a1f (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:25:54.830688  8589 tablet_bootstrap.cc:654] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.831391  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73c51b6166884e0287dbdff730d29a1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.831163  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:54.831887  8472 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:54.833590  8590 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:54.834833  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:25:54.836436  8361 leader_election.cc:343] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:54.842212  8381 tablet_service.cc:1511] Processing CreateTablet for tablet 268ce46c10234969b0ee35600bf0a70d (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:54.843617  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268ce46c10234969b0ee35600bf0a70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.846513  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 268ce46c10234969b0ee35600bf0a70d (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:54.847707  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268ce46c10234969b0ee35600bf0a70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.847826  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 268ce46c10234969b0ee35600bf0a70d (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:25:54.849014  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 268ce46c10234969b0ee35600bf0a70d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.849545  8386 tablet_service.cc:1511] Processing CreateTablet for tablet 04e64f31022343538635c1fde40fe9d0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:54.851199  8386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e64f31022343538635c1fde40fe9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.852730  8455 tablet_service.cc:1511] Processing CreateTablet for tablet 04e64f31022343538635c1fde40fe9d0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:54.839547  8456 tablet_service.cc:1511] Processing CreateTablet for tablet 1f4ad78594dd4320b4c04e2f4e775e85 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:25:54.854876  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e64f31022343538635c1fde40fe9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.855458  8456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4ad78594dd4320b4c04e2f4e775e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.859994  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 04e64f31022343538635c1fde40fe9d0 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:25:54.861248  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e64f31022343538635c1fde40fe9d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.861112  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 2310aee96e77479c812917bfcb775d66 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:54.862288  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2310aee96e77479c812917bfcb775d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.874861  8472 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:54.890625  8586 tablet_bootstrap.cc:654] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:54.894789  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 2310aee96e77479c812917bfcb775d66 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:54.891707  8362 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:54.896863  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2310aee96e77479c812917bfcb775d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.898433  8590 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:54.908437  8536 tablet_service.cc:1511] Processing CreateTablet for tablet 2310aee96e77479c812917bfcb775d66 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:25:54.909844  8536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2310aee96e77479c812917bfcb775d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.938935  8590 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:54.949182  8457 tablet_service.cc:1511] Processing CreateTablet for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:54.950062  8457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:54.952564  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:54.953859  8531 tablet_service.cc:1511] Processing CreateTablet for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:54.954998  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.956902  8589 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:54.957350  8589 ts_tablet_manager.cc:1403] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.140s	user 0.017s	sys 0.011s
I20260709 12:25:54.958431  8387 tablet_service.cc:1511] Processing CreateTablet for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:25:54.959641  8387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.960831  8587 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:54.961292  8587 ts_tablet_manager.cc:1403] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.209s	user 0.021s	sys 0.034s
I20260709 12:25:54.957224  8383 tablet_service.cc:1511] Processing CreateTablet for tablet 9d18f5c816314559a3727b41a178ee5c (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:54.966323  8383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d18f5c816314559a3727b41a178ee5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.963330  8589 raft_consensus.cc:359] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.967487  8589 raft_consensus.cc:385] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.967763  8589 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.970212  8589 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.972155  8599 consensus_queue.cc:1048] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:54.976459  8589 ts_tablet_manager.cc:1434] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:25:54.978890  8590 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.980609  8458 tablet_service.cc:1511] Processing CreateTablet for tablet 9d18f5c816314559a3727b41a178ee5c (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:54.985281  8528 tablet_service.cc:1511] Processing CreateTablet for tablet 9d18f5c816314559a3727b41a178ee5c (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:25:54.988539  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d18f5c816314559a3727b41a178ee5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.989279  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d18f5c816314559a3727b41a178ee5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:54.989607  8589 tablet_bootstrap.cc:492] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:54.986291  8587 raft_consensus.cc:359] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:54.990506  8587 raft_consensus.cc:385] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:54.990861  8587 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:54.992836  8586 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:54.996897  8586 ts_tablet_manager.cc:1403] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.177s	user 0.012s	sys 0.008s
I20260709 12:25:54.993551  8381 tablet_service.cc:1511] Processing CreateTablet for tablet a5fade2bf4064a129c23d8bb05ce09c7 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:54.995887  8621 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.998660  8621 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.000962  8621 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.002689  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.004665  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.006107  8599 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.006583  8599 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.008747  8599 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.003350  8546 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:55.023604  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.023392  8586 raft_consensus.cc:359] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.024137  8586 raft_consensus.cc:385] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:55.020750  8362 leader_election.cc:343] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.024194  8455 tablet_service.cc:1511] Processing CreateTablet for tablet a5fade2bf4064a129c23d8bb05ce09c7 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:55.024546  8586 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.025497  8455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fade2bf4064a129c23d8bb05ce09c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.027479  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:55.028671  8621 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.029028  8621 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.029335  8621 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.019946  8599 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.031858  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.031626  8587 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.024230  8546 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:55.033938  8436 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:55.034893  8594 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:55.035640  8438 leader_election.cc:343] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.031839  8599 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.035266  8594 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.037137  8594 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.038300  8599 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.041131  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.041844  8546 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:55.041901  8621 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.043041  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:55.049906  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.050194  8385 tablet_service.cc:1511] Processing CreateTablet for tablet e353e593608d40f283a70e6dab6c4d3a (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:55.051393  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e353e593608d40f283a70e6dab6c4d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.051641  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:55.052057  8528 tablet_service.cc:1511] Processing CreateTablet for tablet a5fade2bf4064a129c23d8bb05ce09c7 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:25:55.053138  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fade2bf4064a129c23d8bb05ce09c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.054132  8381 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5fade2bf4064a129c23d8bb05ce09c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.054980  8599 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.055334  8599 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:55.054711  8362 leader_election.cc:343] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.055723  8599 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.059278  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:55.060037  8546 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.061650  8594 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.076150  8587 ts_tablet_manager.cc:1434] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.115s	user 0.015s	sys 0.006s
I20260709 12:25:55.084213  8587 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:55.078198  8599 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.068951  8621 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.031706  8586 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.110337  8594 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.118270  8586 ts_tablet_manager.cc:1434] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.121s	user 0.016s	sys 0.003s
I20260709 12:25:55.119227  8586 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.120306  8587 tablet_bootstrap.cc:654] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.123652  8589 tablet_bootstrap.cc:654] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.124595  8586 tablet_bootstrap.cc:654] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:55.124529  8281 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 53798.8us
I20260709 12:25:55.131429  8589 tablet_bootstrap.cc:492] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.132192  8589 ts_tablet_manager.cc:1403] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.143s	user 0.005s	sys 0.008s
I20260709 12:25:55.138262  8587 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:55.138800  8587 ts_tablet_manager.cc:1403] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:25:55.142733  8587 raft_consensus.cc:359] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.135459  8589 raft_consensus.cc:359] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.145152  8587 raft_consensus.cc:385] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.145232  8589 raft_consensus.cc:385] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.145473  8587 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.145630  8589 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.146236  8587 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.146481  8589 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.148061  8587 ts_tablet_manager.cc:1434] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:25:55.148726  8589 ts_tablet_manager.cc:1434] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:25:55.149109  8587 tablet_bootstrap.cc:492] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:55.149820  8589 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:55.144802  8586 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.151832  8586 ts_tablet_manager.cc:1403] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.008s
I20260709 12:25:55.155153  8587 tablet_bootstrap.cc:654] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.154806  8586 raft_consensus.cc:359] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.155644  8586 raft_consensus.cc:385] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.156003  8586 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.156596  8589 tablet_bootstrap.cc:654] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.156760  8586 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.159570  8586 ts_tablet_manager.cc:1434] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:25:55.160742  8586 tablet_bootstrap.cc:492] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.164287  8629 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.164783  8629 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.167027  8629 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.167265  8586 tablet_bootstrap.cc:654] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.179797  8586 tablet_bootstrap.cc:492] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.180459  8586 ts_tablet_manager.cc:1403] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:25:55.183508  8586 raft_consensus.cc:359] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.184346  8586 raft_consensus.cc:385] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.184739  8586 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.185685  8586 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.188084  8586 ts_tablet_manager.cc:1434] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:55.189226  8586 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.195771  8586 tablet_bootstrap.cc:654] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.246776  8586 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.247210  8586 ts_tablet_manager.cc:1403] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.002s
I20260709 12:25:55.249320  8586 raft_consensus.cc:359] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.249924  8586 raft_consensus.cc:385] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.250174  8586 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.250761  8586 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.252377  8586 ts_tablet_manager.cc:1434] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:55.253188  8586 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.258121  8586 tablet_bootstrap.cc:654] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.262892  8586 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.263274  8586 ts_tablet_manager.cc:1403] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:25:55.265421  8586 raft_consensus.cc:359] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.266120  8586 raft_consensus.cc:385] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.266374  8586 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.266984  8586 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.268934  8586 ts_tablet_manager.cc:1434] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:55.269779  8586 tablet_bootstrap.cc:492] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.274748  8586 tablet_bootstrap.cc:654] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.279426  8586 tablet_bootstrap.cc:492] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.279870  8586 ts_tablet_manager.cc:1403] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 12:25:55.282164  8586 raft_consensus.cc:359] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.282748  8586 raft_consensus.cc:385] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.282966  8586 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.283612  8586 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.284017  8546 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:55.285372  8586 ts_tablet_manager.cc:1434] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:55.285372  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:55.286278  8586 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.291189  8586 tablet_bootstrap.cc:654] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.296054  8586 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.296455  8586 ts_tablet_manager.cc:1403] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:25:55.298838  8586 raft_consensus.cc:359] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.299500  8586 raft_consensus.cc:385] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.299760  8586 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.300496  8586 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.301054  8589 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.301518  8589 ts_tablet_manager.cc:1403] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.152s	user 0.021s	sys 0.034s
I20260709 12:25:55.302543  8586 ts_tablet_manager.cc:1434] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:55.303484  8586 tablet_bootstrap.cc:492] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.304355  8589 raft_consensus.cc:359] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.305037  8589 raft_consensus.cc:385] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.305302  8589 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.309196  8621 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.309651  8621 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.309860  8586 tablet_bootstrap.cc:654] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.309949  8458 tablet_service.cc:1511] Processing CreateTablet for tablet e353e593608d40f283a70e6dab6c4d3a (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:55.311295  8621 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.311228  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e353e593608d40f283a70e6dab6c4d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.311944  8621 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.312311  8621 raft_consensus.cc:697] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:55.312880  8621 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.314977  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.315459  8472 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:55.316488  8362 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:55.319574  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.319730  8589 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:55.321080  8361 leader_election.cc:343] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.322122  8589 ts_tablet_manager.cc:1434] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:25:55.323261  8589 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:55.323945  8599 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.333359  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.334661  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:55.335289  8545 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:55.338040  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 288510us
I20260709 12:25:55.339112  8589 tablet_bootstrap.cc:654] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.339782  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:55.335160  8590 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.340739  8590 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.341078  8590 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.345074  8589 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.345368  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.346411  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:55.346980  8395 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.348143  8587 tablet_bootstrap.cc:492] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:55.348704  8587 ts_tablet_manager.cc:1403] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.200s	user 0.025s	sys 0.016s
W20260709 12:25:55.349576  8436 leader_election.cc:343] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.350915  8629 consensus_queue.cc:1048] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.351598  8587 raft_consensus.cc:359] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.351858  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:55.352427  8546 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:55.339758  8438 leader_election.cc:343] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:55.355048  8438 leader_election.cc:343] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.360319  8545 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:55.361675  8586 tablet_bootstrap.cc:492] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.364768  8586 ts_tablet_manager.cc:1403] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.016s
I20260709 12:25:55.365466  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:55.365362  8531 tablet_service.cc:1511] Processing CreateTablet for tablet e353e593608d40f283a70e6dab6c4d3a (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:25:55.364933  8293 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.367630  8531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e353e593608d40f283a70e6dab6c4d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.367586  8586 raft_consensus.cc:359] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.368335  8586 raft_consensus.cc:385] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.368597  8586 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.369203  8599 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.369339  8586 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.371466  8586 ts_tablet_manager.cc:1434] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:55.372367  8586 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.370982  8385 tablet_service.cc:1511] Processing CreateTablet for tablet d12c64e413ad46968034a527b5290316 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:55.373318  8458 tablet_service.cc:1511] Processing CreateTablet for tablet d12c64e413ad46968034a527b5290316 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:55.374286  8587 raft_consensus.cc:385] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.345567  8589 ts_tablet_manager.cc:1403] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:25:55.375325  8587 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
W20260709 12:25:55.376461  8361 consensus_peers.cc:597] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:55.377110  8587 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.374305  8458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12c64e413ad46968034a527b5290316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.361764  8590 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.381668  8396 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:55.375005  8385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12c64e413ad46968034a527b5290316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.389904  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:55.364068  8395 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:55.378047  8589 raft_consensus.cc:359] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:55.391299  8361 leader_election.cc:343] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.369692  8599 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:55.392139  8586 tablet_bootstrap.cc:654] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.392370  8599 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.392823  8546 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:55.395601  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:55.396118  8472 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.391309  8589 raft_consensus.cc:385] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.396806  8528 tablet_service.cc:1511] Processing CreateTablet for tablet d12c64e413ad46968034a527b5290316 (DEFAULT_TABLE table=test-workload [id=b639b805973747cc8958558a0e295d8e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:25:55.397924  8528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12c64e413ad46968034a527b5290316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:55.400557  8590 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.401619  8436 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:55.402678  8594 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.403133  8594 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:55.403937  8594 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.397043  8589 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.409592  8589 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.410979  8472 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:55.412145  8593 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.412381  8362 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.412657  8593 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.414117  8438 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.414950  8593 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.414978  8629 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.418134  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.418758  8395 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:55.419348  8589 ts_tablet_manager.cc:1434] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.002s
I20260709 12:25:55.419849  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:55.420487  8589 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:55.420598  8590 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.420876  8593 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.421247  8593 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.421402  8590 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:55.421590  8593 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.423604  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.430917  8472 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:55.438575  8589 tablet_bootstrap.cc:654] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.439754  8590 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.446843  8599 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.447228  8586 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.447785  8586 ts_tablet_manager.cc:1403] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.005s
I20260709 12:25:55.447297  8599 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.430064  8593 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.450510  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.452364  8587 ts_tablet_manager.cc:1434] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260709 12:25:55.450655  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.451015  8599 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.449072  8628 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.450829  8586 raft_consensus.cc:359] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.453612  8586 raft_consensus.cc:385] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.453902  8586 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
W20260709 12:25:55.453904  8436 leader_election.cc:343] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.454975  8586 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:55.455502  8438 leader_election.cc:343] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.455899  8438 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.456962  8586 ts_tablet_manager.cc:1434] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:55.457834  8586 tablet_bootstrap.cc:492] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.461211  8629 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.453365  8587 tablet_bootstrap.cc:492] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:55.461385  8294 catalog_manager.cc:5697] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.463311  8589 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.463762  8589 ts_tablet_manager.cc:1403] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.004s
I20260709 12:25:55.463943  8294 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.467154  8586 tablet_bootstrap.cc:654] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.469776  8589 raft_consensus.cc:359] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.470487  8589 raft_consensus.cc:385] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.470741  8589 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.471493  8589 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.472738  8593 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.473881  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:55.474437  8395 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.475983  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:55.476593  8471 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.489027  8395 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:55.497582  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:55.498521  8593 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.507550  8593 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:55.508579  8593 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.510914  8587 tablet_bootstrap.cc:654] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.490594  8471 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:55.512632  8586 tablet_bootstrap.cc:492] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.513127  8586 ts_tablet_manager.cc:1403] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.001s
I20260709 12:25:55.515828  8586 raft_consensus.cc:359] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.516474  8586 raft_consensus.cc:385] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.516745  8586 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.517521  8586 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.519769  8586 ts_tablet_manager.cc:1434] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:25:55.520699  8586 tablet_bootstrap.cc:492] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.524392  8293 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.526201  8293 catalog_manager.cc:5697] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.527635  8589 ts_tablet_manager.cc:1434] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.017s
I20260709 12:25:55.528544  8589 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:55.533844  8589 tablet_bootstrap.cc:654] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.533314  8295 catalog_manager.cc:5697] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.526196  8586 tablet_bootstrap.cc:654] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.536466  8599 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.536955  8599 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.538951  8599 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.539893  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.540519  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:55.541349  8438 leader_election.cc:343] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:55.541872  8436 leader_election.cc:343] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.542265  8436 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.543501  8599 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.558666  8587 tablet_bootstrap.cc:492] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:55.559139  8587 ts_tablet_manager.cc:1403] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.002s
I20260709 12:25:55.562108  8587 raft_consensus.cc:359] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.562762  8587 raft_consensus.cc:385] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.563040  8587 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.563673  8587 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.565843  8587 ts_tablet_manager.cc:1434] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:55.567780  8587 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:55.572329  8589 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.572759  8589 ts_tablet_manager.cc:1403] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.003s
I20260709 12:25:55.575372  8589 raft_consensus.cc:359] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.575989  8589 raft_consensus.cc:385] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.576254  8589 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.576990  8589 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.579118  8589 ts_tablet_manager.cc:1434] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:55.579981  8589 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:55.582336  8586 tablet_bootstrap.cc:492] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.583223  8586 ts_tablet_manager.cc:1403] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.009s
I20260709 12:25:55.585655  8586 raft_consensus.cc:359] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.586129  8586 raft_consensus.cc:385] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.586284  8586 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.586884  8599 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.586745  8586 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.587301  8599 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.589313  8599 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.590778  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:55.592555  8436 leader_election.cc:343] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.593672  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:55.594965  8438 leader_election.cc:343] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.595371  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.595964  8586 ts_tablet_manager.cc:1434] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:25:55.597919  8586 tablet_bootstrap.cc:492] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.596994  8587 tablet_bootstrap.cc:654] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.596606  8629 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.610152  8586 tablet_bootstrap.cc:654] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.601704  8589 tablet_bootstrap.cc:654] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.615715  8593 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.616256  8593 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.618427  8593 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.620913  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.622443  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.623246  8472 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:55.623818  8629 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.624254  8629 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.625025  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:55.626187  8629 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.626947  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.627544  8395 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:55.627626  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.628706  8438 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:25:55.629460  8436 leader_election.cc:343] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.630342  8629 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.630728  8629 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.631057  8629 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.633754  8586 tablet_bootstrap.cc:492] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.634249  8586 ts_tablet_manager.cc:1403] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.037s	user 0.002s	sys 0.026s
I20260709 12:25:55.635607  8593 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.636534  8628 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.637005  8628 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.638527  8599 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.638974  8599 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.640192  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.641055  8599 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.638994  8628 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:25:55.641558  8361 leader_election.cc:343] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.642565  8587 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:55.643023  8587 ts_tablet_manager.cc:1403] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.004s
I20260709 12:25:55.643136  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.643870  8546 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:55.645682  8587 raft_consensus.cc:359] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.646356  8587 raft_consensus.cc:385] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.646416  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.646657  8587 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
W20260709 12:25:55.647857  8362 leader_election.cc:343] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.648267  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.648824  8593 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.649307  8628 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.649927  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.651047  8629 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.651791  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.654047  8594 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.655628  8599 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.656105  8599 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.658150  8599 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.659868  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.661041  8594 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.661366  8593 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.653395  8586 raft_consensus.cc:359] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.662039  8586 raft_consensus.cc:385] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.661854  8593 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.662374  8586 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
W20260709 12:25:55.662781  8436 leader_election.cc:343] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.664357  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:55.665745  8438 leader_election.cc:343] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.666337  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.667387  8594 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.668524  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.669251  8593 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.669448  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.669997  8587 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:55.670785  8511 leader_election.cc:343] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:55.671988  8512 leader_election.cc:343] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.672384  8512 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:55.673056  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:55.673426  8593 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:55.674392  8436 leader_election.cc:343] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.675273  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:55.676060  8395 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.663281  8586 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.680539  8586 ts_tablet_manager.cc:1434] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 12:25:55.681748  8586 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.687208  8586 tablet_bootstrap.cc:654] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.692994  8395 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:55.696995  8438 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.697875  8594 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.697929  8628 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.698453  8594 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:55.699265  8594 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.706075  8586 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.707737  8586 ts_tablet_manager.cc:1403] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.004s
I20260709 12:25:55.710815  8586 raft_consensus.cc:359] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.714900  8586 raft_consensus.cc:385] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.715253  8586 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.715972  8629 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.716068  8586 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.717847  8587 ts_tablet_manager.cc:1434] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.004s
I20260709 12:25:55.718295  8586 ts_tablet_manager.cc:1434] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:25:55.719360  8586 tablet_bootstrap.cc:492] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.725039  8586 tablet_bootstrap.cc:654] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.727432  8629 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.727948  8629 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.729961  8587 tablet_bootstrap.cc:492] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:55.735499  8586 tablet_bootstrap.cc:492] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.736060  8586 ts_tablet_manager.cc:1403] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 12:25:55.738709  8629 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.740378  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.741469  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:55.741801  8438 leader_election.cc:343] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.741667  8586 raft_consensus.cc:359] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.742513  8586 raft_consensus.cc:385] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:55.742769  8436 leader_election.cc:343] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.742834  8586 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.743259  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.744009  8629 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.743899  8590 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:55.743853  8586 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.746039  8586 ts_tablet_manager.cc:1434] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.004s
I20260709 12:25:55.746325  8589 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.746779  8589 ts_tablet_manager.cc:1403] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.167s	user 0.072s	sys 0.056s
I20260709 12:25:55.747092  8654 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.747864  8654 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.749955  8654 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.750260  8589 raft_consensus.cc:359] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.750891  8589 raft_consensus.cc:385] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.751160  8589 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.751833  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.752425  8471 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:55.752545  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.751809  8589 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.754770  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:55.755024  8589 ts_tablet_manager.cc:1434] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:25:55.755831  8593 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.755913  8589 tablet_bootstrap.cc:492] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
W20260709 12:25:55.755986  8512 leader_election.cc:343] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.756283  8593 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.756672  8593 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.761031  8654 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.761574  8589 tablet_bootstrap.cc:654] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.761469  8654 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.764206  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.765512  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.766268  8654 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.766788  8511 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:55.767637  8654 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.768698  8593 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.769191  8586 tablet_bootstrap.cc:492] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.771733  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:55.772372  8589 tablet_bootstrap.cc:492] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.772779  8589 ts_tablet_manager.cc:1403] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
W20260709 12:25:55.773054  8512 leader_election.cc:343] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.775622  8586 tablet_bootstrap.cc:654] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.775324  8589 raft_consensus.cc:359] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.776014  8589 raft_consensus.cc:385] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.776194  8587 tablet_bootstrap.cc:654] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.776299  8589 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.777209  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:55.777050  8589 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.779347  8589 ts_tablet_manager.cc:1434] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:25:55.780334  8589 tablet_bootstrap.cc:492] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:55.779382  8295 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:55.784204  8587 tablet_bootstrap.cc:492] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:55.784614  8587 ts_tablet_manager.cc:1403] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.000s
I20260709 12:25:55.786091  8593 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.777772  8472 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.787082  8587 raft_consensus.cc:359] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.787722  8587 raft_consensus.cc:385] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.787981  8587 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.788838  8587 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.792249  8589 tablet_bootstrap.cc:654] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.794782  8472 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:55.796018  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:55.796633  8593 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.797124  8593 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:55.797829  8593 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.805522  8629 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.806099  8629 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.808144  8629 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.809470  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:55.810909  8438 leader_election.cc:343] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.810331  8292 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.811769  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.812359  8546 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:55.813541  8587 ts_tablet_manager.cc:1434] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:25:55.813678  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:55.814870  8629 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.815274  8629 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.815514  8586 tablet_bootstrap.cc:492] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.815757  8629 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.815968  8586 ts_tablet_manager.cc:1403] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.001s
I20260709 12:25:55.818723  8586 raft_consensus.cc:359] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.819360  8586 raft_consensus.cc:385] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.819648  8586 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.820938  8586 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.822947  8629 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.825168  8629 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.825222  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:55.825376  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:55.825896  8546 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:55.826968  8438 leader_election.cc:343] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.827613  8586 ts_tablet_manager.cc:1434] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:25:55.828585  8586 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:55.832180  8546 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:55.833396  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:55.834038  8590 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.835397  8629 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.836031  8629 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:55.837455  8654 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.837898  8654 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.839296  8545 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.839848  8654 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:55.841156  8587 tablet_bootstrap.cc:492] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:55.842068  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.844354  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.845074  8395 raft_consensus.cc:2393] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:25:55.846382  8512 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:55.847675  8654 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.851182  8586 tablet_bootstrap.cc:654] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.853691  8654 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.854318  8587 tablet_bootstrap.cc:654] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.858498  8629 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.859840  8586 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:55.860268  8586 ts_tablet_manager.cc:1403] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.001s
I20260709 12:25:55.862823  8586 raft_consensus.cc:359] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.863458  8586 raft_consensus.cc:385] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.863735  8586 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.864494  8589 tablet_bootstrap.cc:492] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.864905  8589 ts_tablet_manager.cc:1403] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.039s
I20260709 12:25:55.866273  8587 tablet_bootstrap.cc:492] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:55.866902  8587 ts_tablet_manager.cc:1403] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.006s
I20260709 12:25:55.869531  8587 raft_consensus.cc:359] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.870131  8587 raft_consensus.cc:385] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.870395  8587 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.871112  8586 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.871307  8589 raft_consensus.cc:359] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.876148  8594 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.872228  8630 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.878461  8594 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.878610  8630 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.871616  8621 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:25:55.880614  8589 raft_consensus.cc:385] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.880537  8594 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.880523  8630 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.881098  8589 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.881821  8599 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.882393  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.883697  8586 ts_tablet_manager.cc:1434] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:25:55.884038  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.884639  8586 tablet_bootstrap.cc:492] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
W20260709 12:25:55.886062  8438 leader_election.cc:343] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:55.886673  8438 leader_election.cc:343] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.888271  8587 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.888666  8589 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.891747  8589 ts_tablet_manager.cc:1434] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.004s
I20260709 12:25:55.893528  8587 ts_tablet_manager.cc:1434] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.005s
I20260709 12:25:55.893975  8589 tablet_bootstrap.cc:492] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:55.894399  8587 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:55.895502  8621 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.895951  8621 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.897979  8621 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.900180  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.902909  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.903703  8545 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 1: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:25:55.904394  8654 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.904899  8361 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.906032  8621 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.910377  8587 tablet_bootstrap.cc:654] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.913453  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.914176  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.922335  8586 tablet_bootstrap.cc:654] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.919394  8590 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.927718  8590 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.929766  8590 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.930461  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:55.931049  8472 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:55.931192  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.931777  8545 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:55.932260  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:55.933071  8590 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:55.933391  8590 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.933687  8590 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:55.934141  8589 tablet_bootstrap.cc:654] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:55.914202  8679 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:25:55.938783  8292 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:55.941010  8436 leader_election.cc:343] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.941459  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:25:55.942530  8436 leader_election.cc:343] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.943005  8679 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.947108  8629 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.947726  8589 tablet_bootstrap.cc:492] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:55.947625  8629 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.948192  8589 ts_tablet_manager.cc:1403] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.003s
I20260709 12:25:55.949414  8629 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.950384  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:55.953291  8438 leader_election.cc:343] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.954370  8621 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.956597  8590 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.964303  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:55.964955  8471 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:55.967284  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:55.951496  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.973135  8589 raft_consensus.cc:359] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.973827  8589 raft_consensus.cc:385] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:55.974123  8589 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:55.974781  8589 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.980360  8589 ts_tablet_manager.cc:1434] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.004s
I20260709 12:25:55.972429  8593 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:25:55.973181  8679 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.983078  8679 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.983569  8679 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.984602  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:55.985648  8679 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.985917  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:55.986474  8546 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:55.986519  8436 leader_election.cc:343] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.986994  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:55.973239  8471 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:55.990551  8629 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:55.991369  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:55.993482  8436 leader_election.cc:343] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:55.993778  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:55.972895  8590 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:55.994702  8590 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:55.994793  8629 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:55.995169  8590 raft_consensus.cc:697] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:55.995985  8590 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:55.999657  8589 tablet_bootstrap.cc:492] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.002275  8546 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:56.002372  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:55.999455  8599 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:25:56.010423  8589 tablet_bootstrap.cc:654] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.016265  8586 tablet_bootstrap.cc:492] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:56.016762  8586 ts_tablet_manager.cc:1403] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.013s
W20260709 12:25:56.017755  8438 leader_election.cc:343] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.018186  8438 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.019197  8599 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.019389  8586 raft_consensus.cc:359] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.020208  8586 raft_consensus.cc:385] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.020510  8586 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.021217  8586 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.023483  8586 ts_tablet_manager.cc:1434] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:56.024715  8586 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:56.030203  8586 tablet_bootstrap.cc:654] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.046114  8587 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:56.046561  8587 ts_tablet_manager.cc:1403] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.018s
I20260709 12:25:56.049073  8587 raft_consensus.cc:359] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.049721  8587 raft_consensus.cc:385] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.049997  8587 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.050652  8587 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.052830  8587 ts_tablet_manager.cc:1434] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 12:25:56.052927  8586 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:56.053546  8586 ts_tablet_manager.cc:1403] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.007s
I20260709 12:25:56.053784  8587 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:56.056241  8586 raft_consensus.cc:359] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.057032  8586 raft_consensus.cc:385] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.057344  8586 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.058192  8586 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.059644  8587 tablet_bootstrap.cc:654] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.060876  8621 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.061331  8621 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.065532  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.063282  8621 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.068107  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.068930  8472 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 1: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:25:56.070076  8362 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.070422  8587 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:56.071321  8621 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.071602  8587 ts_tablet_manager.cc:1403] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.012s
I20260709 12:25:56.074149  8587 raft_consensus.cc:359] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.074734  8587 raft_consensus.cc:385] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.074982  8587 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.077975  8589 tablet_bootstrap.cc:492] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.078428  8589 ts_tablet_manager.cc:1403] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.097s	user 0.021s	sys 0.010s
I20260709 12:25:56.081044  8589 raft_consensus.cc:359] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.081655  8589 raft_consensus.cc:385] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.075606  8587 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.081786  8621 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.083375  8586 ts_tablet_manager.cc:1434] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:25:56.083729  8587 ts_tablet_manager.cc:1434] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:25:56.083978  8589 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.085139  8586 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:56.085605  8589 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.085147  8587 tablet_bootstrap.cc:492] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:56.087534  8589 ts_tablet_manager.cc:1434] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:25:56.088554  8589 tablet_bootstrap.cc:492] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.090391  8586 tablet_bootstrap.cc:654] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.094151  8587 tablet_bootstrap.cc:654] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.094988  8589 tablet_bootstrap.cc:654] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.103016  8589 tablet_bootstrap.cc:492] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.103488  8589 ts_tablet_manager.cc:1403] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:25:56.104871  8295 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.105911  8589 raft_consensus.cc:359] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.106525  8589 raft_consensus.cc:385] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.106772  8589 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.108601  8589 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.109822  8587 tablet_bootstrap.cc:492] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:56.110332  8587 ts_tablet_manager.cc:1403] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.012s
I20260709 12:25:56.110754  8589 ts_tablet_manager.cc:1434] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:25:56.111665  8589 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.113193  8587 raft_consensus.cc:359] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.117110  8589 tablet_bootstrap.cc:654] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.113915  8587 raft_consensus.cc:385] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.119084  8594 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.119699  8594 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.121852  8594 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.123049  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.123553  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:56.124562  8436 leader_election.cc:343] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:56.125099  8438 leader_election.cc:343] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.125550  8438 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.126665  8594 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.127492  8587 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.128397  8587 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.129320  8589 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.129742  8589 ts_tablet_manager.cc:1403] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:25:56.130951  8587 ts_tablet_manager.cc:1434] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.003s
I20260709 12:25:56.132063  8587 tablet_bootstrap.cc:492] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:56.132257  8589 raft_consensus.cc:359] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.133064  8589 raft_consensus.cc:385] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.133328  8589 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.134039  8589 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.136230  8589 ts_tablet_manager.cc:1434] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:56.137132  8589 tablet_bootstrap.cc:492] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.138895  8587 tablet_bootstrap.cc:654] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.142513  8589 tablet_bootstrap.cc:654] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.148239  8594 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.148751  8594 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.150893  8594 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.152830  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.152976  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:56.153545  8545 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:56.153649  8396 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:56.154964  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:56.160697  8594 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.161087  8594 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.161302  8629 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.161885  8629 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.164062  8629 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.165791  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.166445  8545 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:56.161412  8594 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.171742  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:56.174180  8438 leader_election.cc:343] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.174791  8436 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:56.175550  8629 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.175946  8629 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.176555  8629 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.181524  8594 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.182723  8629 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.184271  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:56.184896  8396 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.189069  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:56.189584  8590 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.190323  8594 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.190956  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:56.190073  8590 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:56.192765  8438 leader_election.cc:343] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.193274  8590 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.194137  8594 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.194474  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:56.195083  8546 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.195685  8629 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.199859  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.200523  8472 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:56.189615  8545 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.202025  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.203456  8362 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:25:56.204059  8361 leader_election.cc:343] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.204452  8628 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.204798  8628 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.210193  8589 tablet_bootstrap.cc:492] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.210832  8589 ts_tablet_manager.cc:1403] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.011s
W20260709 12:25:56.207799  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08001e92e0 after lost signal to thread 7264
I20260709 12:25:56.206439  8628 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:56.213128  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800196f80 after lost signal to thread 8329
W20260709 12:25:56.216229  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000c19e0 after lost signal to thread 8421
W20260709 12:25:56.217172  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa380 after lost signal to thread 8496
I20260709 12:25:56.218959  8545 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:56.220253  8587 tablet_bootstrap.cc:492] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:56.220438  8436 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:56.220700  8587 ts_tablet_manager.cc:1403] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.007s
I20260709 12:25:56.220738  8546 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:56.221544  8629 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.222023  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:56.223161  8599 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.223662  8599 raft_consensus.cc:697] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:25:56.224169  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000bf620 after lost signal to thread 8570
I20260709 12:25:56.224102  8628 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.224440  8599 consensus_queue.cc:237] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.225360  8589 raft_consensus.cc:359] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.225966  8589 raft_consensus.cc:385] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.226233  8589 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.226836  8589 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.227308  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:56.223207  8587 raft_consensus.cc:359] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.228212  8587 raft_consensus.cc:385] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.228478  8587 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.228583  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:25:56.228752  8361 leader_election.cc:343] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.229164  8472 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.227530  8628 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.229811  8396 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:56.233114  8589 ts_tablet_manager.cc:1434] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:25:56.233966  8589 tablet_bootstrap.cc:492] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.234555  8586 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:56.234987  8586 ts_tablet_manager.cc:1403] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.150s	user 0.052s	sys 0.071s
I20260709 12:25:56.236848  8587 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.238277  8594 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.238835  8587 ts_tablet_manager.cc:1434] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 12:25:56.235685  8629 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:56.240947  8629 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.244439  8587 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:56.250718  8589 tablet_bootstrap.cc:654] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.263474  8472 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:56.264837  8362 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.266281  8586 raft_consensus.cc:359] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.267045  8700 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.267158  8586 raft_consensus.cc:385] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.267475  8586 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.267546  8700 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:56.269148  8700 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.268127  8586 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.275116  8586 ts_tablet_manager.cc:1434] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 12:25:56.276645  8586 tablet_bootstrap.cc:492] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:56.279788  8593 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.280283  8593 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.282404  8593 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.283588  8629 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.284075  8629 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.286247  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.286921  8472 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:56.287810  8589 tablet_bootstrap.cc:492] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.288231  8589 ts_tablet_manager.cc:1403] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.003s
I20260709 12:25:56.288257  8511 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:56.289309  8593 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.289706  8593 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.290062  8593 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.290895  8589 raft_consensus.cc:359] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.291512  8589 raft_consensus.cc:385] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.291772  8589 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.292373  8589 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.295125  8589 ts_tablet_manager.cc:1434] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:56.295768  8629 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.296037  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:56.297284  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:56.299095  8512 leader_election.cc:343] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:56.299360  8438 leader_election.cc:343] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.281463  8293 catalog_manager.cc:5697] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.306411  8593 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.309072  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:25:56.310616  8512 leader_election.cc:343] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.311579  8593 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.296033  8589 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.314630  8587 tablet_bootstrap.cc:654] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.318941  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.321678  8586 tablet_bootstrap.cc:654] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:56.322878  8436 leader_election.cc:343] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.323330  8436 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.324373  8629 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.328750  8295 catalog_manager.cc:5697] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.329787  8589 tablet_bootstrap.cc:654] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.334527  8587 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:56.335001  8587 ts_tablet_manager.cc:1403] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.095s	user 0.004s	sys 0.013s
I20260709 12:25:56.337100  8593 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.337601  8593 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.339820  8593 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.341055  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:56.341668  8472 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.348407  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:56.349146  8396 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:56.350540  8512 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:56.351502  8593 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.351780  8293 catalog_manager.cc:5697] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.353392  8593 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.353933  8593 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.352691  8587 raft_consensus.cc:359] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.355629  8587 raft_consensus.cc:385] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.355983  8587 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.356985  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.357590  8471 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:56.357669  8587 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.368268  8629 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.383502  8587 ts_tablet_manager.cc:1434] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:25:56.385141  8587 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:56.380155  8472 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:56.387948  8395 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.393335  8511 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:56.397828  8654 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.398861  8654 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.399255  8654 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:56.400029  8654 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.415246  8700 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.415850  8700 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.421211  8700 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.426539  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.429639  8586 tablet_bootstrap.cc:492] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:56.430092  8586 ts_tablet_manager.cc:1403] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.154s	user 0.016s	sys 0.034s
I20260709 12:25:56.432673  8586 raft_consensus.cc:359] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.433350  8586 raft_consensus.cc:385] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.433607  8586 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.434268  8586 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.439288  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.440744  8700 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.443986  8700 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.444365  8589 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.444967  8589 ts_tablet_manager.cc:1403] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.149s	user 0.061s	sys 0.046s
I20260709 12:25:56.446760  8586 ts_tablet_manager.cc:1434] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:25:56.446552  8362 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.445991  8599 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:56.449870  8621 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:56.450978  8700 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.451972  8586 tablet_bootstrap.cc:492] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:56.452674  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.455813  8471 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:56.458175  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.459901  8362 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:56.460762  8700 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.461130  8700 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.461448  8700 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:56.473292  8361 leader_election.cc:343] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.464670  8593 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.476051  8587 tablet_bootstrap.cc:654] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.476315  8593 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.477032  8711 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.477463  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:56.477578  8712 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 12:25:56.478147  8471 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.477495  8711 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.482331  8711 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.484586  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.485293  8470 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:56.490063  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:56.497525  8589 raft_consensus.cc:359] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.497900  8471 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:56.498251  8589 raft_consensus.cc:385] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.498592  8589 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.499308  8511 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:56.499225  8589 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.500176  8654 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.500641  8654 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:56.501397  8654 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.508124  8589 ts_tablet_manager.cc:1434] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.063s	user 0.012s	sys 0.000s
I20260709 12:25:56.510691  8621 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.506793  8711 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.533123  8700 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.535480  8700 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:25:56.522982  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 83912.7us
I20260709 12:25:56.527279  8711 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.540002  8589 tablet_bootstrap.cc:492] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.540493  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:56.540985  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:56.541366  8472 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.542176  8586 tablet_bootstrap.cc:654] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:56.542250  8361 leader_election.cc:343] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.555747  8715 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.556318  8715 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.538607  8711 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.564635  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:56.575165  8295 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:56.583091  8512 leader_election.cc:343] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.584072  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:56.589689  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:56.595031  8654 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.595333  8396 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.590497  8715 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.589206  8472 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:56.595621  8654 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.599757  8587 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:56.600108  8587 ts_tablet_manager.cc:1403] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.001s
I20260709 12:25:56.596748  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.606217  8362 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.607713  8469 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:56.612469  8700 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.616217  8700 raft_consensus.cc:697] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:56.617053  8700 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.626255  8587 raft_consensus.cc:359] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.626816  8587 raft_consensus.cc:385] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.627022  8587 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.631166  8587 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.634291  8587 ts_tablet_manager.cc:1434] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:25:56.635221  8593 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.635712  8593 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.638043  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:56.638058  8593 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.639820  8593 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.639966  8396 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:56.641494  8711 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.643361  8711 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.643570  8293 catalog_manager.cc:5697] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.645637  8599 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.647289  8587 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:56.647328  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:56.648236  8469 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.652971  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.653702  8471 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:56.662217  8511 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:56.663131  8711 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.663560  8711 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.663885  8711 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.664637  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:56.666606  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:25:56.666705  8512 leader_election.cc:343] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.667479  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:56.668493  8512 leader_election.cc:343] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.669119  8654 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.669922  8700 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.673103  8593 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:56.669135  8512 leader_election.cc:343] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.675288  8711 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:56.662093  8718 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:56.678532  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.679219  8471 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:56.686196  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:56.685701  8295 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:56.693554  8711 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:25:56.694295  8512 leader_election.cc:343] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.696226  8469 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:56.700081  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:56.701131  8593 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.701489  8593 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.701833  8593 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.702111  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:56.702992  8654 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.703483  8654 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:56.704282  8654 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.708912  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:56.709478  8469 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.714568  8587 tablet_bootstrap.cc:654] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.714493  8593 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.715010  8589 tablet_bootstrap.cc:654] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.717684  8586 tablet_bootstrap.cc:492] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:56.718133  8586 ts_tablet_manager.cc:1403] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.269s	user 0.016s	sys 0.019s
I20260709 12:25:56.719724  8628 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.720281  8628 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.727903  8628 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.728668  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.730199  8586 raft_consensus.cc:359] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.730831  8586 raft_consensus.cc:385] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.731063  8586 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.731114  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:56.733289  8586 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.735368  8586 ts_tablet_manager.cc:1434] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:25:56.736080  8593 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:56.738669  8293 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.740978  8395 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.725113  8469 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:56.743386  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:56.748152  8586 tablet_bootstrap.cc:492] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
W20260709 12:25:56.748742  8512 leader_election.cc:343] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.743634  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:56.747195  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.749402  8471 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.753439  8511 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:56.756232  8589 tablet_bootstrap.cc:492] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.756731  8589 ts_tablet_manager.cc:1403] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.217s	user 0.036s	sys 0.031s
I20260709 12:25:56.759205  8589 raft_consensus.cc:359] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.759848  8589 raft_consensus.cc:385] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.760141  8589 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.760665  8589 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.756176  8593 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.762697  8589 ts_tablet_manager.cc:1434] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:56.764043  8593 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:56.764302  8589 tablet_bootstrap.cc:492] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.764954  8593 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.766325  8628 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.771392  8630 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.772578  8589 tablet_bootstrap.cc:654] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.776577  8587 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:56.777062  8587 ts_tablet_manager.cc:1403] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.018s
I20260709 12:25:56.778817  8471 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:56.779683  8587 raft_consensus.cc:359] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.781391  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:56.782243  8586 tablet_bootstrap.cc:654] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.786155  8587 raft_consensus.cc:385] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.786525  8587 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.787210  8587 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.801059  8679 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.801533  8679 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.805738  8587 ts_tablet_manager.cc:1434] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:25:56.805073  8654 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.807144  8654 raft_consensus.cc:697] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:56.808218  8679 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.808034  8654 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.812238  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:56.813616  8436 leader_election.cc:343] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.814673  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:56.818526  8700 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.824208  8587 tablet_bootstrap.cc:492] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
W20260709 12:25:56.822324  8438 leader_election.cc:343] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.824842  8679 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:56.825395  8438 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.826404  8679 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:56.827178  8679 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.844187  8589 tablet_bootstrap.cc:492] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.844653  8589 ts_tablet_manager.cc:1403] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.081s	user 0.045s	sys 0.024s
I20260709 12:25:56.849237  8589 raft_consensus.cc:359] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.849936  8589 raft_consensus.cc:385] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.850209  8589 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.850845  8589 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.852406  8589 ts_tablet_manager.cc:1434] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:56.853112  8589 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.856717  8586 tablet_bootstrap.cc:492] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:56.857122  8586 ts_tablet_manager.cc:1403] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.115s	user 0.009s	sys 0.011s
I20260709 12:25:56.861595  8587 tablet_bootstrap.cc:654] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.861159  8293 catalog_manager.cc:5697] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:56.864707  8628 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.900555  8628 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.906498  8628 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.907615  8589 tablet_bootstrap.cc:654] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.910032  8586 raft_consensus.cc:359] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.910785  8586 raft_consensus.cc:385] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.911098  8586 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.911892  8586 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.913897  8586 ts_tablet_manager.cc:1434] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.057s	user 0.016s	sys 0.012s
I20260709 12:25:56.914798  8586 tablet_bootstrap.cc:492] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:56.915604  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:56.916231  8469 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:56.917402  8362 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:56.910144  8628 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.918193  8700 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:56.918606  8700 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.918931  8700 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.919176  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:56.920578  8361 leader_election.cc:343] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.925444  8586 tablet_bootstrap.cc:654] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:56.932548  8589 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:56.935266  8700 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.936576  8589 ts_tablet_manager.cc:1403] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.008s
I20260709 12:25:56.939224  8589 raft_consensus.cc:359] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:56.939538  8700 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:56.942713  8589 raft_consensus.cc:385] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:56.943547  8589 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:56.947165  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:56.952131  8471 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:56.956365  8593 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:56.956456  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:56.945947  8589 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:56.961279  8361 leader_election.cc:343] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:56.979024  8593 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:56.989398  8589 ts_tablet_manager.cc:1434] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.000s
I20260709 12:25:56.990501  8589 tablet_bootstrap.cc:492] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:56.991503  8471 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:56.992913  8362 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:56.993971  8700 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:56.994474  8700 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:56.995353  8700 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:57.000216  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:25:57.001811  8512 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.004957  8587 tablet_bootstrap.cc:492] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.006549  8587 ts_tablet_manager.cc:1403] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.183s	user 0.032s	sys 0.022s
I20260709 12:25:57.014005  8593 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.013589  8295 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:57.015790  8544 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.025239  8590 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.027166  8590 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.013465  8587 raft_consensus.cc:359] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.028743  8587 raft_consensus.cc:385] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.031455  8587 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.033111  8587 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.038374  8587 ts_tablet_manager.cc:1434] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:25:57.041363  8587 tablet_bootstrap.cc:492] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.035274  8586 tablet_bootstrap.cc:492] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.045274  8586 ts_tablet_manager.cc:1403] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.131s	user 0.008s	sys 0.008s
I20260709 12:25:57.047878  8586 raft_consensus.cc:359] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.048588  8586 raft_consensus.cc:385] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.051769  8586 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.052977  8586 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.054661  8586 ts_tablet_manager.cc:1434] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:25:57.005560  8589 tablet_bootstrap.cc:654] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.061298  8293 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.062685  8587 tablet_bootstrap.cc:654] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.066929  8586 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.073711  8586 tablet_bootstrap.cc:654] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.083853  8586 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.084277  8586 ts_tablet_manager.cc:1403] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:25:57.086781  8587 tablet_bootstrap.cc:492] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.087218  8587 ts_tablet_manager.cc:1403] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.001s
I20260709 12:25:57.089650  8587 raft_consensus.cc:359] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.090276  8587 raft_consensus.cc:385] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.090534  8587 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.091216  8587 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.095809  8587 ts_tablet_manager.cc:1434] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:25:57.096318  8700 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.096777  8700 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.098690  8700 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.100880  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.101518  8544 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:57.102671  8361 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.103443  8700 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.103852  8700 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.104166  8700 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.096089  8586 raft_consensus.cc:359] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.108071  8586 raft_consensus.cc:385] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.108357  8586 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.108990  8586 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:57.110131  8743 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:57.110357  8700 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.112144  8587 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.112792  8586 ts_tablet_manager.cc:1434] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:25:57.113638  8586 tablet_bootstrap.cc:492] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.117542  8587 tablet_bootstrap.cc:654] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.118901  8586 tablet_bootstrap.cc:654] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.119875  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.120464  8470 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:57.121295  8589 tablet_bootstrap.cc:492] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.121773  8589 ts_tablet_manager.cc:1403] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.132s	user 0.009s	sys 0.001s
I20260709 12:25:57.123931  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:57.124477  8544 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.125020  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:57.125551  8470 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.127841  8700 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.130753  8544 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:57.131937  8361 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.132786  8700 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.134014  8700 raft_consensus.cc:697] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:57.134433  8589 raft_consensus.cc:359] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.134662  8470 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:57.135115  8589 raft_consensus.cc:385] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.134781  8700 consensus_queue.cc:237] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.135430  8589 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.136128  8589 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.140527  8589 ts_tablet_manager.cc:1434] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:25:57.141453  8589 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:57.143777  8711 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.148797  8587 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.149227  8587 ts_tablet_manager.cc:1403] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.037s	user 0.002s	sys 0.010s
I20260709 12:25:57.151751  8587 raft_consensus.cc:359] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.152360  8587 raft_consensus.cc:385] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.152621  8587 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.153254  8587 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.155476  8587 ts_tablet_manager.cc:1434] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:25:57.156418  8587 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.153679  8589 tablet_bootstrap.cc:654] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.159691  8711 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.168210  8295 catalog_manager.cc:5697] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.169581  8586 tablet_bootstrap.cc:492] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.170037  8586 ts_tablet_manager.cc:1403] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.010s
I20260709 12:25:57.172188  8587 tablet_bootstrap.cc:654] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.179559  8711 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.179665  8599 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.180150  8711 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.180207  8599 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.183094  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:57.184558  8512 leader_election.cc:343] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.188191  8711 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:57.189709  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.190438  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.191030  8544 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:57.191951  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.192339  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.193109  8679 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:25:57.191059  8511 leader_election.cc:343] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:57.193377  8438 leader_election.cc:343] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.193552  8679 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.193639  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:57.193909  8679 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.194149  8599 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.194800  8711 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.200361  8586 raft_consensus.cc:359] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.201031  8586 raft_consensus.cc:385] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.200708  8679 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.201331  8586 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.202276  8586 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.216173  8586 ts_tablet_manager.cc:1434] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:25:57.220188  8586 tablet_bootstrap.cc:492] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.220803  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:57.221331  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:57.222223  8679 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:25:57.222437  8438 leader_election.cc:343] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.222477  8544 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.227140  8586 tablet_bootstrap.cc:654] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.228531  8679 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.237972  8587 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.239003  8587 ts_tablet_manager.cc:1403] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.083s	user 0.007s	sys 0.023s
I20260709 12:25:57.243269  8397 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.246256  8544 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:57.247471  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:57.247686  8700 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.248247  8589 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.248145  8700 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.248495  8630 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.248690  8589 ts_tablet_manager.cc:1403] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.001s
I20260709 12:25:57.248939  8630 raft_consensus.cc:697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:57.250001  8700 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.249704  8630 consensus_queue.cc:237] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.239380  8679 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.252799  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.253145  8679 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.253515  8471 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 1: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:25:57.253909  8587 raft_consensus.cc:359] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.254539  8587 raft_consensus.cc:385] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.254779  8587 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.255152  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.255671  8587 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.256225  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:57.256881  8436 leader_election.cc:343] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.257658  8587 ts_tablet_manager.cc:1434] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
W20260709 12:25:57.259037  8438 leader_election.cc:343] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.259481  8438 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.260020  8587 tablet_bootstrap.cc:492] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.260505  8599 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.251145  8589 raft_consensus.cc:359] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.263181  8589 raft_consensus.cc:385] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.263468  8589 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.264079  8589 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:57.274251  8512 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:57.276535  8587 tablet_bootstrap.cc:654] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.277189  8589 ts_tablet_manager.cc:1434] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:25:57.277410  8590 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.278457  8590 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.278965  8589 tablet_bootstrap.cc:492] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:57.283314  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.285069  8590 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.286118  8716 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.287524  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.288311  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.288553  8628 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.289605  8628 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.291077  8587 tablet_bootstrap.cc:492] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.291553  8587 ts_tablet_manager.cc:1403] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:25:57.292423  8628 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.292619  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.293991  8587 raft_consensus.cc:359] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.294620  8587 raft_consensus.cc:385] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.294884  8587 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.295512  8587 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:57.297341  8361 leader_election.cc:343] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.298056  8361 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.303992  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.304317  8587 ts_tablet_manager.cc:1434] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:25:57.304674  8470 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:57.305263  8587 tablet_bootstrap.cc:492] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.306075  8362 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.307571  8362 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.309394  8628 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:57.310041  8628 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.310356  8628 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.310660  8628 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.310918  8587 tablet_bootstrap.cc:654] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.312917  8586 tablet_bootstrap.cc:492] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.313371  8700 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.318043  8628 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.319475  8700 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.313365  8586 ts_tablet_manager.cc:1403] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.094s	user 0.037s	sys 0.021s
I20260709 12:25:57.321164  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:25:57.322443  8361 leader_election.cc:343] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.322535  8586 raft_consensus.cc:359] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.323159  8586 raft_consensus.cc:385] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.323732  8586 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.324695  8586 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.326560  8586 ts_tablet_manager.cc:1434] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:25:57.327491  8586 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.330796  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:57.331383  8470 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.333575  8586 tablet_bootstrap.cc:654] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.337729  8470 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:57.341023  8589 tablet_bootstrap.cc:654] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.341493  8362 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.342331  8700 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.342805  8700 raft_consensus.cc:697] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:57.343773  8700 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.344286  8586 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.344704  8586 ts_tablet_manager.cc:1403] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 12:25:57.347185  8586 raft_consensus.cc:359] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.347839  8586 raft_consensus.cc:385] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.348093  8586 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.348690  8587 tablet_bootstrap.cc:492] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.349246  8587 ts_tablet_manager.cc:1403] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.044s	user 0.023s	sys 0.000s
I20260709 12:25:57.348706  8586 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.351344  8586 ts_tablet_manager.cc:1434] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:57.351622  8628 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.352337  8586 tablet_bootstrap.cc:492] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.352147  8587 raft_consensus.cc:359] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.352763  8587 raft_consensus.cc:385] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.353088  8587 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.353875  8599 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.353691  8587 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.354344  8599 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.356053  8587 ts_tablet_manager.cc:1434] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:25:57.357000  8587 tablet_bootstrap.cc:492] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.357157  8630 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.359781  8599 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.360106  8630 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.361310  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.362305  8630 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:25:57.365049  8436 leader_election.cc:343] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.365095  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.365589  8293 catalog_manager.cc:5697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.366843  8586 tablet_bootstrap.cc:654] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:57.366988  8436 leader_election.cc:343] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.368108  8589 tablet_bootstrap.cc:492] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.368472  8589 ts_tablet_manager.cc:1403] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.090s	user 0.008s	sys 0.002s
I20260709 12:25:57.372051  8716 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:57.373644  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.378037  8589 raft_consensus.cc:359] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.378733  8589 raft_consensus.cc:385] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.378996  8589 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.381366  8589 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.384759  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.387398  8587 tablet_bootstrap.cc:654] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:57.389155  8438 leader_election.cc:343] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.389605  8438 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.391394  8599 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.391574  8630 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.392045  8630 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.396371  8589 ts_tablet_manager.cc:1434] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:25:57.396366  8599 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.396991  8599 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.398905  8589 tablet_bootstrap.cc:492] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:57.402719  8599 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.404503  8630 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.410436  8293 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:57.411655  8438 leader_election.cc:343] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.412782  8438 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.414047  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.414611  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.415259  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.414147  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:57.415777  8438 leader_election.cc:343] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:57.417339  8438 leader_election.cc:343] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.417932  8586 tablet_bootstrap.cc:492] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.418427  8586 ts_tablet_manager.cc:1403] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.008s
I20260709 12:25:57.414083  8630 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:57.420038  8436 leader_election.cc:343] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.421144  8436 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.419528  8716 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:25:57.422276  8436 leader_election.cc:343] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.422430  8586 raft_consensus.cc:359] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.443567  8586 raft_consensus.cc:385] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.443979  8586 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.425107  8630 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.441063  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.445719  8589 tablet_bootstrap.cc:654] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.445858  8599 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.446249  8630 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.444693  8586 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.446962  8630 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.449688  8586 ts_tablet_manager.cc:1434] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 12:25:57.453299  8586 tablet_bootstrap.cc:492] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.464303  8630 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.466154  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.466840  8546 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:57.469149  8436 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.470065  8630 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.470984  8630 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.471691  8630 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.477032  8586 tablet_bootstrap.cc:654] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.476981  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.477721  8395 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:57.481213  8587 tablet_bootstrap.cc:492] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.481705  8587 ts_tablet_manager.cc:1403] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.012s
I20260709 12:25:57.487722  8630 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.490355  8587 raft_consensus.cc:359] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.491060  8587 raft_consensus.cc:385] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.491323  8587 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.491981  8587 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.494051  8587 ts_tablet_manager.cc:1434] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:25:57.494951  8587 tablet_bootstrap.cc:492] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.508675  8630 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.510078  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:57.514762  8628 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.515398  8546 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.516010  8586 tablet_bootstrap.cc:492] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.516441  8586 ts_tablet_manager.cc:1403] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.017s
I20260709 12:25:57.518795  8586 raft_consensus.cc:359] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.519387  8586 raft_consensus.cc:385] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.519666  8586 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.510455  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:57.512879  8587 tablet_bootstrap.cc:654] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.520318  8395 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.520313  8586 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.522363  8546 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:57.523578  8586 ts_tablet_manager.cc:1434] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:25:57.524590  8586 tablet_bootstrap.cc:492] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.524789  8436 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.525835  8599 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.526486  8599 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:57.527362  8589 tablet_bootstrap.cc:492] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.527230  8599 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.529201  8395 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:57.525785  8628 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.530148  8586 tablet_bootstrap.cc:654] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.530292  8628 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.532413  8628 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.527788  8589 ts_tablet_manager.cc:1403] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.131s	user 0.008s	sys 0.003s
I20260709 12:25:57.534173  8587 tablet_bootstrap.cc:492] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.534623  8587 ts_tablet_manager.cc:1403] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.005s
I20260709 12:25:57.535176  8589 raft_consensus.cc:359] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.535827  8589 raft_consensus.cc:385] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.536092  8589 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.536422  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.536710  8589 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.537431  8587 raft_consensus.cc:359] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.538102  8587 raft_consensus.cc:385] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.538369  8587 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.538615  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.538995  8587 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.540385  8700 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.541884  8362 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.542380  8586 tablet_bootstrap.cc:492] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.542625  8700 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.542810  8586 ts_tablet_manager.cc:1403] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:25:57.543817  8587 ts_tablet_manager.cc:1434] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:25:57.544690  8587 tablet_bootstrap.cc:492] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.545308  8586 raft_consensus.cc:359] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.546537  8586 raft_consensus.cc:385] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.546787  8586 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.547550  8586 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.550450  8587 tablet_bootstrap.cc:654] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.551837  8586 ts_tablet_manager.cc:1434] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:25:57.552693  8586 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.554982  8589 ts_tablet_manager.cc:1434] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:25:57.555938  8589 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:57.558586  8586 tablet_bootstrap.cc:654] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.560055  8397 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.563995  8589 tablet_bootstrap.cc:654] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.570788  8586 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.571211  8586 ts_tablet_manager.cc:1403] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 12:25:57.573649  8586 raft_consensus.cc:359] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.574399  8586 raft_consensus.cc:385] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.574647  8586 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.575472  8586 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.577628  8586 ts_tablet_manager.cc:1434] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:57.578984  8586 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.573648  8587 tablet_bootstrap.cc:492] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.580121  8587 ts_tablet_manager.cc:1403] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:25:57.584520  8586 tablet_bootstrap.cc:654] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.586277  8587 raft_consensus.cc:359] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.588088  8587 raft_consensus.cc:385] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.588353  8587 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.589171  8587 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.589200  8593 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.591692  8587 ts_tablet_manager.cc:1434] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:25:57.591585  8593 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.592715  8587 tablet_bootstrap.cc:492] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.593931  8593 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:57.596151  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.601445  8589 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.601881  8589 ts_tablet_manager.cc:1403] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.008s
I20260709 12:25:57.606071  8589 raft_consensus.cc:359] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.606669  8589 raft_consensus.cc:385] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.603662  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.607110  8589 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.602633  8546 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.611852  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:57.607939  8589 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.615868  8628 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.616564  8589 ts_tablet_manager.cc:1434] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:25:57.618072  8586 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.618523  8586 ts_tablet_manager.cc:1403] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.019s
I20260709 12:25:57.602049  8295 catalog_manager.cc:5697] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.621330  8587 tablet_bootstrap.cc:654] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.621294  8586 raft_consensus.cc:359] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.622025  8586 raft_consensus.cc:385] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.622293  8586 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.622625  8593 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.622908  8586 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.623108  8593 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.625118  8593 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:57.625643  8586 ts_tablet_manager.cc:1434] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:25:57.627666  8589 tablet_bootstrap.cc:492] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:57.630339  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.630980  8470 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:57.631356  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.631980  8396 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:57.632026  8511 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.632938  8593 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.633278  8593 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.633600  8593 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.638870  8589 tablet_bootstrap.cc:654] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.641440  8593 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.644042  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:57.644672  8396 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.644793  8586 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.648327  8593 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:57.656687  8593 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.656791  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:57.657390  8471 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.657212  8593 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.659262  8593 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:57.663919  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.666538  8395 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.666797  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.667647  8470 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:57.672789  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:57.673552  8587 tablet_bootstrap.cc:492] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.673833  8716 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.674233  8630 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.676396  8587 ts_tablet_manager.cc:1403] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.008s
I20260709 12:25:57.683308  8711 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.683775  8628 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.685559  8587 raft_consensus.cc:359] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.686203  8587 raft_consensus.cc:385] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.686465  8587 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.686833  8716 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.692023  8587 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.696786  8471 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:57.697661  8589 tablet_bootstrap.cc:492] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.697878  8511 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.698181  8589 ts_tablet_manager.cc:1403] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.071s	user 0.007s	sys 0.015s
I20260709 12:25:57.698966  8586 tablet_bootstrap.cc:654] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.699977  8630 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:57.699983  8711 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.701877  8711 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:57.703131  8589 raft_consensus.cc:359] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.703743  8589 raft_consensus.cc:385] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.703994  8589 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.704778  8587 ts_tablet_manager.cc:1434] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.002s
I20260709 12:25:57.704602  8589 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.702665  8711 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.707182  8589 ts_tablet_manager.cc:1434] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:57.707674  8628 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.708091  8628 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.711958  8628 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.713047  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.713701  8471 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:57.714500  8716 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.714995  8716 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.715842  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:57.715212  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.716666  8544 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:57.713819  8587 tablet_bootstrap.cc:492] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.717767  8628 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.718154  8628 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.718487  8628 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.719898  8716 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:57.727098  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.727808  8471 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:57.729166  8396 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:57.731523  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.736230  8397 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.741119  8628 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.742329  8394 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:57.743191  8628 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.743912  8589 tablet_bootstrap.cc:492] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:57.746860  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:57.747177  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:57.747799  8544 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.752717  8470 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.756541  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:57.768873  8599 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.769078  8470 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:57.769371  8599 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.770233  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:57.772308  8621 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.776041  8599 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.777560  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.778292  8586 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:57.778860  8586 ts_tablet_manager.cc:1403] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.005s
W20260709 12:25:57.781412  8436 leader_election.cc:343] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.783603  8586 raft_consensus.cc:359] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.789767  8586 raft_consensus.cc:385] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.790215  8586 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.789033  8292 catalog_manager.cc:5697] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:57.779754  8621 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:57.801383  8621 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.805608  8586 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.814886  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.819360  8544 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:57.819489  8590 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:25:57.819835  8438 leader_election.cc:343] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.820011  8654 raft_consensus.cc:2764] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:25:57.820094  8590 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.820283  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.823294  8586 ts_tablet_manager.cc:1434] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 12:25:57.813277  8789 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.824203  8586 tablet_bootstrap.cc:492] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.824306  8789 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.824798  8590 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.829638  8599 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.830932  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:57.835091  8789 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.836184  8589 tablet_bootstrap.cc:654] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.838774  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.839397  8543 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 0.
I20260709 12:25:57.841408  8700 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:57.841387  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.842178  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.843753  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:57.844863  8599 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.845384  8599 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.845711  8599 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.847430  8438 leader_election.cc:343] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.848984  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.852134  8700 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:25:57.858492  8599 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.860528  8586 tablet_bootstrap.cc:654] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.861438  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:57.862036  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:57.863902  8544 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.870934  8295 catalog_manager.cc:5697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.872767  8544 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:25:57.873847  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:25:57.874418  8438 leader_election.cc:343] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.876467  8630 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.877142  8630 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:25:57.877910  8630 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.881948  8589 tablet_bootstrap.cc:492] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.882418  8589 ts_tablet_manager.cc:1403] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.002s
I20260709 12:25:57.861605  8599 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.879724  8587 tablet_bootstrap.cc:654] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.887135  8589 raft_consensus.cc:359] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.887848  8589 raft_consensus.cc:385] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.888152  8589 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.888809  8589 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.898595  8589 ts_tablet_manager.cc:1434] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:25:57.901664  8587 tablet_bootstrap.cc:492] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.902125  8587 ts_tablet_manager.cc:1403] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.001s
I20260709 12:25:57.904510  8587 raft_consensus.cc:359] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.904978  8587 raft_consensus.cc:385] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.905228  8587 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.905838  8587 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.906461  8621 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:57.908301  8587 ts_tablet_manager.cc:1434] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:25:57.908234  8292 catalog_manager.cc:5697] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:57.912518  8587 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:57.914083  8621 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.914533  8621 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.917588  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.917865  8621 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.918375  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:25:57.918977  8361 leader_election.cc:343] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.920243  8589 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:57.918970  8471 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:57.928809  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.927707  8630 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.929986  8599 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.931351  8630 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.932149  8700 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:57.932957  8700 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.933288  8700 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:57.934368  8630 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.936713  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.932571  8599 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.940502  8587 tablet_bootstrap.cc:654] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:57.941179  8436 leader_election.cc:343] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.943305  8589 tablet_bootstrap.cc:654] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.942791  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:57.945436  8586 tablet_bootstrap.cc:492] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
W20260709 12:25:57.946012  8438 leader_election.cc:343] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.945868  8586 ts_tablet_manager.cc:1403] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.006s
I20260709 12:25:57.946424  8438 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.947049  8599 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.947511  8599 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.949994  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:57.949918  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:57.951177  8436 leader_election.cc:343] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.951818  8599 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:57.952091  8438 leader_election.cc:343] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.952574  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.956575  8700 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.959223  8599 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:57.959897  8700 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:57.960057  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:57.960331  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:57.960772  8471 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:57.961388  8361 leader_election.cc:343] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:57.961524  8586 raft_consensus.cc:359] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.962008  8586 raft_consensus.cc:385] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.962244  8586 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.962783  8586 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.964581  8586 ts_tablet_manager.cc:1434] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:25:57.967981  8586 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:57.973032  8586 tablet_bootstrap.cc:654] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:57.973707  8471 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:57.975886  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:57.979843  8700 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:57.987479  8700 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:57.993274  8587 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:57.993750  8587 ts_tablet_manager.cc:1403] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.007s
I20260709 12:25:57.996268  8587 raft_consensus.cc:359] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.996906  8587 raft_consensus.cc:385] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:57.997165  8587 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:57.997714  8587 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:57.998472  8589 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:57.998976  8589 ts_tablet_manager.cc:1403] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.079s	user 0.013s	sys 0.012s
I20260709 12:25:57.999253  8587 ts_tablet_manager.cc:1434] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:25:58.010649  8587 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.014572  8789 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.016341  8587 tablet_bootstrap.cc:654] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.019834  8711 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.020283  8711 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.022194  8711 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.022872  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.023504  8394 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:58.025044  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:58.026023  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.026242  8789 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.026646  8471 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:58.026716  8789 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.027673  8711 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.028033  8711 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.028355  8711 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.028740  8789 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.001505  8589 raft_consensus.cc:359] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.002936  8700 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.030241  8589 raft_consensus.cc:385] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.033979  8589 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.036270  8589 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.043016  8589 ts_tablet_manager.cc:1434] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:25:58.045660  8789 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.045764  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.046167  8789 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.047675  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.048166  8789 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.049678  8589 tablet_bootstrap.cc:492] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
W20260709 12:25:58.050065  8436 leader_election.cc:343] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:58.053663  8438 leader_election.cc:343] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.056154  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.056231  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.055369  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.057641  8789 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:25:58.059525  8436 leader_election.cc:343] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.059954  8711 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.064035  8587 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.064380  8587 ts_tablet_manager.cc:1403] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.000s
W20260709 12:25:58.062137  8438 leader_election.cc:343] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.065783  8586 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.066195  8586 ts_tablet_manager.cc:1403] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.098s	user 0.005s	sys 0.018s
I20260709 12:25:58.069017  8293 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.072224  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.079573  8587 raft_consensus.cc:359] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.080240  8587 raft_consensus.cc:385] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.080580  8587 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.081362  8587 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.080216  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:58.082384  8397 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.083161  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.083741  8471 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.087323  8587 ts_tablet_manager.cc:1434] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:25:58.088289  8587 tablet_bootstrap.cc:492] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.089179  8397 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:58.078594  8711 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.090194  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:58.090945  8711 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.091641  8711 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:58.092334  8471 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:58.092489  8711 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.100625  8679 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.105211  8589 tablet_bootstrap.cc:654] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.106601  8586 raft_consensus.cc:359] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.107254  8586 raft_consensus.cc:385] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.107601  8586 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.109663  8586 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.111707  8586 ts_tablet_manager.cc:1434] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.003s
I20260709 12:25:58.112668  8586 tablet_bootstrap.cc:492] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.128985  8711 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.131435  8295 catalog_manager.cc:5697] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:58.132306  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:58.149667  8587 tablet_bootstrap.cc:654] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.152181  8586 tablet_bootstrap.cc:654] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.156750  8589 tablet_bootstrap.cc:492] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.157294  8589 ts_tablet_manager.cc:1403] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.015s
I20260709 12:25:58.160166  8589 raft_consensus.cc:359] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.160827  8589 raft_consensus.cc:385] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.161093  8589 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.161868  8789 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.162320  8789 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.164258  8789 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.165726  8654 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.169028  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:58.170820  8436 leader_election.cc:343] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.172303  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:58.173638  8438 leader_election.cc:343] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.174065  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.175355  8789 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.172078  8589 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.182134  8711 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.182605  8711 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.183629  8589 ts_tablet_manager.cc:1434] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:25:58.184227  8789 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.184715  8789 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.186902  8711 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.187974  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:58.189280  8438 leader_election.cc:343] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.186832  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:58.190716  8512 leader_election.cc:343] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.192631  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:58.193958  8436 leader_election.cc:343] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.194389  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.195127  8630 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.195732  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.196257  8789 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.199568  8587 tablet_bootstrap.cc:492] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.199995  8587 ts_tablet_manager.cc:1403] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.001s
I20260709 12:25:58.196331  8469 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:58.201617  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:58.202611  8711 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.202425  8587 raft_consensus.cc:359] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.202967  8711 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.203058  8587 raft_consensus.cc:385] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.203352  8711 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.205572  8586 tablet_bootstrap.cc:492] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.206211  8586 ts_tablet_manager.cc:1403] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.006s
I20260709 12:25:58.208637  8586 raft_consensus.cc:359] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.209244  8586 raft_consensus.cc:385] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.209511  8586 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.210515  8711 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.211594  8586 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.213748  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.213999  8586 ts_tablet_manager.cc:1434] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:25:58.214214  8589 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:58.214823  8586 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.217453  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:58.219501  8711 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.220103  8469 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.225627  8469 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:58.226601  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:58.227290  8654 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.203384  8587 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.227793  8589 tablet_bootstrap.cc:654] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.227771  8654 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:58.228688  8654 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.232249  8587 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.233894  8394 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.234860  8587 ts_tablet_manager.cc:1434] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:25:58.235790  8587 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.240825  8700 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.241240  8394 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:58.241288  8700 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.243757  8586 tablet_bootstrap.cc:654] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.244479  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.243327  8700 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.245921  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.246644  8469 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:58.245929  8543 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:58.248531  8362 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:58.249480  8700 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.249822  8700 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.250169  8700 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.251959  8587 tablet_bootstrap.cc:654] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.264473  8587 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.264897  8587 ts_tablet_manager.cc:1403] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:25:58.267357  8587 raft_consensus.cc:359] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.267705  8789 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.268013  8587 raft_consensus.cc:385] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.268401  8587 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.269021  8587 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.270452  8587 ts_tablet_manager.cc:1434] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:58.271306  8587 tablet_bootstrap.cc:492] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.279974  8700 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.282595  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.282824  8586 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.283154  8471 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.283344  8586 ts_tablet_manager.cc:1403] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.002s
I20260709 12:25:58.283985  8292 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.286049  8586 raft_consensus.cc:359] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.286751  8586 raft_consensus.cc:385] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.287048  8586 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.287750  8586 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.289954  8586 ts_tablet_manager.cc:1434] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:58.290953  8586 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.296064  8471 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:58.296600  8586 tablet_bootstrap.cc:654] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.297137  8362 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:58.297873  8621 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.298323  8621 raft_consensus.cc:697] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:58.299125  8621 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.300612  8791 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.313627  8589 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.317453  8589 ts_tablet_manager.cc:1403] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.002s
I20260709 12:25:58.317519  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:58.318334  8543 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.320551  8587 tablet_bootstrap.cc:654] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.317787  8700 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.325361  8586 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.325799  8586 ts_tablet_manager.cc:1403] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 12:25:58.325938  8543 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:58.328034  8586 raft_consensus.cc:359] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.328599  8586 raft_consensus.cc:385] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.328843  8586 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.329442  8586 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:58.330709  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:58.331349  8586 ts_tablet_manager.cc:1434] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:58.337131  8586 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.338573  8295 catalog_manager.cc:5697] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.346120  8586 tablet_bootstrap.cc:654] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.350811  8586 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.351230  8586 ts_tablet_manager.cc:1403] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 12:25:58.353682  8586 raft_consensus.cc:359] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.354307  8586 raft_consensus.cc:385] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.354557  8586 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.355115  8586 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.356994  8586 ts_tablet_manager.cc:1434] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:25:58.357820  8586 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.358511  8589 raft_consensus.cc:359] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.359561  8589 raft_consensus.cc:385] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.359886  8589 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.360558  8589 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.366080  8791 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.368122  8586 tablet_bootstrap.cc:654] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.379158  8586 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.379629  8586 ts_tablet_manager.cc:1403] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.011s
I20260709 12:25:58.381096  8589 ts_tablet_manager.cc:1434] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.000s
I20260709 12:25:58.385258  8587 tablet_bootstrap.cc:492] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.385102  8586 raft_consensus.cc:359] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.385841  8587 ts_tablet_manager.cc:1403] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.115s	user 0.011s	sys 0.000s
I20260709 12:25:58.385890  8586 raft_consensus.cc:385] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.386292  8586 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.387604  8589 tablet_bootstrap.cc:492] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:58.387003  8586 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.390048  8586 ts_tablet_manager.cc:1434] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:25:58.390959  8586 tablet_bootstrap.cc:492] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.394611  8589 tablet_bootstrap.cc:654] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.397507  8586 tablet_bootstrap.cc:654] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.410082  8621 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.410645  8621 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.396543  8587 raft_consensus.cc:359] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.411814  8587 raft_consensus.cc:385] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.412175  8587 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.412549  8621 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.412765  8587 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.413964  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.414563  8471 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:58.415050  8587 ts_tablet_manager.cc:1434] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:25:58.415675  8362 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:58.415987  8587 tablet_bootstrap.cc:492] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.416626  8590 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.416992  8590 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.417253  8590 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.419121  8586 tablet_bootstrap.cc:492] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.419634  8586 ts_tablet_manager.cc:1403] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.004s
I20260709 12:25:58.420673  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:58.421952  8361 leader_election.cc:343] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.422374  8586 raft_consensus.cc:359] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.423065  8586 raft_consensus.cc:385] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.423273  8587 tablet_bootstrap.cc:654] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.423372  8586 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.424299  8586 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.425034  8589 tablet_bootstrap.cc:492] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.425453  8589 ts_tablet_manager.cc:1403] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.004s
I20260709 12:25:58.426695  8586 ts_tablet_manager.cc:1434] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:58.426810  8590 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.427696  8586 tablet_bootstrap.cc:492] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.427788  8589 raft_consensus.cc:359] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.428406  8589 raft_consensus.cc:385] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.428663  8589 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.429255  8589 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.434010  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.437325  8471 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.440292  8589 ts_tablet_manager.cc:1434] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:25:58.441224  8589 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:58.456214  8589 tablet_bootstrap.cc:654] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.457042  8471 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:58.459487  8630 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.459998  8630 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:58.461163  8361 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:58.463907  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.464722  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:25:58.465153  8436 leader_election.cc:343] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.462280  8590 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.463198  8362 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:58.467006  8630 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.458956  8586 tablet_bootstrap.cc:654] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:58.469949  8361 leader_election.cc:343] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.474238  8621 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.472687  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.473253  8791 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.474705  8621 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.476888  8621 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.475279  8791 raft_consensus.cc:697] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:58.477833  8791 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.479472  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.480074  8543 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:58.480985  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.482045  8470 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:58.481002  8621 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:58.481218  8438 leader_election.cc:343] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.484249  8589 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.484331  8438 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.484738  8589 ts_tablet_manager.cc:1403] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.004s
I20260709 12:25:58.485466  8630 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.485963  8362 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:58.486625  8590 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.487217  8589 raft_consensus.cc:359] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.487526  8590 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.487913  8589 raft_consensus.cc:385] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.483861  8621 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.488088  8590 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.488226  8589 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.489022  8589 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.490983  8589 ts_tablet_manager.cc:1434] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:25:58.493287  8621 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.494093  8589 tablet_bootstrap.cc:492] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:58.494501  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.494825  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.496630  8362 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.497597  8621 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.507853  8589 tablet_bootstrap.cc:654] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.508395  8586 tablet_bootstrap.cc:492] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.508847  8586 ts_tablet_manager.cc:1403] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.002s
I20260709 12:25:58.511569  8586 raft_consensus.cc:359] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.512212  8586 raft_consensus.cc:385] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.512488  8586 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.513217  8586 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.513051  8293 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.515872  8587 tablet_bootstrap.cc:492] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.516335  8587 ts_tablet_manager.cc:1403] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.005s
I20260709 12:25:58.516562  8590 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.521487  8586 ts_tablet_manager.cc:1434] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:25:58.529033  8586 tablet_bootstrap.cc:492] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.531087  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.531328  8630 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.531600  8471 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.531809  8630 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.533645  8630 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.534509  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.535074  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:58.536304  8438 leader_election.cc:343] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:58.536854  8436 leader_election.cc:343] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.537274  8436 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.524432  8589 tablet_bootstrap.cc:492] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.525095  8654 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.527347  8791 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.522167  8587 raft_consensus.cc:359] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.538630  8630 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.538973  8587 raft_consensus.cc:385] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.539358  8587 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.540230  8589 ts_tablet_manager.cc:1403] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 12:25:58.539983  8587 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.541684  8587 ts_tablet_manager.cc:1434] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:25:58.542524  8587 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.542791  8589 raft_consensus.cc:359] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.543427  8589 raft_consensus.cc:385] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.543684  8589 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.547274  8589 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.548928  8586 tablet_bootstrap.cc:654] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.549693  8589 ts_tablet_manager.cc:1434] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:58.551311  8589 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:58.555182  8587 tablet_bootstrap.cc:654] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.556998  8791 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.557184  8589 tablet_bootstrap.cc:654] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.557459  8791 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.560175  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.560810  8472 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:58.561462  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:58.562781  8361 leader_election.cc:343] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.563298  8791 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.565887  8586 tablet_bootstrap.cc:492] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.566318  8586 ts_tablet_manager.cc:1403] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.006s
I20260709 12:25:58.567445  8362 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.568970  8621 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.568828  8586 raft_consensus.cc:359] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.569366  8621 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.569742  8621 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.571779  8587 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.572208  8587 ts_tablet_manager.cc:1403] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:25:58.573658  8586 raft_consensus.cc:385] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.569579  8471 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:58.573952  8586 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.582029  8679 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.582526  8679 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.584159  8590 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.584570  8679 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.585916  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.587622  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.588404  8621 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.593755  8362 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:25:58.594434  8590 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.594518  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:58.595119  8543 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.595181  8590 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:25:58.595419  8436 leader_election.cc:343] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.595814  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.594521  8587 raft_consensus.cc:359] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.596859  8587 raft_consensus.cc:385] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:25:58.597024  8438 leader_election.cc:343] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.597159  8587 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.597426  8438 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.598064  8679 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.596314  8471 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.599830  8587 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.600250  8586 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.602888  8587 ts_tablet_manager.cc:1434] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:25:58.603674  8587 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.604828  8621 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.604228  8630 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.605837  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:58.606189  8630 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:58.607107  8361 leader_election.cc:343] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.601157  8590 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.608830  8630 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.610627  8654 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.611055  8654 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.609931  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.612313  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.613402  8654 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:25:58.614038  8438 leader_election.cc:343] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:58.614473  8436 leader_election.cc:343] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.611474  8586 ts_tablet_manager.cc:1434] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.002s
I20260709 12:25:58.613992  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.615957  8586 tablet_bootstrap.cc:492] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.614890  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:25:58.617151  8512 leader_election.cc:343] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.617388  8679 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.618723  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.619542  8472 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:58.621197  8589 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.621326  8471 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:58.621640  8589 ts_tablet_manager.cc:1403] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 12:25:58.622582  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:58.623332  8654 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.624751  8654 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.625156  8654 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.624292  8362 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.625396  8543 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:58.629024  8589 raft_consensus.cc:359] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.629673  8589 raft_consensus.cc:385] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.630400  8589 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.627638  8621 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.632470  8621 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:58.633287  8621 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.638365  8589 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.640892  8589 ts_tablet_manager.cc:1434] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.019s	user 0.001s	sys 0.005s
I20260709 12:25:58.641220  8654 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.648157  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.648721  8469 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.648940  8587 tablet_bootstrap.cc:654] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.648957  8292 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.650835  8711 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.651283  8711 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.653244  8711 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.653708  8630 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.654134  8630 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.656039  8630 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.658434  8586 tablet_bootstrap.cc:654] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.659432  8589 tablet_bootstrap.cc:492] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:58.660171  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:58.661233  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:58.671964  8512 leader_election.cc:343] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.672585  8587 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.672459  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.673090  8587 ts_tablet_manager.cc:1403] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 12:25:58.673673  8716 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:58.675238  8438 leader_election.cc:343] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.675771  8587 raft_consensus.cc:359] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.676395  8587 raft_consensus.cc:385] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.676644  8587 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.677553  8589 tablet_bootstrap.cc:654] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.681799  8621 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.682260  8621 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.684484  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.684962  8621 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.685230  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:25:58.685745  8436 leader_election.cc:343] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.686156  8470 raft_consensus.cc:2393] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:58.686007  8587 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.686408  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:58.687592  8361 leader_election.cc:343] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.688323  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.688126  8292 catalog_manager.cc:5697] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.689045  8587 ts_tablet_manager.cc:1434] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 12:25:58.689453  8679 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.689951  8587 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.689803  8511 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:58.689476  8630 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.691560  8630 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.692245  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.692587  8716 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.692818  8471 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:58.695345  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:58.696698  8436 leader_election.cc:343] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.697211  8630 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.698341  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:58.699493  8438 leader_election.cc:343] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.699996  8438 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.701004  8679 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.700078  8654 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.699441  8469 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:58.705435  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:25:58.706568  8654 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.707727  8654 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:58.709048  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.710177  8621 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.710561  8621 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.710917  8621 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.710703  8654 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.709190  8716 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.714183  8587 tablet_bootstrap.cc:654] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.717870  8621 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.724052  8586 tablet_bootstrap.cc:492] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.724510  8586 ts_tablet_manager.cc:1403] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.013s
I20260709 12:25:58.724869  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:58.725485  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:25:58.726047  8361 leader_election.cc:343] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.726487  8469 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.729758  8587 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.730118  8589 tablet_bootstrap.cc:492] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.730209  8587 ts_tablet_manager.cc:1403] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 12:25:58.730500  8589 ts_tablet_manager.cc:1403] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.018s
I20260709 12:25:58.731177  8841 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.731634  8841 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.732764  8587 raft_consensus.cc:359] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.733381  8587 raft_consensus.cc:385] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.733626  8587 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.726583  8621 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.733958  8590 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:25:58.734197  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 60618.8us
I20260709 12:25:58.735493  8589 raft_consensus.cc:359] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.736104  8589 raft_consensus.cc:385] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.736351  8589 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.736953  8589 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.738404  8841 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.739710  8469 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:58.741087  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.741678  8470 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:58.745617  8589 ts_tablet_manager.cc:1434] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 12:25:58.726956  8586 raft_consensus.cc:359] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.746053  8586 raft_consensus.cc:385] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.746320  8586 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.746608  8589 tablet_bootstrap.cc:492] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:58.747112  8511 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:58.747906  8716 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:58.748248  8716 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.749258  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.750130  8841 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.746954  8586 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.752260  8586 ts_tablet_manager.cc:1434] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:25:58.753140  8586 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.756469  8587 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.750329  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.757400  8394 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:58.758330  8590 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.758878  8590 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:58.759913  8590 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.748551  8716 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.767618  8587 ts_tablet_manager.cc:1434] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:25:58.771672  8587 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.773425  8586 tablet_bootstrap.cc:654] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.781239  8587 tablet_bootstrap.cc:654] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.777117  8716 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.792444  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:58.793026  8471 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.794433  8397 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.819828  8471 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:58.821367  8293 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.802007  8716 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:58.825716  8511 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:58.836946  8679 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.837507  8679 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.837742  8841 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:58.839589  8679 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.839268  8292 catalog_manager.cc:5697] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:58.842226  8589 tablet_bootstrap.cc:654] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:58.836952  8716 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:58.847316  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:58.847821  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:58.825234  8590 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:25:58.852907  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.851778  8716 raft_consensus.cc:697] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:58.855965  8716 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.851331  8395 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:58.864732  8436 leader_election.cc:343] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:58.870940  8438 leader_election.cc:343] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.871346  8438 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:58.871783  8586 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:58.872283  8586 ts_tablet_manager.cc:1403] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.027s
I20260709 12:25:58.873076  8789 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:58.905663  8395 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:58.955521  8589 tablet_bootstrap.cc:492] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:58.956013  8589 ts_tablet_manager.cc:1403] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.210s	user 0.015s	sys 0.013s
I20260709 12:25:58.959661  8587 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:58.960139  8587 ts_tablet_manager.cc:1403] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.192s	user 0.022s	sys 0.035s
I20260709 12:25:58.960566  8586 raft_consensus.cc:359] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.961156  8586 raft_consensus.cc:385] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.961350  8586 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.961875  8586 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.966897  8586 ts_tablet_manager.cc:1434] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.094s	user 0.004s	sys 0.002s
I20260709 12:25:58.966928  8654 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.969971  8654 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.969740  8586 tablet_bootstrap.cc:492] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:58.971017  8545 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:58.975934  8587 raft_consensus.cc:359] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.976682  8587 raft_consensus.cc:385] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.976960  8587 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.980115  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:58.977576  8587 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.987836  8589 raft_consensus.cc:359] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.988749  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:58.991137  8789 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.988919  8587 ts_tablet_manager.cc:1434] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:25:58.989490  8589 raft_consensus.cc:385] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:58.992358  8589 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:58.993386  8587 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:58.994640  8621 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.995090  8621 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.997072  8621 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:58.997749  8589 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:58.992897  8293 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.000722  8586 tablet_bootstrap.cc:654] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.000533  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:58.984432  8654 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.003021  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.003088  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.003763  8472 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:59.004407  8589 ts_tablet_manager.cc:1434] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.001s
I20260709 12:25:59.005309  8589 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
W20260709 12:25:59.005374  8361 leader_election.cc:343] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:58.991611  8789 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.009452  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.010160  8362 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.011070  8789 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.012807  8850 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.013199  8850 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.013530  8850 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.015642  8587 tablet_bootstrap.cc:654] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.014562  8438 leader_election.cc:343] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.019832  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.021245  8436 leader_election.cc:343] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.021651  8436 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.022641  8789 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.026743  8589 tablet_bootstrap.cc:654] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.024755  8850 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.028249  8716 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.029251  8850 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.031076  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:59.031123  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:59.031840  8472 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:59.032590  8361 leader_election.cc:343] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.050225  8621 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.053196  8472 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:59.054890  8362 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.055636  8621 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.056107  8621 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:59.056859  8621 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.076228  8587 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.076766  8587 ts_tablet_manager.cc:1403] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.084s	user 0.026s	sys 0.014s
I20260709 12:25:59.079424  8587 raft_consensus.cc:359] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.080133  8587 raft_consensus.cc:385] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.080427  8587 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.081071  8587 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.083468  8587 ts_tablet_manager.cc:1434] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:59.084447  8587 tablet_bootstrap.cc:492] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:59.089481  8850 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.089990  8850 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.091933  8850 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.093263  8586 tablet_bootstrap.cc:492] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.093710  8586 ts_tablet_manager.cc:1403] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.124s	user 0.020s	sys 0.010s
I20260709 12:25:59.093622  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.094518  8587 tablet_bootstrap.cc:654] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.095014  8361 leader_election.cc:343] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.097512  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.098140  8472 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:59.102049  8589 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.101855  8586 raft_consensus.cc:359] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.102481  8589 ts_tablet_manager.cc:1403] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.097s	user 0.005s	sys 0.012s
I20260709 12:25:59.102520  8586 raft_consensus.cc:385] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.102856  8586 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.103132  8679 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.103485  8586 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.103595  8679 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.105607  8586 ts_tablet_manager.cc:1434] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:25:59.106623  8586 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.107321  8293 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.108105  8362 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.108407  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.111898  8850 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.112442  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.113765  8436 leader_election.cc:343] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.105602  8679 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.116339  8586 tablet_bootstrap.cc:654] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.114673  8841 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.120581  8841 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.121726  8589 raft_consensus.cc:359] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.122366  8589 raft_consensus.cc:385] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.122637  8589 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.123590  8589 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.124099  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.124850  8469 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:59.125770  8589 ts_tablet_manager.cc:1434] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.023s	user 0.001s	sys 0.005s
I20260709 12:25:59.126019  8841 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.126596  8850 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.126950  8850 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.127007  8589 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.127331  8850 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.133700  8850 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.135624  8850 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.137557  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:59.137754  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.138594  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:25:59.138626  8438 leader_election.cc:343] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.139258  8469 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:59.139614  8361 leader_election.cc:343] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.140164  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.141126  8679 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.145983  8469 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:59.152223  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:59.153579  8716 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.160175  8716 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.167565  8589 tablet_bootstrap.cc:654] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.175805  8362 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.179621  8700 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.181011  8700 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.188951  8586 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.189437  8586 ts_tablet_manager.cc:1403] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.041s
I20260709 12:25:59.191856  8586 raft_consensus.cc:359] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.192516  8586 raft_consensus.cc:385] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.192777  8586 raft_consensus.cc:740] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.193361  8586 consensus_queue.cc:260] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.196772  8586 ts_tablet_manager.cc:1434] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:25:59.197710  8586 tablet_bootstrap.cc:492] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.203238  8586 tablet_bootstrap.cc:654] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.176554  8850 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.211627  8850 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:59.212462  8850 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.218359  8654 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.218847  8654 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.221122  8654 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.224218  8589 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.224908  8589 ts_tablet_manager.cc:1403] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.098s	user 0.022s	sys 0.006s
I20260709 12:25:59.225762  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.226676  8469 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:59.227486  8589 raft_consensus.cc:359] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.228457  8589 raft_consensus.cc:385] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.228749  8589 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.229507  8589 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.231482  8589 ts_tablet_manager.cc:1434] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
W20260709 12:25:59.220469  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 44750.6us
I20260709 12:25:59.234079  8589 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.241032  8586 tablet_bootstrap.cc:492] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.241492  8586 ts_tablet_manager.cc:1403] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.003s
I20260709 12:25:59.241847  8654 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.242332  8654 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.244462  8654 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.245478  8586 raft_consensus.cc:359] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.246111  8586 raft_consensus.cc:385] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.246315  8586 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.246978  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.247848  8472 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:59.248620  8589 tablet_bootstrap.cc:654] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.252415  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.254072  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.246989  8586 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:25:59.257000  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:25:59.257565  8586 ts_tablet_manager.cc:1434] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:59.258421  8586 tablet_bootstrap.cc:492] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.263542  8586 tablet_bootstrap.cc:654] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.267933  8586 tablet_bootstrap.cc:492] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.267634  8293 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.268396  8586 ts_tablet_manager.cc:1403] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:25:59.275149  8586 raft_consensus.cc:359] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.275861  8586 raft_consensus.cc:385] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.276124  8586 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.276744  8586 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.287606  8589 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.288110  8589 ts_tablet_manager.cc:1403] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.007s
I20260709 12:25:59.288291  8586 ts_tablet_manager.cc:1434] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.004s
I20260709 12:25:59.289186  8586 tablet_bootstrap.cc:492] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.290706  8589 raft_consensus.cc:359] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.291376  8589 raft_consensus.cc:385] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.291694  8589 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.292351  8589 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.293746  8589 ts_tablet_manager.cc:1434] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 12:25:59.294623  8589 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.300527  8589 tablet_bootstrap.cc:654] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.302181  8586 tablet_bootstrap.cc:654] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.304296  8587 tablet_bootstrap.cc:492] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.304744  8587 ts_tablet_manager.cc:1403] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.221s	user 0.029s	sys 0.023s
I20260709 12:25:59.307221  8587 raft_consensus.cc:359] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.308125  8587 raft_consensus.cc:385] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.308444  8587 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.309063  8587 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.311136  8654 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.311491  8587 ts_tablet_manager.cc:1434] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:25:59.314332  8586 tablet_bootstrap.cc:492] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.314674  8654 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.314828  8586 ts_tablet_manager.cc:1403] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.026s	user 0.003s	sys 0.009s
I20260709 12:25:59.315160  8654 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.317206  8654 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.318857  8587 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:59.317716  8586 raft_consensus.cc:359] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.321555  8586 raft_consensus.cc:385] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.322199  8586 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.323041  8586 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.325310  8586 ts_tablet_manager.cc:1434] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:25:59.326261  8586 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.327527  8850 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.330842  8850 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.331949  8590 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.332561  8586 tablet_bootstrap.cc:654] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.333400  8512 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:59.334607  8512 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:59.335613  8715 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.335752  8841 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.337622  8587 tablet_bootstrap.cc:654] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.342660  8512 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:59.342731  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.343966  8716 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.344496  8716 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.344935  8850 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.345412  8850 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.346575  8716 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.347276  8850 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.355984  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.357203  8361 leader_election.cc:343] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.359709  8589 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.360234  8589 ts_tablet_manager.cc:1403] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.031s
I20260709 12:25:59.361423  8715 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.362181  8841 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.365146  8589 raft_consensus.cc:359] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.365819  8589 raft_consensus.cc:385] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.366146  8589 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.366811  8589 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.368774  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.369437  8394 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:59.369000  8589 ts_tablet_manager.cc:1434] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:25:59.370576  8589 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.370594  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:59.373548  8875 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.373914  8875 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.374238  8875 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.377526  8589 tablet_bootstrap.cc:654] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.380519  8586 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.380985  8586 ts_tablet_manager.cc:1403] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 12:25:59.383733  8586 raft_consensus.cc:359] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.384407  8586 raft_consensus.cc:385] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.384667  8586 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.388002  8586 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.389045  8587 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.389523  8587 ts_tablet_manager.cc:1403] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.001s
I20260709 12:25:59.390247  8586 ts_tablet_manager.cc:1434] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:25:59.391256  8586 tablet_bootstrap.cc:492] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.392215  8587 raft_consensus.cc:359] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.392864  8587 raft_consensus.cc:385] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.393139  8587 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.393730  8587 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.397765  8587 ts_tablet_manager.cc:1434] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:25:59.396481  8875 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.400931  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:59.401530  8394 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.401872  8587 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:59.408835  8394 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:59.410333  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:59.411541  8716 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.412027  8716 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.412813  8654 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.412731  8850 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.413525  8654 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:59.414222  8630 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.414726  8630 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.418224  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.419705  8436 leader_election.cc:343] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.420665  8630 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.420871  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.420646  8654 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.422034  8587 tablet_bootstrap.cc:654] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.422323  8438 leader_election.cc:343] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.422761  8438 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.423754  8789 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.424224  8789 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.426283  8789 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.426757  8789 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.427062  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.428567  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.429353  8438 leader_election.cc:343] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:59.429937  8436 leader_election.cc:343] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.430341  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.432868  8789 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.433455  8789 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.433879  8789 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.434343  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.434978  8470 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:59.436906  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.438150  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.438457  8438 leader_election.cc:343] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.439155  8789 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:25:59.439545  8436 leader_election.cc:343] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.439930  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.440826  8789 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.441519  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.442108  8396 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:59.443204  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:59.444073  8715 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.444453  8715 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.444772  8715 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.459844  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.460722  8468 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:25:59.464982  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.462877  8715 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.465787  8468 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:59.467504  8715 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.470098  8716 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.475227  8589 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.475786  8589 ts_tablet_manager.cc:1403] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.105s	user 0.043s	sys 0.047s
I20260709 12:25:59.476658  8586 tablet_bootstrap.cc:654] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.478367  8589 raft_consensus.cc:359] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.478869  8875 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.479081  8589 raft_consensus.cc:385] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.479455  8589 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.480609  8589 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.482349  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:59.482599  8589 ts_tablet_manager.cc:1434] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:59.482926  8394 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.484568  8589 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.488940  8587 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.489378  8587 ts_tablet_manager.cc:1403] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.005s
I20260709 12:25:59.490582  8394 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:59.495246  8589 tablet_bootstrap.cc:654] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.497186  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:59.495492  8586 tablet_bootstrap.cc:492] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.497762  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.498096  8586 ts_tablet_manager.cc:1403] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.000s
I20260709 12:25:59.498108  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:59.498819  8468 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.500798  8586 raft_consensus.cc:359] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.501490  8586 raft_consensus.cc:385] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.501756  8586 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.502399  8586 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.497789  8469 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.512142  8586 ts_tablet_manager.cc:1434] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:25:59.513178  8586 tablet_bootstrap.cc:492] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.513865  8468 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:59.516564  8469 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:59.520973  8586 tablet_bootstrap.cc:654] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.523536  8295 catalog_manager.cc:5697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.526503  8589 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.526995  8589 ts_tablet_manager.cc:1403] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.014s
I20260709 12:25:59.527134  8586 tablet_bootstrap.cc:492] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.527583  8586 ts_tablet_manager.cc:1403] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:25:59.530150  8586 raft_consensus.cc:359] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.530148  8589 raft_consensus.cc:359] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.530906  8586 raft_consensus.cc:385] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.531036  8589 raft_consensus.cc:385] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.531200  8586 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.531456  8589 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.531982  8586 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.532143  8589 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.534130  8586 ts_tablet_manager.cc:1434] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:25:59.534386  8589 ts_tablet_manager.cc:1434] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:25:59.535252  8589 tablet_bootstrap.cc:492] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.535182  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:59.536306  8586 tablet_bootstrap.cc:492] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.543291  8589 tablet_bootstrap.cc:654] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.543291  8586 tablet_bootstrap.cc:654] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.544914  8362 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.545944  8700 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.546267  8700 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.546573  8700 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.552377  8700 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.554759  8885 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.555063  8700 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.555301  8885 raft_consensus.cc:697] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:59.555827  8589 tablet_bootstrap.cc:492] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.556322  8589 ts_tablet_manager.cc:1403] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 12:25:59.556151  8885 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.556137  8586 tablet_bootstrap.cc:492] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.560336  8586 ts_tablet_manager.cc:1403] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 12:25:59.566996  8589 raft_consensus.cc:359] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.567695  8589 raft_consensus.cc:385] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.567941  8589 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.567884  8590 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:25:59.568502  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:25:59.569041  8544 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.568717  8589 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.572083  8589 ts_tablet_manager.cc:1434] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:25:59.572943  8589 tablet_bootstrap.cc:492] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.576330  8875 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.578806  8587 raft_consensus.cc:359] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.579840  8587 raft_consensus.cc:385] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.580211  8587 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.579855  8544 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:59.581048  8587 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.581485  8361 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:59.582335  8590 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.582789  8590 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:25:59.583055  8587 ts_tablet_manager.cc:1434] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.001s
I20260709 12:25:59.584313  8590 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.588526  8511 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:25:59.590091  8587 tablet_bootstrap.cc:492] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:59.594856  8679 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.595342  8679 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.595510  8654 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.598227  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.598626  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.598830  8679 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.591121  8875 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:59.599849  8436 leader_election.cc:343] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:59.600348  8438 leader_election.cc:343] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.600740  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.603231  8679 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.608696  8875 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.627605  8630 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.628104  8630 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.630352  8630 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.632371  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.638361  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.639883  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:59.640470  8471 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.633880  8292 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:59.639925  8436 leader_election.cc:343] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:25:59.647887  8438 leader_election.cc:343] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.660313  8471 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:59.660269  8295 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.665110  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.665128  8586 raft_consensus.cc:359] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.668290  8590 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.670169  8621 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.668669  8586 raft_consensus.cc:385] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.670912  8586 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.667886  8630 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.675034  8586 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.677430  8589 tablet_bootstrap.cc:654] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.681686  8587 tablet_bootstrap.cc:654] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.701260  8587 tablet_bootstrap.cc:492] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.701679  8587 ts_tablet_manager.cc:1403] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.000s
I20260709 12:25:59.704174  8587 raft_consensus.cc:359] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.704787  8587 raft_consensus.cc:385] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.705042  8587 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.705621  8587 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.718077  8587 ts_tablet_manager.cc:1434] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:25:59.718986  8587 tablet_bootstrap.cc:492] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:59.724141  8394 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.724726  8587 tablet_bootstrap.cc:654] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.729009  8586 ts_tablet_manager.cc:1434] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.168s	user 0.009s	sys 0.003s
I20260709 12:25:59.729907  8586 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Bootstrap starting.
I20260709 12:25:59.737895  8589 tablet_bootstrap.cc:492] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.738431  8589 ts_tablet_manager.cc:1403] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.166s	user 0.011s	sys 0.003s
I20260709 12:25:59.741258  8587 tablet_bootstrap.cc:492] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.741727  8587 ts_tablet_manager.cc:1403] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:25:59.741823  8589 raft_consensus.cc:359] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.742411  8621 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.742630  8589 raft_consensus.cc:385] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.743062  8589 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.743798  8589 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.744486  8587 raft_consensus.cc:359] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.745175  8587 raft_consensus.cc:385] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.745417  8587 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.747430  8589 ts_tablet_manager.cc:1434] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:25:59.748345  8587 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.748381  8589 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.748770  8899 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.750171  8899 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.752686  8587 ts_tablet_manager.cc:1434] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:25:59.753580  8587 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:25:59.787885  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.771008  8899 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:25:59.789474  8436 leader_election.cc:343] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.791030  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:25:59.796968  8438 leader_election.cc:343] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.797379  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.800149  8789 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.797921  8899 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.811053  8899 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.813048  8587 tablet_bootstrap.cc:654] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.800309  8875 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.826037  8589 tablet_bootstrap.cc:654] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.821872  8586 tablet_bootstrap.cc:654] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.817176  8875 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.829208  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.830441  8436 leader_election.cc:343] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.834124  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.834733  8396 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:59.835983  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:59.836400  8875 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.836777  8885 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.837177  8885 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.837491  8885 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.841104  8700 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.841539  8700 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.842779  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.843473  8467 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:25:59.844012  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.845506  8899 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.846506  8789 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.847002  8789 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.849555  8789 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.850114  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.852064  8436 leader_election.cc:343] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.860483  8587 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.861267  8700 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:25:59.862725  8438 leader_election.cc:343] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.863162  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.863534  8587 ts_tablet_manager.cc:1403] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.110s	user 0.007s	sys 0.005s
I20260709 12:25:59.866830  8789 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.866648  8587 raft_consensus.cc:359] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.868327  8587 raft_consensus.cc:385] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.868624  8587 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.871869  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.873517  8589 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:25:59.873927  8589 ts_tablet_manager.cc:1403] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.126s	user 0.019s	sys 0.020s
I20260709 12:25:59.874625  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.874732  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.875248  8468 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:59.876981  8587 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.879228  8587 ts_tablet_manager.cc:1434] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:25:59.880748  8587 tablet_bootstrap.cc:492] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
W20260709 12:25:59.881870  8361 leader_election.cc:343] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.884135  8362 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.884840  8590 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:25:59.885181  8590 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.885466  8590 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:25:59.888300  8438 leader_election.cc:343] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.888710  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.891987  8897 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.891294  8590 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.894855  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:25:59.896127  8361 leader_election.cc:343] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.895902  8885 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.897646  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:59.883656  8789 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.898197  8468 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.898626  8789 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.901219  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:25:59.901310  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:25:59.901885  8396 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.901945  8467 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:25:59.904196  8590 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.898159  8885 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:25:59.909557  8396 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:59.909622  8589 raft_consensus.cc:359] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.910583  8589 raft_consensus.cc:385] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.910871  8589 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.910838  8467 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:25:59.911245  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:25:59.912355  8789 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.913417  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.913926  8586 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: No bootstrap required, opened a new log
I20260709 12:25:59.914378  8586 ts_tablet_manager.cc:1403] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent bootstrapping tablet: real 0.185s	user 0.021s	sys 0.006s
W20260709 12:25:59.914575  8436 leader_election.cc:343] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.915544  8468 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:25:59.916227  8589 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.916426  8362 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.913473  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.917207  8590 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.917621  8590 raft_consensus.cc:697] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:25:59.917822  8438 leader_election.cc:343] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.918228  8438 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.918911  8899 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.918259  8590 consensus_queue.cc:237] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.925616  8885 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:25:59.926152  8885 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:25:59.928370  8885 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.931110  8589 ts_tablet_manager.cc:1434] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.003s
I20260709 12:25:59.932026  8589 tablet_bootstrap.cc:492] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:25:59.935030  8586 raft_consensus.cc:359] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.935689  8586 raft_consensus.cc:385] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.935978  8587 tablet_bootstrap.cc:654] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:25:59.935945  8586 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.937024  8586 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.939621  8875 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:25:59.941537  8586 ts_tablet_manager.cc:1434] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:25:59.944188  8295 catalog_manager.cc:5697] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.952276  8899 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.952800  8899 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.954734  8899 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.959333  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:25:59.961144  8589 tablet_bootstrap.cc:654] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
W20260709 12:25:59.963732  8438 leader_election.cc:343] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.964824  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:25:59.966203  8436 leader_election.cc:343] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:25:59.966632  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:25:59.967295  8899 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:25:59.968606  8590 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.968680  8875 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:25:59.969085  8590 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.979895  8654 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.980317  8654 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.985432  8587 tablet_bootstrap.cc:492] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:25:59.985947  8587 ts_tablet_manager.cc:1403] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.002s
I20260709 12:25:59.988637  8590 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:25:59.993881  8587 raft_consensus.cc:359] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.994876  8587 raft_consensus.cc:385] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:25:59.995240  8587 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:25:59.994104  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:25:59.988165  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:25:59.996035  8587 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:25:59.997929  8544 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:59.998629  8468 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:25:59.999486  8587 ts_tablet_manager.cc:1434] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:26:00.000551  8362 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:00.001376  8587 tablet_bootstrap.cc:492] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.001689  8850 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.002063  8850 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.002372  8850 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.009086  8654 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.009282  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.009868  8468 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:00.011008  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:00.012287  8841 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.012696  8841 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.015141  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:00.013018  8841 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:00.019999  8512 leader_election.cc:343] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.020392  8293 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.050004  8589 tablet_bootstrap.cc:492] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:00.050653  8589 ts_tablet_manager.cc:1403] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.119s	user 0.022s	sys 0.024s
I20260709 12:26:00.051479  8654 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.052773  8587 tablet_bootstrap.cc:654] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.055287  8715 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.055773  8715 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.071849  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.072494  8467 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:00.073083  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:00.073489  8511 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:00.074606  8654 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.074923  8654 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.075209  8654 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.071230  8715 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:00.079752  8512 leader_election.cc:343] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.083837  8654 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.086365  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.086519  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:00.086901  8467 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.089655  8589 raft_consensus.cc:359] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:00.091807  8512 leader_election.cc:343] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.096423  8589 raft_consensus.cc:385] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.096446  8654 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.095844  8467 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:00.093104  8841 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.096841  8589 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.098938  8589 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.102180  8511 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:00.103044  8875 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.103291  8589 ts_tablet_manager.cc:1434] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.002s
I20260709 12:26:00.103533  8875 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:00.104692  8589 tablet_bootstrap.cc:492] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:00.097882  8850 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.112135  8875 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.122046  8850 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.122859  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.123504  8467 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.123777  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:00.126273  8654 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.124270  8544 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.128782  8841 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.129657  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:00.130878  8512 leader_election.cc:343] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.133522  8587 tablet_bootstrap.cc:492] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:00.133942  8587 ts_tablet_manager.cc:1403] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.133s	user 0.007s	sys 0.014s
I20260709 12:26:00.136224  8700 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.136555  8544 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:00.139297  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:00.140409  8590 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.140822  8590 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:00.141516  8590 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.142611  8589 tablet_bootstrap.cc:654] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.147076  8292 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.140581  8587 raft_consensus.cc:359] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.148422  8587 raft_consensus.cc:385] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.148789  8587 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.153446  8587 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.157315  8467 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:00.166675  8587 ts_tablet_manager.cc:1434] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.005s
I20260709 12:26:00.167675  8587 tablet_bootstrap.cc:492] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.169143  8850 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.169198  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.171162  8466 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.198233  8466 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:00.200484  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:00.203049  8841 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.203485  8841 raft_consensus.cc:697] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:00.204258  8841 consensus_queue.cc:237] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.218487  8587 tablet_bootstrap.cc:654] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.231052  8589 tablet_bootstrap.cc:492] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:00.231619  8589 ts_tablet_manager.cc:1403] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.127s	user 0.025s	sys 0.004s
I20260709 12:26:00.229741  8292 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.234339  8589 raft_consensus.cc:359] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.239982  8589 raft_consensus.cc:385] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.240351  8589 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.241145  8589 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.245012  8295 catalog_manager.cc:5697] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.246644  8589 ts_tablet_manager.cc:1434] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 12:26:00.249189  8589 tablet_bootstrap.cc:492] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:00.248029  8587 tablet_bootstrap.cc:492] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:00.259819  8587 ts_tablet_manager.cc:1403] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.000s
I20260709 12:26:00.262457  8587 raft_consensus.cc:359] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.263540  8587 raft_consensus.cc:385] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.263871  8587 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.267799  8587 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.269879  8587 ts_tablet_manager.cc:1434] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:00.264235  8700 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.271984  8700 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.272769  8587 tablet_bootstrap.cc:492] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.273993  8700 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.274391  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.274770  8589 tablet_bootstrap.cc:654] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.275010  8466 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:00.278625  8841 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.277515  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:00.279192  8544 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:00.279568  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:00.280340  8700 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.280153  8841 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.280692  8700 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.281019  8700 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.283004  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:00.284489  8512 leader_election.cc:343] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.285019  8590 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.285420  8590 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.286975  8700 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.289594  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.289883  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:00.289670  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.290298  8469 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.290410  8544 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.290530  8466 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:00.288455  8587 tablet_bootstrap.cc:654] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.300560  8469 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:00.302982  8590 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.313397  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.313836  8544 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:00.314136  8469 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:00.314998  8841 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.315209  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:00.316906  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:00.317709  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:00.318400  8932 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.318886  8932 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:00.319599  8841 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.319968  8841 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.320556  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:00.322276  8700 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.318279  8929 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.327711  8841 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.329052  8929 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.329708  8929 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:00.330717  8361 leader_election.cc:343] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.334998  8932 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.341832  8899 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.342326  8899 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:00.346655  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:00.348052  8841 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.349041  8715 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.349373  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:00.349978  8841 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.344730  8929 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:00.350772  8436 leader_election.cc:343] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.351357  8899 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.352226  8929 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.353832  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.353190  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:00.354424  8466 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.355167  8589 tablet_bootstrap.cc:492] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:00.355614  8589 ts_tablet_manager.cc:1403] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.011s
W20260709 12:26:00.355628  8361 leader_election.cc:343] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.357223  8587 tablet_bootstrap.cc:492] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:00.357656  8587 ts_tablet_manager.cc:1403] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.013s
I20260709 12:26:00.357967  8589 raft_consensus.cc:359] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.358465  8589 raft_consensus.cc:385] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.358668  8589 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.359228  8589 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.360980  8587 raft_consensus.cc:359] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.361696  8587 raft_consensus.cc:385] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.361943  8587 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.362546  8587 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.364490  8587 ts_tablet_manager.cc:1434] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:00.365341  8587 tablet_bootstrap.cc:492] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.365686  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.366271  8470 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.371364  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:00.373548  8512 leader_election.cc:343] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.374171  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:00.376579  8470 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:00.360940  8466 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:00.380726  8589 ts_tablet_manager.cc:1434] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:00.381670  8589 tablet_bootstrap.cc:492] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:00.384250  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:00.384989  8841 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.385468  8841 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:00.386236  8841 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.391526  8589 tablet_bootstrap.cc:654] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:00.391808  8438 leader_election.cc:343] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.392227  8438 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:00.394234  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:00.393162  8899 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.395038  8928 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.395499  8928 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:00.397326  8928 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.405782  8587 tablet_bootstrap.cc:654] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.413590  8590 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.414079  8590 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.415867  8590 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.417394  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:00.423725  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.424464  8466 raft_consensus.cc:2393] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 1: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:00.428766  8875 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.430562  8362 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:00.431777  8590 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.433996  8295 catalog_manager.cc:5697] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.441182  8590 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.457386  8589 tablet_bootstrap.cc:492] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:00.457881  8589 ts_tablet_manager.cc:1403] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.001s
I20260709 12:26:00.459995  8887 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.460461  8887 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.462495  8887 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.462611  8850 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.464685  8589 raft_consensus.cc:359] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.465629  8587 tablet_bootstrap.cc:492] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:00.466085  8587 ts_tablet_manager.cc:1403] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.101s	user 0.011s	sys 0.004s
I20260709 12:26:00.466180  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.466902  8469 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:00.465298  8589 raft_consensus.cc:385] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.467814  8589 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.468322  8589 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.469467  8589 ts_tablet_manager.cc:1434] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:26:00.469841  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:00.470335  8589 tablet_bootstrap.cc:492] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:00.475926  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:00.477910  8654 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.478200  8295 catalog_manager.cc:5697] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.488822  8293 catalog_manager.cc:5697] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.483177  8587 raft_consensus.cc:359] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.490819  8587 raft_consensus.cc:385] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.491097  8587 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.491734  8587 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.492458  8546 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.494292  8587 ts_tablet_manager.cc:1434] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.002s
I20260709 12:26:00.495210  8587 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.502135  8928 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:26:00.508819  8928 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.509253  8928 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.511497  8928 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.495769  8589 tablet_bootstrap.cc:654] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.512110  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:00.512818  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.513576  8470 raft_consensus.cc:2393] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 1: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:00.502666  8654 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.519106  8362 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:00.521546  8928 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.522508  8587 tablet_bootstrap.cc:654] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.529994  8928 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:00.541270  8589 tablet_bootstrap.cc:492] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:00.541762  8589 ts_tablet_manager.cc:1403] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.072s	user 0.006s	sys 0.011s
I20260709 12:26:00.544281  8589 raft_consensus.cc:359] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.544931  8589 raft_consensus.cc:385] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.545171  8589 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.545765  8589 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.553194  8587 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:00.553653  8587 ts_tablet_manager.cc:1403] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.003s
I20260709 12:26:00.556246  8587 raft_consensus.cc:359] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.556872  8587 raft_consensus.cc:385] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.557122  8587 raft_consensus.cc:740] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.557850  8589 ts_tablet_manager.cc:1434] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:26:00.558753  8589 tablet_bootstrap.cc:492] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:00.559825  8850 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.561527  8587 consensus_queue.cc:260] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.572654  8587 ts_tablet_manager.cc:1434] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:26:00.577867  8589 tablet_bootstrap.cc:654] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.579731  8587 tablet_bootstrap.cc:492] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.590921  8929 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.593048  8587 tablet_bootstrap.cc:654] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.596238  8850 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.596756  8850 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.600318  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:00.602034  8361 leader_election.cc:343] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.602265  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.602864  8469 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:00.604040  8589 tablet_bootstrap.cc:492] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:00.604475  8589 ts_tablet_manager.cc:1403] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 12:26:00.604403  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:00.605489  8590 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.605803  8590 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.606087  8590 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.606370  8850 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.612097  8590 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.613878  8590 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.615098  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.615386  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:00.615653  8469 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:00.616647  8361 leader_election.cc:343] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.616979  8587 tablet_bootstrap.cc:492] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:00.617367  8587 ts_tablet_manager.cc:1403] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.004s
I20260709 12:26:00.619331  8590 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.621133  8469 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:00.619524  8587 raft_consensus.cc:359] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.621655  8587 raft_consensus.cc:385] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.621938  8587 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.622555  8587 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.624859  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:00.625792  8587 ts_tablet_manager.cc:1434] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:26:00.619786  8590 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.620981  8589 raft_consensus.cc:359] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.627681  8589 raft_consensus.cc:385] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.627945  8589 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.628566  8589 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.630645  8589 ts_tablet_manager.cc:1434] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:26:00.631506  8589 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:00.635010  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:00.635110  8850 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.635624  8546 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:00.635880  8850 raft_consensus.cc:697] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:00.636361  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.636947  8470 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:00.636718  8850 consensus_queue.cc:237] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.638302  8589 tablet_bootstrap.cc:654] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.639830  8875 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.627269  8587 tablet_bootstrap.cc:492] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.640290  8875 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.642714  8875 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.644455  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:00.645372  8841 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:00.648392  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:00.649055  8928 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:00.649389  8928 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.649703  8928 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:00.650266  8512 leader_election.cc:343] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.650672  8587 tablet_bootstrap.cc:654] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.652000  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:00.652401  8469 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:00.678896  8590 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.693612  8589 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:00.692864  8928 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.704123  8875 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.712949  8589 ts_tablet_manager.cc:1403] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.006s
I20260709 12:26:00.691299  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:00.713660  8875 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:00.713747  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 50040.8us
I20260709 12:26:00.714092  8928 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:00.714553  8875 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.714985  8875 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.715683  8589 raft_consensus.cc:359] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.715553  8295 catalog_manager.cc:5697] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:00.716418  8589 raft_consensus.cc:385] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.716732  8589 raft_consensus.cc:740] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.717381  8589 consensus_queue.cc:260] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.720063  8589 ts_tablet_manager.cc:1434] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:00.721073  8589 tablet_bootstrap.cc:492] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:00.726050  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:00.726593  8546 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.729707  8875 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.732339  8546 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:00.740868  8589 tablet_bootstrap.cc:654] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.747303  8887 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.745990  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:00.743749  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:00.751169  8590 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.754309  8716 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.758450  8590 raft_consensus.cc:697] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:00.762960  8590 consensus_queue.cc:237] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.759908  8928 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.760418  8587 tablet_bootstrap.cc:492] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:00.748591  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.764765  8587 ts_tablet_manager.cc:1403] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.015s
W20260709 12:26:00.766853  8512 leader_election.cc:343] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:00.773438  8466 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.809044  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:00.810873  8470 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.877279  8470 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:00.907755  8928 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.918146  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:00.920536  8841 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:00.921376  8841 raft_consensus.cc:697] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:00.922190  8841 consensus_queue.cc:237] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.884316  8887 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:00.886742  8587 raft_consensus.cc:359] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.923614  8587 raft_consensus.cc:385] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:00.923900  8587 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:00.892570  8875 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:00.919546  8466 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
W20260709 12:26:00.880913  8954 log.cc:927] Time spent T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:26:00.924549  8587 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:00.933604  8587 ts_tablet_manager.cc:1434] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.168s	user 0.008s	sys 0.006s
I20260709 12:26:00.934450  8587 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:00.939529  8394 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:00.949839  8587 tablet_bootstrap.cc:654] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:00.964368  8293 catalog_manager.cc:5697] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:00.974112  8955 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.147s	user 0.002s	sys 0.002s
I20260709 12:26:01.038481  8966 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.040218  8590 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.040694  8590 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.049751  8295 catalog_manager.cc:5697] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.084918  8589 tablet_bootstrap.cc:492] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:01.085400  8589 ts_tablet_manager.cc:1403] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.365s	user 0.018s	sys 0.017s
I20260709 12:26:01.087456  8966 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.092543  8589 raft_consensus.cc:359] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.093856  8589 raft_consensus.cc:385] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.094201  8589 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.094869  8589 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.095304  8587 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:01.096302  8587 ts_tablet_manager.cc:1403] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.162s	user 0.019s	sys 0.001s
I20260709 12:26:01.096540  8589 ts_tablet_manager.cc:1434] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:01.097533  8589 tablet_bootstrap.cc:492] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:01.098922  8587 raft_consensus.cc:359] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.099602  8587 raft_consensus.cc:385] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.099856  8587 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.105109  8589 tablet_bootstrap.cc:654] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.111378  8887 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.111902  8887 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.112267  8587 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.113834  8887 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.115850  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.116577  8466 raft_consensus.cc:2393] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 1: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:01.127239  8590 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:01.152376  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:01.162424  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49989.1us
I20260709 12:26:01.169575  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:01.169344  8875 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:01.170981  8587 ts_tablet_manager.cc:1434] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.000s
I20260709 12:26:01.172402  8587 tablet_bootstrap.cc:492] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:01.174216  8545 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.184518  8850 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.186954  8589 tablet_bootstrap.cc:492] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:01.189333  8589 ts_tablet_manager.cc:1403] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.092s	user 0.012s	sys 0.024s
I20260709 12:26:01.191941  8589 raft_consensus.cc:359] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.198714  8589 raft_consensus.cc:385] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.199498  8589 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.200786  8589 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.204804  8589 ts_tablet_manager.cc:1434] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:26:01.208480  8589 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:01.208750  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.216135  8589 tablet_bootstrap.cc:654] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.217617  8587 tablet_bootstrap.cc:654] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.236913  8512 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:01.238013  8715 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.256973  8362 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:01.258921  8875 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.259440  8875 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.261346  8875 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.262760  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.263479  8470 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.264358  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.265038  8841 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.265419  8841 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.265739  8841 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.268532  8930 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.269037  8930 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.270489  8587 tablet_bootstrap.cc:492] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:01.270936  8587 ts_tablet_manager.cc:1403] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.099s	user 0.003s	sys 0.006s
I20260709 12:26:01.271224  8930 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:01.272650  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:01.273983  8968 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.273936  8841 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.276770  8589 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:01.277215  8589 ts_tablet_manager.cc:1403] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.069s	user 0.028s	sys 0.010s
I20260709 12:26:01.277315  8587 raft_consensus.cc:359] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.277974  8587 raft_consensus.cc:385] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.278373  8587 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.279021  8587 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.281570  8928 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:01.283114  8589 raft_consensus.cc:359] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.284804  8589 raft_consensus.cc:385] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.277863  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:01.286365  8470 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.291776  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:01.292424  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:01.293785  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.294514  8467 raft_consensus.cc:2393] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 1: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:01.295974  8587 ts_tablet_manager.cc:1434] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:26:01.285069  8589 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.296716  8589 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.292418  8394 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.299130  8362 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:01.299851  8590 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.278498  8841 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.303429  8589 ts_tablet_manager.cc:1434] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:26:01.304350  8589 tablet_bootstrap.cc:492] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:01.309453  8587 tablet_bootstrap.cc:492] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:01.315089  8587 tablet_bootstrap.cc:654] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.316445  8590 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:01.319494  8589 tablet_bootstrap.cc:654] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.327064  8590 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.331049  8470 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:01.332295  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:01.333766  8875 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.334233  8875 raft_consensus.cc:697] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:01.334987  8875 consensus_queue.cc:237] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.342384  8589 tablet_bootstrap.cc:492] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:01.342888  8589 ts_tablet_manager.cc:1403] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 12:26:01.345428  8589 raft_consensus.cc:359] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.346069  8589 raft_consensus.cc:385] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.346333  8589 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.346905  8589 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.350775  8589 ts_tablet_manager.cc:1434] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:26:01.353085  8587 tablet_bootstrap.cc:492] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:01.353523  8587 ts_tablet_manager.cc:1403] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 12:26:01.355964  8587 raft_consensus.cc:359] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.356598  8587 raft_consensus.cc:385] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.356841  8587 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.357442  8587 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.358450  8589 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Bootstrap starting.
I20260709 12:26:01.364318  8589 tablet_bootstrap.cc:654] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.367180  8587 ts_tablet_manager.cc:1434] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:26:01.367123  8928 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.367756  8928 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.369699  8928 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:01.370380  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.370743  8587 tablet_bootstrap.cc:492] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:01.370994  8470 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:01.372112  8362 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:01.373430  8590 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.373776  8590 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.374063  8590 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.378651  8587 tablet_bootstrap.cc:654] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.381613  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:01.382222  8545 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 0.
I20260709 12:26:01.381475  8959 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.388746  8587 tablet_bootstrap.cc:492] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:01.389246  8587 ts_tablet_manager.cc:1403] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.007s
I20260709 12:26:01.392163  8589 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: No bootstrap required, opened a new log
I20260709 12:26:01.392601  8589 ts_tablet_manager.cc:1403] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Time spent bootstrapping tablet: real 0.034s	user 0.004s	sys 0.008s
I20260709 12:26:01.395473  8589 raft_consensus.cc:359] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.396101  8589 raft_consensus.cc:385] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.396350  8589 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.397107  8589 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.399439  8589 ts_tablet_manager.cc:1434] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:01.401407  8587 raft_consensus.cc:359] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.401506  8590 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.402135  8587 raft_consensus.cc:385] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.402478  8587 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.403088  8587 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.405109  8587 ts_tablet_manager.cc:1434] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:01.405929  8587 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: Bootstrap starting.
I20260709 12:26:01.411281  8587 tablet_bootstrap.cc:654] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:01.416435  8587 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: No bootstrap required, opened a new log
I20260709 12:26:01.416851  8587 ts_tablet_manager.cc:1403] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:26:01.417526  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:01.418179  8467 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.419296  8587 raft_consensus.cc:359] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.419955  8587 raft_consensus.cc:385] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:01.420222  8587 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Initialized, Role: FOLLOWER
I20260709 12:26:01.420827  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:01.420893  8587 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.421419  8545 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.423753  8587 ts_tablet_manager.cc:1434] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:01.426177  8545 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:01.427336  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.428062  8928 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.428123  8590 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 1 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:01.428740  8928 raft_consensus.cc:697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:01.431770  8715 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.445344  8715 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.445643  8928 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.448366  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.448717  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:01.437866  8293 catalog_manager.cc:5697] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.448983  8468 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.450405  8511 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.447310  8715 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.450855  8392 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.451341  8715 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.451707  8715 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.452018  8715 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.453032  8875 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:01.461836  8715 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.468843  8715 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.469658  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:01.470270  8392 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.475445  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:01.476070  8468 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.475953  8292 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 0 to 1, leader changed from <none> to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.492784  8468 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:01.494262  8511 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.495087  8715 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.495586  8715 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:01.496331  8715 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:01.499128  8343 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:01.501876  8392 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:01.506985  8716 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.508697  8467 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:01.519887  8293 catalog_manager.cc:5697] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.678675  8887 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.679225  8887 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.681458  8887 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.682582  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:01.683286  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.683272  8392 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.683986  8465 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.685190  8512 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.686185  8887 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.686585  8887 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.686944  8887 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.694072  8887 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.695796  8887 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.696506  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:01.697032  8392 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.697032  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:01.697748  8465 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.700076  8887 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.700824  8887 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.703886  8887 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.704103  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:01.704722  8468 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.706341  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.706461  8392 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:01.707034  8887 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:01.707505  8887 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.707209  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:01.707849  8887 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.708284  8394 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 0.
I20260709 12:26:01.709106  8512 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.709894  8875 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.710357  8875 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:01.711108  8875 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.713992  8465 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:01.717885  8887 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.719534  8887 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:01.721282  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:01.721829  8394 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.725121  8294 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.727998  8394 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:01.728437  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:01.729068  8465 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.729131  8512 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:01.731148  8715 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:01.731650  8715 raft_consensus.cc:697] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:01.732416  8715 consensus_queue.cc:237] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:01.748661  8294 catalog_manager.cc:5697] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 0 to 1, leader changed from <none> to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.758378  8465 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:01.844843  8887 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.845232  8590 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.877905  8590 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:01.898250  8392 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:01.908778  8887 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.003604  8841 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.018883  8887 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.121912  8887 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.133013  8841 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.170684  8887 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:02.184935  8887 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:03.634321  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:03.652544  9004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.654379  9005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:03.657853  9007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:03.657923  7261 server_base.cc:1061] running on GCE node
I20260709 12:26:03.659391  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:03.659646  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:03.659835  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783599963659803 us; error 0 us; skew 500 ppm
I20260709 12:26:03.660457  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:03.666152  7261 webserver.cc:533] Webserver started at http://127.7.23.68:35087/ using document root <none> and password file <none>
I20260709 12:26:03.666762  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:03.666971  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:03.667286  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:03.668447  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-3-root/instance:
uuid: "e3660d999c0a41658a1f1dbe7cc90746"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ps85"
I20260709 12:26:03.674158  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:03.678011  9012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.678838  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:03.679131  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-3-root
uuid: "e3660d999c0a41658a1f1dbe7cc90746"
format_stamp: "Formatted at 2026-07-09 12:26:03 on dist-test-slave-ps85"
I20260709 12:26:03.679401  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:03.713856  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:03.715554  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:03.717557  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:03.720706  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:03.720885  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.721141  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:03.721302  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:03.811831  9074 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.68:37019 every 8 connection(s)
I20260709 12:26:03.812402  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.68:37019
I20260709 12:26:03.817725  7261 auto_leader_rebalancer-test.cc:439] add a tserver: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:03.849447  9075 heartbeater.cc:344] Connected to a master server at 127.7.23.126:36193
I20260709 12:26:03.849956  9075 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:03.850845  9075 heartbeater.cc:507] Master 127.7.23.126:36193 requested a full tablet report, sending...
I20260709 12:26:03.853072  8294 ts_manager.cc:194] Registered new tserver with Master: e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:03.854329  8294 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46076
I20260709 12:26:04.785436  8392 consensus_queue.cc:237] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:04.797150  8468 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:04.798797  8958 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:04.809078  8537 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:04.811000  8958 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:04.817199  8361 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2310aee96e77479c812917bfcb775d66. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:04.827576  9088 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:04.832937  8467 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:04.834834  8537 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:04.852826  8294 catalog_manager.cc:5697] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:04.857259  9075 heartbeater.cc:499] Master 127.7.23.126:36193 was elected leader, sending a full tablet report...
I20260709 12:26:04.903214  8537 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:04.945313  8465 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:04.946962  9085 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:04.955919  8392 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:04.957227  9085 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:26:04.981763  8510 consensus_peers.cc:597] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf567c52be7141c5b7edac250f385cc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:04.986074  8716 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:04.991747  8392 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.003949  8537 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.010015  8293 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.998034  8465 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:26:05.055394  8510 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 016be601898642f5bfd00376e81080bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.056219  8465 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.057735  8392 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.059216  9003 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:05.060176  9085 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.074368  9003 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.084594  8392 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.091212  8468 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.100410  8293 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.102804  8394 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:05.127532  8361 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ddabc2a2d42405c9f529c8489fdf71b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.128917  8468 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.129302  8542 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:05.130769  9097 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.131560  9088 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:05.140219  9097 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.142475  8468 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.144140  8542 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:05.159163  8292 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.201941  9112 ts_tablet_manager.cc:933] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:05.212728  9112 tablet_copy_client.cc:323] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:05.234500  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet 2310aee96e77479c812917bfcb775d66 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:05.235137  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet 2310aee96e77479c812917bfcb775d66 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-2310aee96e77479c812917bfcb775d66
I20260709 12:26:05.241657  8407 tablet_copy_source_session.cc:215] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:05.246951  9112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2310aee96e77479c812917bfcb775d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.266556  9112 tablet_copy_client.cc:806] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:05.267313  9112 tablet_copy_client.cc:670] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:05.271950  9112 tablet_copy_client.cc:538] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:05.280616  9112 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:05.322086  9112 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:05.323062  9112 tablet_bootstrap.cc:492] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:05.323734  9112 ts_tablet_manager.cc:1403] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.019s
I20260709 12:26:05.326704  9112 raft_consensus.cc:359] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.327534  9112 raft_consensus.cc:740] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:05.328209  9112 consensus_queue.cc:260] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.330960  9112 ts_tablet_manager.cc:1434] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 12:26:05.336199  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-2310aee96e77479c812917bfcb775d66 received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:05.336707  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-2310aee96e77479c812917bfcb775d66 on tablet 2310aee96e77479c812917bfcb775d66 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:05.478694  9112 ts_tablet_manager.cc:933] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:05.482400  9112 tablet_copy_client.cc:323] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:26:05.495811  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet bf567c52be7141c5b7edac250f385cc4 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:26:05.496376  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet bf567c52be7141c5b7edac250f385cc4 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-bf567c52be7141c5b7edac250f385cc4
I20260709 12:26:05.503885  8556 tablet_copy_source_session.cc:215] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:05.506999  9112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf567c52be7141c5b7edac250f385cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.526203  9112 tablet_copy_client.cc:806] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:05.526815  9112 tablet_copy_client.cc:670] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:05.536281  9112 tablet_copy_client.cc:538] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:05.545320  9112 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:05.567003  9112 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:05.567883  9112 tablet_bootstrap.cc:492] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:05.568526  9112 ts_tablet_manager.cc:1403] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.001s
I20260709 12:26:05.576896  9112 raft_consensus.cc:359] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.577800  9112 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:05.578509  9112 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.628129  9112 ts_tablet_manager.cc:1434] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:26:05.649000  8556 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-bf567c52be7141c5b7edac250f385cc4 received from {username='slave'} at 127.0.0.1:58406
I20260709 12:26:05.649461  8556 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-bf567c52be7141c5b7edac250f385cc4 on tablet bf567c52be7141c5b7edac250f385cc4 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:05.681901  9112 ts_tablet_manager.cc:933] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:05.690681  9112 tablet_copy_client.cc:323] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:26:05.693167  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet 016be601898642f5bfd00376e81080bd from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:26:05.693722  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet 016be601898642f5bfd00376e81080bd from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-016be601898642f5bfd00376e81080bd
I20260709 12:26:05.701401  8556 tablet_copy_source_session.cc:215] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:05.704735  9112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016be601898642f5bfd00376e81080bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.774237  9049 raft_consensus.cc:1217] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:05.810456  9128 ts_tablet_manager.cc:933] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:05.822729  9128 tablet_copy_client.cc:323] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:05.824555  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet 9ddabc2a2d42405c9f529c8489fdf71b from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:05.825074  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet 9ddabc2a2d42405c9f529c8489fdf71b from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-9ddabc2a2d42405c9f529c8489fdf71b
I20260709 12:26:05.826434  9112 tablet_copy_client.cc:806] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:05.826964  9112 tablet_copy_client.cc:670] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:05.832458  8407 tablet_copy_source_session.cc:215] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:05.835709  9128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ddabc2a2d42405c9f529c8489fdf71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:05.842942  9112 tablet_copy_client.cc:538] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:05.853394  9128 tablet_copy_client.cc:806] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:05.854056  9128 tablet_copy_client.cc:670] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:05.855894  9112 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:05.857707  9128 tablet_copy_client.cc:538] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:05.865860  9128 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:05.885069  9112 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:05.885952  9112 tablet_bootstrap.cc:492] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:05.886706  9112 ts_tablet_manager.cc:1403] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.004s
I20260709 12:26:05.889187  9112 raft_consensus.cc:359] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.889978  9112 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:05.890594  9112 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.896565  9128 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:05.897589  9128 tablet_bootstrap.cc:492] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:05.898304  9128 ts_tablet_manager.cc:1403] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.005s
I20260709 12:26:05.899631  9112 ts_tablet_manager.cc:1434] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.005s
I20260709 12:26:05.901235  9128 raft_consensus.cc:359] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.902159  9128 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:05.902823  9128 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:05.906451  9128 ts_tablet_manager.cc:1434] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:05.906508  8556 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-016be601898642f5bfd00376e81080bd received from {username='slave'} at 127.0.0.1:58406
I20260709 12:26:05.907003  8556 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-016be601898642f5bfd00376e81080bd on tablet 016be601898642f5bfd00376e81080bd with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:05.908326  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-9ddabc2a2d42405c9f529c8489fdf71b received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:05.908718  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-9ddabc2a2d42405c9f529c8489fdf71b on tablet 9ddabc2a2d42405c9f529c8489fdf71b with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:06.060294  9050 raft_consensus.cc:1217] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.078331  9050 raft_consensus.cc:1217] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.144860  9050 raft_consensus.cc:1217] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:06.299710  9129 raft_consensus.cc:1064] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:06.302466  9129 consensus_queue.cc:237] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:06.314630  9050 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.316457  8544 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.321257  9088 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.323916  9088 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.331516  8465 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.340660  9097 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.361822  9088 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.365592  8470 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.377482  9050 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.384760  8294 catalog_manager.cc:5697] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.401134  8542 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.431845  8396 consensus_queue.cc:237] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:06.437350  9050 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.438127  8470 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.440157  9097 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:06.447146  9138 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:06.448073  9129 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.451447  8470 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.451897  9050 raft_consensus.cc:2955] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.458427  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2310aee96e77479c812917bfcb775d66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:06.466962  8295 catalog_manager.cc:5697] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.482741  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet 2310aee96e77479c812917bfcb775d66 with delete_type TABLET_DATA_TOMBSTONED (TS aef8c9f023564378a04e3e1e6171930d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:06.490980  9143 tablet_replica.cc:333] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:26:06.491950  9143 raft_consensus.cc:2243] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:06.492522  9143 raft_consensus.cc:2272] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:06.495335  9143 ts_tablet_manager.cc:1916] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:06.507743  9143 ts_tablet_manager.cc:1929] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:06.508263  9143 log.cc:1199] T 2310aee96e77479c812917bfcb775d66 P aef8c9f023564378a04e3e1e6171930d: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/wals/2310aee96e77479c812917bfcb775d66
I20260709 12:26:06.509939  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet 2310aee96e77479c812917bfcb775d66 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:06.535676  9085 raft_consensus.cc:1064] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:06.538057  9085 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:06.545452  8470 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.545467  9050 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.546820  9085 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.547158  8396 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.547699  9003 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.548501  8716 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.571128  9003 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.573504  8465 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.579589  9050 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.586259  8396 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.591419  8716 raft_consensus.cc:1064] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:06.593386  8716 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:06.590559  8292 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.602938  8467 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.603631  9049 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.605669  9084 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:06.606827  9085 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.629055  8716 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.630651  9049 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.634282  8396 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.644912  9084 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:06.644484  8465 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.648152  8542 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:06.655691  8295 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.676446  9049 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.677672  9084 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:06.684613  8392 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.686313  9084 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:06.691751  8392 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.692304  8537 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:06.692096  9049 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.701442  8465 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.700416  9148 raft_consensus.cc:2955] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.702693  9085 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:06.704857  9129 raft_consensus.cc:1064] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:06.708523  9085 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.716264  8465 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.718942  8280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf567c52be7141c5b7edac250f385cc4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:06.718886  9129 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:06.731156  9049 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:06.732832  9085 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:06.733659  8396 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:26:06.783044  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 47928.8us
I20260709 12:26:06.784045  8294 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.788239  8295 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:06.887615  9049 raft_consensus.cc:2955] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:26:06.896680  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 88320.1us
W20260709 12:26:06.897619  9153 log.cc:927] Time spent T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:26:06.956588  9050 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:06.975152  9088 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:26:07.079906  8542 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.045854  8280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 016be601898642f5bfd00376e81080bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:26:07.095081  8280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 53581.5us
W20260709 12:26:07.130719  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 89222us
W20260709 12:26:07.132525  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 155648us
I20260709 12:26:07.139257  8458 tablet_service.cc:1558] Processing DeleteTablet for tablet 016be601898642f5bfd00376e81080bd with delete_type TABLET_DATA_TOMBSTONED (TS 2d99fb7f1afb4c958cdc302eb8ef165f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:07.169787  8385 tablet_service.cc:1558] Processing DeleteTablet for tablet bf567c52be7141c5b7edac250f385cc4 with delete_type TABLET_DATA_TOMBSTONED (TS 21c151c99bcf4cbeb819de06e68d95bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60370
I20260709 12:26:07.204916  9160 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:26:07.247568  8467 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:07.251294  9173 tablet_replica.cc:333] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:26:07.253152  9173 raft_consensus.cc:2243] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.253847  9173 raft_consensus.cc:2272] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.260670  9172 tablet_replica.cc:333] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:26:07.261747  9172 raft_consensus.cc:2243] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.262409  9172 raft_consensus.cc:2272] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.288246  9172 ts_tablet_manager.cc:1916] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.289184  9173 ts_tablet_manager.cc:1916] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:07.292675  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 84948.5us
W20260709 12:26:07.293418  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 77116.5us
W20260709 12:26:07.296964  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 89151.4us
I20260709 12:26:07.306514  9173 ts_tablet_manager.cc:1929] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.307098  9173 log.cc:1199] T bf567c52be7141c5b7edac250f385cc4 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/wals/bf567c52be7141c5b7edac250f385cc4
I20260709 12:26:07.317623  9159 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:07.320830  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 107660us
I20260709 12:26:07.323362  8282 catalog_manager.cc:5028] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): tablet bf567c52be7141c5b7edac250f385cc4 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:07.333408  9172 ts_tablet_manager.cc:1929] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.334806  9172 log.cc:1199] T 016be601898642f5bfd00376e81080bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/wals/016be601898642f5bfd00376e81080bd
I20260709 12:26:07.344026  8281 catalog_manager.cc:5028] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): tablet 016be601898642f5bfd00376e81080bd (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:07.364890  9178 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:07.370851  8537 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:07.377272  9049 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:07.383607  8292 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.370173  8469 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:07.404366  8393 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:07.412549  9049 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.413913  9155 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:07.415390  8469 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:07.420416  9159 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:07.423714  9155 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:07.429028  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ddabc2a2d42405c9f529c8489fdf71b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:07.429040  9049 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:07.430083  8469 raft_consensus.cc:2955] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:07.438143  8292 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:07.448832  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ddabc2a2d42405c9f529c8489fdf71b with delete_type TABLET_DATA_TOMBSTONED (TS aef8c9f023564378a04e3e1e6171930d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:07.451503  9181 tablet_replica.cc:333] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:26:07.452538  9181 raft_consensus.cc:2243] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:07.453197  9181 raft_consensus.cc:2272] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:07.457131  9181 ts_tablet_manager.cc:1916] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:07.468981  9181 ts_tablet_manager.cc:1929] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:07.469269  9181 log.cc:1199] T 9ddabc2a2d42405c9f529c8489fdf71b P aef8c9f023564378a04e3e1e6171930d: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/wals/9ddabc2a2d42405c9f529c8489fdf71b
I20260709 12:26:07.470643  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet 9ddabc2a2d42405c9f529c8489fdf71b (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:08.536296  8470 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:08.546206  8393 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.547369  9154 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.556655  8537 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.555961  9182 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.557930  9154 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.558517  8393 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.563812  8537 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.570096  8397 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:08.581238  8361 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abbf9b71c617406c9d2be1cd987a6a94. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.574963  8293 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:08.585376  8436 consensus_peers.cc:597] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7ae3eef998ef416f8ebd3e8c21b20834. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.595940  8537 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.596176  8469 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.597527  9192 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.598485  9178 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.608505  9178 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.613165  8537 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.623299  8397 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:08.627874  8469 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.634163  8292 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.651751  8544 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:08.652007  8361 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8974a3bbc8c3420f95c2b151405bd386. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.653043  9192 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.653553  8469 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.655159  9192 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:26:08.664587  9178 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.672326  8544 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.733065  8393 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:08.738680  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51377.9us
I20260709 12:26:08.748493  8294 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:08.764343  8361 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a231323db194487a6ca917e91cb1389. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:08.765570  8469 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.764895  8470 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.766927  8544 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:08.768756  9159 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.772718  9178 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:08.790449  9178 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.791524  8544 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.800532  8469 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:08.813897  8292 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:08.930622  9206 ts_tablet_manager.cc:933] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:08.934185  9206 tablet_copy_client.cc:323] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.66:41641
I20260709 12:26:08.944558  8482 tablet_copy_service.cc:140] P 2d99fb7f1afb4c958cdc302eb8ef165f: Received BeginTabletCopySession request for tablet 7ae3eef998ef416f8ebd3e8c21b20834 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:59088)
I20260709 12:26:08.945019  8482 tablet_copy_service.cc:161] P 2d99fb7f1afb4c958cdc302eb8ef165f: Beginning new tablet copy session on tablet 7ae3eef998ef416f8ebd3e8c21b20834 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:59088: session id = e3660d999c0a41658a1f1dbe7cc90746-7ae3eef998ef416f8ebd3e8c21b20834
I20260709 12:26:08.955068  8482 tablet_copy_source_session.cc:215] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:08.957911  9206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae3eef998ef416f8ebd3e8c21b20834. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:08.973935  9206 tablet_copy_client.cc:806] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:08.974546  9206 tablet_copy_client.cc:670] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:08.978514  9206 tablet_copy_client.cc:538] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:08.986794  9206 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:09.000260  9209 ts_tablet_manager.cc:933] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:09.004098  9209 tablet_copy_client.cc:323] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:09.005537  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet abbf9b71c617406c9d2be1cd987a6a94 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:09.006008  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet abbf9b71c617406c9d2be1cd987a6a94 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-abbf9b71c617406c9d2be1cd987a6a94
I20260709 12:26:09.006736  9206 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.007617  9206 tablet_bootstrap.cc:492] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:09.008742  9206 ts_tablet_manager.cc:1403] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.004s
I20260709 12:26:09.011704  8407 tablet_copy_source_session.cc:215] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.011665  9206 raft_consensus.cc:359] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.015532  9206 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:09.016252  9206 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.029332  9209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbf9b71c617406c9d2be1cd987a6a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.033612  9206 ts_tablet_manager.cc:1434] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 12:26:09.036141  8482 tablet_copy_service.cc:342] P 2d99fb7f1afb4c958cdc302eb8ef165f: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-7ae3eef998ef416f8ebd3e8c21b20834 received from {username='slave'} at 127.0.0.1:59088
I20260709 12:26:09.036577  8482 tablet_copy_service.cc:434] P 2d99fb7f1afb4c958cdc302eb8ef165f: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-7ae3eef998ef416f8ebd3e8c21b20834 on tablet 7ae3eef998ef416f8ebd3e8c21b20834 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:09.047313  9209 tablet_copy_client.cc:806] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.048866  9209 tablet_copy_client.cc:670] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.053066  9209 tablet_copy_client.cc:538] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.061918  9209 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:09.081972  9209 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.082717  9209 tablet_bootstrap.cc:492] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:09.083447  9209 ts_tablet_manager.cc:1403] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.008s
I20260709 12:26:09.085831  9209 raft_consensus.cc:359] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.086454  9209 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:09.087065  9209 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.088872  9209 ts_tablet_manager.cc:1434] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:09.090318  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-abbf9b71c617406c9d2be1cd987a6a94 received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:09.090646  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-abbf9b71c617406c9d2be1cd987a6a94 on tablet abbf9b71c617406c9d2be1cd987a6a94 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:09.098078  9209 ts_tablet_manager.cc:933] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:09.099553  9209 tablet_copy_client.cc:323] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:09.100788  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet 8974a3bbc8c3420f95c2b151405bd386 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:09.101177  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet 8974a3bbc8c3420f95c2b151405bd386 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-8974a3bbc8c3420f95c2b151405bd386
I20260709 12:26:09.106215  8407 tablet_copy_source_session.cc:215] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.108652  9209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8974a3bbc8c3420f95c2b151405bd386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.119385  9209 tablet_copy_client.cc:806] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.119908  9209 tablet_copy_client.cc:670] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.125113  9209 tablet_copy_client.cc:538] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.133775  9209 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:09.156158  9209 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.157006  9209 tablet_bootstrap.cc:492] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:09.157648  9209 ts_tablet_manager.cc:1403] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.010s
I20260709 12:26:09.160802  9209 raft_consensus.cc:359] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.161630  9209 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:09.162235  9209 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.164538  9209 ts_tablet_manager.cc:1434] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:26:09.166056  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-8974a3bbc8c3420f95c2b151405bd386 received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:09.166422  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-8974a3bbc8c3420f95c2b151405bd386 on tablet 8974a3bbc8c3420f95c2b151405bd386 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:09.253430  9209 ts_tablet_manager.cc:933] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:09.264127  9209 tablet_copy_client.cc:323] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:09.265643  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet 9a231323db194487a6ca917e91cb1389 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:09.266201  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet 9a231323db194487a6ca917e91cb1389 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-9a231323db194487a6ca917e91cb1389
I20260709 12:26:09.273452  8407 tablet_copy_source_session.cc:215] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:09.276157  9209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a231323db194487a6ca917e91cb1389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:09.286811  9209 tablet_copy_client.cc:806] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:09.287284  9209 tablet_copy_client.cc:670] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:09.290203  9209 tablet_copy_client.cc:538] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:09.296128  9209 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:09.311754  9209 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.312649  9209 tablet_bootstrap.cc:492] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:09.313259  9209 ts_tablet_manager.cc:1403] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.002s
I20260709 12:26:09.315984  9209 raft_consensus.cc:359] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.316740  9209 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:09.317171  9209 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:09.320981  9209 ts_tablet_manager.cc:1434] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:26:09.323932  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-9a231323db194487a6ca917e91cb1389 received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:09.324398  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-9a231323db194487a6ca917e91cb1389 on tablet 9a231323db194487a6ca917e91cb1389 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:09.460273  9048 raft_consensus.cc:1217] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:09.533159  9048 raft_consensus.cc:1217] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:09.714012  9048 raft_consensus.cc:1217] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:09.745807  9048 raft_consensus.cc:1217] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:09.981775  9182 raft_consensus.cc:1064] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:09.983636  9182 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:09.990015  9048 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:09.993296  9220 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:09.995512  8396 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:09.999578  9222 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.008540  8544 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.020013  9220 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.022085  9219 raft_consensus.cc:1064] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:10.029240  9219 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:10.054461  9223 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.062361  8470 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.063529  8393 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.065403  9178 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.064738  9049 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.070422  8544 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.075934  9048 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.076393  9178 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.080852  9178 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:10.085311  8544 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.088778  8294 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.118640  9048 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.116017  9219 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.143222  8471 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.147461  8537 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.167703  8471 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:10.169416  8295 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.187525  9048 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.187877  8537 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.189610  9182 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.191256  9182 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.191270  8394 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:10.197963  9050 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.199039  8542 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.199688  9178 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:10.200583  9220 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.206295  9178 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.205905  9050 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.213428  9219 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.223868  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abbf9b71c617406c9d2be1cd987a6a94 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.218473  9049 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.225521  8542 raft_consensus.cc:2955] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.239813  8544 raft_consensus.cc:2955] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.239194  8292 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.251226  8294 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.253439  8281 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7ae3eef998ef416f8ebd3e8c21b20834 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.257627  8458 tablet_service.cc:1558] Processing DeleteTablet for tablet abbf9b71c617406c9d2be1cd987a6a94 with delete_type TABLET_DATA_TOMBSTONED (TS 2d99fb7f1afb4c958cdc302eb8ef165f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:10.278927  8385 tablet_service.cc:1558] Processing DeleteTablet for tablet 7ae3eef998ef416f8ebd3e8c21b20834 with delete_type TABLET_DATA_TOMBSTONED (TS 21c151c99bcf4cbeb819de06e68d95bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60370
I20260709 12:26:10.281322  9236 tablet_replica.cc:333] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:26:10.282275  9236 raft_consensus.cc:2243] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.282852  9236 raft_consensus.cc:2272] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.283466  9159 raft_consensus.cc:1064] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:10.286100  9236 ts_tablet_manager.cc:1916] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.285961  9159 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:10.292542  9192 raft_consensus.cc:1064] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:10.295048  9192 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:10.314313  9236 ts_tablet_manager.cc:1929] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.314862  9236 log.cc:1199] T abbf9b71c617406c9d2be1cd987a6a94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/wals/abbf9b71c617406c9d2be1cd987a6a94
I20260709 12:26:10.316380  8281 catalog_manager.cc:5028] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): tablet abbf9b71c617406c9d2be1cd987a6a94 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:10.321537  9049 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.327329  9178 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.329238  9237 tablet_replica.cc:333] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:26:10.331550  9237 raft_consensus.cc:2243] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.332345  9237 raft_consensus.cc:2272] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.333179  8542 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.335783  9049 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.336714  8469 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.337416  9237 ts_tablet_manager.cc:1916] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.340193  9240 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.343560  9240 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.344234  8542 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.353880  9192 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.358134  9237 ts_tablet_manager.cc:1929] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.358672  9237 log.cc:1199] T 7ae3eef998ef416f8ebd3e8c21b20834 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/wals/7ae3eef998ef416f8ebd3e8c21b20834
I20260709 12:26:10.360021  9192 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.376397  8282 catalog_manager.cc:5028] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): tablet 7ae3eef998ef416f8ebd3e8c21b20834 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:10.380278  8471 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:10.383805  9192 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:10.386754  9219 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.390237  8542 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.397761  9049 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.401284  9240 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.403420  8295 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.405930  9050 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.425367  8471 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.425923  8294 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.429785  8542 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.448047  8471 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.476845  8393 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:10.477253  8396 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:10.482232  9049 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.483669  9050 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.483742  8471 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.485845  9192 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.486315  9249 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.487469  9192 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.488013  8542 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:10.490377  9249 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:10.494407  9248 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.495957  8470 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.502250  9178 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.507236  9049 raft_consensus.cc:2955] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.509261  9050 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.518425  8295 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.518653  8542 raft_consensus.cc:2955] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.521554  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a231323db194487a6ca917e91cb1389 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.526866  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8974a3bbc8c3420f95c2b151405bd386 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:10.529520  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a231323db194487a6ca917e91cb1389 with delete_type TABLET_DATA_TOMBSTONED (TS aef8c9f023564378a04e3e1e6171930d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:10.543319  8294 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:10.545081  9250 tablet_replica.cc:333] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:26:10.546087  9250 raft_consensus.cc:2243] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.546720  9250 raft_consensus.cc:2272] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.549619  9250 ts_tablet_manager.cc:1916] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.553586  8458 tablet_service.cc:1558] Processing DeleteTablet for tablet 8974a3bbc8c3420f95c2b151405bd386 with delete_type TABLET_DATA_TOMBSTONED (TS 2d99fb7f1afb4c958cdc302eb8ef165f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:10.554502  9236 tablet_replica.cc:333] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:26:10.555505  9236 raft_consensus.cc:2243] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:10.556135  9236 raft_consensus.cc:2272] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:10.559140  9236 ts_tablet_manager.cc:1916] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:10.565187  9250 ts_tablet_manager.cc:1929] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.565630  9250 log.cc:1199] T 9a231323db194487a6ca917e91cb1389 P aef8c9f023564378a04e3e1e6171930d: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/wals/9a231323db194487a6ca917e91cb1389
I20260709 12:26:10.567250  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet 9a231323db194487a6ca917e91cb1389 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:10.577280  9236 ts_tablet_manager.cc:1929] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:10.577646  9236 log.cc:1199] T 8974a3bbc8c3420f95c2b151405bd386 P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/wals/8974a3bbc8c3420f95c2b151405bd386
I20260709 12:26:10.578830  8281 catalog_manager.cc:5028] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): tablet 8974a3bbc8c3420f95c2b151405bd386 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:11.617448  8544 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:11.623862  8510 consensus_peers.cc:597] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3541cfbddb54a3dbef569666e60ffb4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.624372  8471 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.624671  8396 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.625452  9252 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.626106  9175 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.635954  9251 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.637228  8393 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.651772  8295 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.652114  8471 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.656597  8396 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:11.677197  8361 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a180f2cda394b6eb7ca0ecbbc583c75. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.679999  8542 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.681720  9249 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.682550  8470 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.683635  9249 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.693117  9249 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.694394  8542 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.698546  8472 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.713335  8542 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:11.717869  8294 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:11.730613  8510 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4c2e2eb7e2ca4c688fde6389b1c6a4ee. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.732782  8472 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.733233  8396 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.734742  9175 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.737808  9175 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.742825  9251 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.744441  8396 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.748171  8471 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.758562  8292 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.758966  8472 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:11.768494  8436 consensus_peers.cc:597] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2739228b32f48d7a73d1704fa1bfe5b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:11.768980  8542 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.769379  8396 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:11.770306  9258 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.771122  9261 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:11.780602  9258 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.782235  8393 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.801115  8294 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:11.806039  8542 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:12.046342  9274 ts_tablet_manager.cc:933] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:12.048166  9274 tablet_copy_client.cc:323] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:26:12.050004  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet d3541cfbddb54a3dbef569666e60ffb4 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:26:12.050491  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet d3541cfbddb54a3dbef569666e60ffb4 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-d3541cfbddb54a3dbef569666e60ffb4
I20260709 12:26:12.055341  8556 tablet_copy_source_session.cc:215] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.058074  9274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3541cfbddb54a3dbef569666e60ffb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.072079  9274 tablet_copy_client.cc:806] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.072656  9274 tablet_copy_client.cc:670] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.075970  9274 tablet_copy_client.cc:538] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.082221  9274 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:12.098004  9274 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.098670  9274 tablet_bootstrap.cc:492] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:12.099212  9274 ts_tablet_manager.cc:1403] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:26:12.101967  9274 raft_consensus.cc:359] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.102689  9274 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:12.103327  9274 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.109155  9274 ts_tablet_manager.cc:1434] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:26:12.110766  8556 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-d3541cfbddb54a3dbef569666e60ffb4 received from {username='slave'} at 127.0.0.1:58406
I20260709 12:26:12.111284  8556 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-d3541cfbddb54a3dbef569666e60ffb4 on tablet d3541cfbddb54a3dbef569666e60ffb4 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:12.136603  9274 ts_tablet_manager.cc:933] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:12.139855  9274 tablet_copy_client.cc:323] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:26:12.141969  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:26:12.142377  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-4c2e2eb7e2ca4c688fde6389b1c6a4ee
I20260709 12:26:12.147048  8556 tablet_copy_source_session.cc:215] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.149562  9274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.160145  9274 tablet_copy_client.cc:806] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.160709  9274 tablet_copy_client.cc:670] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.166110  9274 tablet_copy_client.cc:538] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.174266  9274 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:12.185523  9279 ts_tablet_manager.cc:933] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:12.195061  9279 tablet_copy_client.cc:323] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.66:41641
I20260709 12:26:12.196794  8482 tablet_copy_service.cc:140] P 2d99fb7f1afb4c958cdc302eb8ef165f: Received BeginTabletCopySession request for tablet f2739228b32f48d7a73d1704fa1bfe5b from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:59088)
I20260709 12:26:12.197325  8482 tablet_copy_service.cc:161] P 2d99fb7f1afb4c958cdc302eb8ef165f: Beginning new tablet copy session on tablet f2739228b32f48d7a73d1704fa1bfe5b from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:59088: session id = e3660d999c0a41658a1f1dbe7cc90746-f2739228b32f48d7a73d1704fa1bfe5b
I20260709 12:26:12.201678  9274 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.202605  9274 tablet_bootstrap.cc:492] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:12.203253  9274 ts_tablet_manager.cc:1403] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.010s
I20260709 12:26:12.206389  8482 tablet_copy_source_session.cc:215] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.207357  9274 raft_consensus.cc:359] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.208209  9274 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:12.208850  9274 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.209801  9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2739228b32f48d7a73d1704fa1bfe5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.214018  9274 ts_tablet_manager.cc:1434] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.003s
I20260709 12:26:12.216625  8556 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-4c2e2eb7e2ca4c688fde6389b1c6a4ee received from {username='slave'} at 127.0.0.1:58406
I20260709 12:26:12.217001  8556 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-4c2e2eb7e2ca4c688fde6389b1c6a4ee on tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:12.226553  9274 ts_tablet_manager.cc:933] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:12.228642  9274 tablet_copy_client.cc:323] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:12.230093  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet 6a180f2cda394b6eb7ca0ecbbc583c75 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:12.230664  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet 6a180f2cda394b6eb7ca0ecbbc583c75 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-6a180f2cda394b6eb7ca0ecbbc583c75
I20260709 12:26:12.232784  9279 tablet_copy_client.cc:806] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.233322  9279 tablet_copy_client.cc:670] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.236235  9279 tablet_copy_client.cc:538] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.237526  8407 tablet_copy_source_session.cc:215] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:12.240854  9274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a180f2cda394b6eb7ca0ecbbc583c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:12.243671  9279 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:12.256361  9274 tablet_copy_client.cc:806] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:12.256932  9274 tablet_copy_client.cc:670] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:12.261231  9274 tablet_copy_client.cc:538] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:12.262100  9279 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.262741  9279 tablet_bootstrap.cc:492] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:12.263298  9279 ts_tablet_manager.cc:1403] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.008s
I20260709 12:26:12.265937  9279 raft_consensus.cc:359] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.266662  9279 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:12.267329  9279 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.269845  9274 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:12.269856  9279 ts_tablet_manager.cc:1434] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:12.272800  8482 tablet_copy_service.cc:342] P 2d99fb7f1afb4c958cdc302eb8ef165f: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-f2739228b32f48d7a73d1704fa1bfe5b received from {username='slave'} at 127.0.0.1:59088
I20260709 12:26:12.273211  8482 tablet_copy_service.cc:434] P 2d99fb7f1afb4c958cdc302eb8ef165f: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-f2739228b32f48d7a73d1704fa1bfe5b on tablet f2739228b32f48d7a73d1704fa1bfe5b with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:12.295439  9274 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:12.296136  9274 tablet_bootstrap.cc:492] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:12.296938  9274 ts_tablet_manager.cc:1403] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.027s	user 0.026s	sys 0.000s
I20260709 12:26:12.299321  9274 raft_consensus.cc:359] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.300107  9274 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:12.300675  9274 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:12.302661  9274 ts_tablet_manager.cc:1434] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:12.304324  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-6a180f2cda394b6eb7ca0ecbbc583c75 received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:12.304726  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-6a180f2cda394b6eb7ca0ecbbc583c75 on tablet 6a180f2cda394b6eb7ca0ecbbc583c75 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:12.631951  9050 raft_consensus.cc:1217] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:12.649572  9050 raft_consensus.cc:1217] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:12.663090  9050 raft_consensus.cc:1217] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:12.679999  9050 raft_consensus.cc:1217] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:13.096288  9286 raft_consensus.cc:1064] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:13.098071  9286 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.103804  9050 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.104657  8471 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.105315  9286 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.106294  8393 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.109688  9251 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.111140  9290 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.120085  9251 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.122999  8393 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.132174  8472 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.139586  9050 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.141788  8295 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.150529  9289 raft_consensus.cc:1064] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:13.153046  9289 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.157512  9175 raft_consensus.cc:1064] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:13.159749  9175 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.167784  9050 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.172516  8537 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.172371  9288 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.174023  9287 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.198463  9049 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.200289  9251 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.200759  8472 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.203941  8393 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.206080  9251 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.208801  9290 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.217546  8396 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.219236  9287 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:13.252991  9297 log.cc:927] Time spent T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:26:13.256776  9249 raft_consensus.cc:1064] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:13.259995  9249 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.266000  9251 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.283653  9289 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.290342  8542 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.292940  8393 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.299798  9050 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.309077  8472 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.321712  9049 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.334787  8393 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.343241  8471 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.344844  9050 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.344947  9298 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.346172  8542 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:13.347811  9285 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:13.354632  9268 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:13.360630  8292 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.362813  8292 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.370657  8537 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.377728  9050 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.380072  8472 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.380203  9309 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.385161  9310 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.394065  9308 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.404019  8470 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.407382  9049 raft_consensus.cc:2955] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.403093  8472 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.408948  8537 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.414526  9048 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.415400  8537 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.416896  8393 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.418010  9289 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.422605  8280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3541cfbddb54a3dbef569666e60ffb4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.423727  9285 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.416580  9050 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.428957  9287 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.424561  9286 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.436049  9287 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.436856  9310 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.421901  8292 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.442255  8544 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.442912  9048 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.453536  9049 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.457860  8537 raft_consensus.cc:2955] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.467141  8281 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2739228b32f48d7a73d1704fa1bfe5b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.465309  9309 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.475874  9047 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.480201  8295 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.500428  8294 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.501919  8294 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 1 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.508128  8280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.509076  8385 tablet_service.cc:1558] Processing DeleteTablet for tablet d3541cfbddb54a3dbef569666e60ffb4 with delete_type TABLET_DATA_TOMBSTONED (TS 21c151c99bcf4cbeb819de06e68d95bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60370
I20260709 12:26:13.515965  8394 raft_consensus.cc:2955] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.518112  9317 tablet_replica.cc:333] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:26:13.527089  8458 tablet_service.cc:1558] Processing DeleteTablet for tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee with delete_type TABLET_DATA_TOMBSTONED (TS 2d99fb7f1afb4c958cdc302eb8ef165f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:13.540445  9318 tablet_replica.cc:333] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:26:13.540300  8385 tablet_service.cc:1558] Processing DeleteTablet for tablet f2739228b32f48d7a73d1704fa1bfe5b with delete_type TABLET_DATA_TOMBSTONED (TS 21c151c99bcf4cbeb819de06e68d95bf not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60370
I20260709 12:26:13.546885  9317 raft_consensus.cc:2243] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.547689  9317 raft_consensus.cc:2272] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.551155  9317 ts_tablet_manager.cc:1916] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.554643  9318 raft_consensus.cc:2243] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.555526  9318 raft_consensus.cc:2272] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.563984  9318 ts_tablet_manager.cc:1916] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.574189  8469 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.592860  9317 ts_tablet_manager.cc:1929] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:13.593384  9317 log.cc:1199] T d3541cfbddb54a3dbef569666e60ffb4 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/wals/d3541cfbddb54a3dbef569666e60ffb4
I20260709 12:26:13.595129  8392 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:13.599715  9047 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.601094  9268 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.601518  8471 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:13.603664  9285 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:13.606631  9318 ts_tablet_manager.cc:1929] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:13.607141  9318 log.cc:1199] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/wals/4c2e2eb7e2ca4c688fde6389b1c6a4ee
I20260709 12:26:13.607827  9317 tablet_replica.cc:333] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:26:13.608767  8281 catalog_manager.cc:5028] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): tablet 4c2e2eb7e2ca4c688fde6389b1c6a4ee (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:13.608933  9248 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.610906  9317 raft_consensus.cc:2243] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.612092  9047 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.613437  8282 catalog_manager.cc:5028] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): tablet d3541cfbddb54a3dbef569666e60ffb4 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:13.612946  9317 raft_consensus.cc:2272] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.624017  9317 ts_tablet_manager.cc:1916] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.626953  8471 raft_consensus.cc:2955] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:13.631995  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a180f2cda394b6eb7ca0ecbbc583c75 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.645344  8292 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.650765  9317 ts_tablet_manager.cc:1929] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:13.651288  9317 log.cc:1199] T f2739228b32f48d7a73d1704fa1bfe5b P 21c151c99bcf4cbeb819de06e68d95bf: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/wals/f2739228b32f48d7a73d1704fa1bfe5b
I20260709 12:26:13.652788  8282 catalog_manager.cc:5028] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): tablet f2739228b32f48d7a73d1704fa1bfe5b (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:13.657586  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a180f2cda394b6eb7ca0ecbbc583c75 with delete_type TABLET_DATA_TOMBSTONED (TS aef8c9f023564378a04e3e1e6171930d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:13.660748  9319 tablet_replica.cc:333] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:26:13.661703  9319 raft_consensus.cc:2243] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:13.662559  9319 raft_consensus.cc:2272] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:13.665716  9319 ts_tablet_manager.cc:1916] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:13.679190  9319 ts_tablet_manager.cc:1929] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:13.679560  9319 log.cc:1199] T 6a180f2cda394b6eb7ca0ecbbc583c75 P aef8c9f023564378a04e3e1e6171930d: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/wals/6a180f2cda394b6eb7ca0ecbbc583c75
I20260709 12:26:13.680707  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet 6a180f2cda394b6eb7ca0ecbbc583c75 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:14.783160  8542 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:14.790079  8469 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:14.790721  8393 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:26:14.791999  8510 consensus_peers.cc:597] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fea9eaca8b50473cb6788b0928b3f8c4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:14.792012  9310 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:14.793035  9327 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:14.800989  9310 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:14.802582  8469 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:14.821638  8394 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:14.821719  8294 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:14.826156  8393 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:26:14.840092  8361 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7de1dd05702461da4c0319fda01a7ca. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:14.841614  8464 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:14.842586  8542 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:14.843874  9324 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:14.847000  9248 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:14.871644  9323 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:14.880785  8464 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:14.902954  8293 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:14.902748  8542 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:14.922137  8394 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:14.938306  8361 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df155d204dc041d7b2ce5467f8825efd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:14.940719  8545 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:14.942314  8464 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:14.956003  9323 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:14.959237  9323 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:15.354779  9342 ts_tablet_manager.cc:933] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:15.398139  9342 tablet_copy_client.cc:323] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:26:16.390749  9344 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.391551  9344 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.393884  9344 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.396587  9345 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.509598  9345 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.511816  9345 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.425259  9346 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.513464  9346 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.515147  9359 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.469293  9349 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.488327  9354 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.495486  9351 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.434617  9347 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.515782  9346 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.535673  9346 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.541170  9354 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.535602  9351 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.547852  9346 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.550063  9346 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.536244  9349 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.536259  9347 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.527158  9344 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.570452  9349 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.572724  9356 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.573269  9356 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.576640  9354 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.571115  9353 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.578298  9347 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.578640  9353 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.579540  9357 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.580118  9357 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:16.779660  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2700 after lost signal to thread 7264
I20260709 12:26:16.549957  9351 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.781607  9348 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.782070  9351 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.782686  9351 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.515874  9359 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:16.842273  9356 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.782231  9348 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.781563  9357 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.847910  9345 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.848335  9351 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.848644  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 840) took 1535 ms. Trace:
I20260709 12:26:16.848469  9345 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.849089  8469 rpcz_store.cc:276] 0709 12:26:15.312887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:16.847829 (+1534942us) service_pool.cc:224] Handling call
0709 12:26:16.848122 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:16.848316 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:16.848340 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:16.848379 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:16.848407 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:16.848484 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:16.848592 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:16.850445  9350 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.850570  9345 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.844255  9346 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.868744  9359 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.868865  9353 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.851092  9350 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.845611  9349 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.844017  9344 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:16.902833  9347 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.906016  9353 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.909092  9349 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.910363  9353 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:16.911612  9348 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.912595  9353 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.875092  9351 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.914232  9349 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.913945  9360 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.914873  9352 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.903785  9361 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.917999  9360 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:16.918464  9344 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:16.891753  9346 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.917433  9347 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.921778  9358 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.910373  9355 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.923233  9368 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.923615  9356 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.925042  9364 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.925442  9353 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.928905  9330 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.922546  9361 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:16.933137  9360 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:16.933636  9360 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.934121  9345 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.934437  9354 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.927176  9321 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.934646  9345 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.934950  9354 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:16.923838  9348 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.921339  9351 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.938109  9365 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.939107  9351 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.939276  9362 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:16.929651  9357 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.935119  9321 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.941617  9362 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.946364  9347 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.939627  9356 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.941413  9330 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.934089  9360 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.943030  9354 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.948972  9351 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.929229  9364 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.936757  9358 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.942324  9348 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.930435  9355 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.938751  9365 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.950304  9350 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.937342  9368 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.960238  9361 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.962071  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 847) took 1646 ms. Trace:
I20260709 12:26:16.962227  9355 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.962800  9351 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:16.962867  9348 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.963779  9321 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.971302  9321 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.971890  9321 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:16.972520  9358 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.952133  9357 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.973918  9321 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:16.974025  9360 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:16.974366  9357 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.974442  9321 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.943568  9353 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:16.923791  9352 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.955969  9346 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.968541  9356 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.958961  9345 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:16.960721  9363 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:16.969017  9367 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:16.980011  9365 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:16.971323  9368 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.103699  9352 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.104786  9364 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.105891  9353 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:16.968909  9330 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.106752  9363 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:16.978083  9321 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:16.967779  8466 rpcz_store.cc:276] 0709 12:26:15.315094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.315344 (+   250us) service_pool.cc:224] Handling call
0709 12:26:16.960256 (+1644912us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b58001c7198. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264f8c 00007f6461264ef6 000000000036eb39 00007f64692d81e0 00007f64693a10c4 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:16.960400 (+   144us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:16.961592 (+  1192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:16.961624 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:16.961668 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:16.961699 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:16.961776 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:16.961911 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293942016}
I20260709 12:26:17.210891  9351 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.124442  9330 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.211639  9330 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:17.216781  9321 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.217084  9361 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.217839  9359 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.220310  9363 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.221786  9330 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.225576  9359 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.213145  9362 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.227295  9321 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.233161  9353 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.233224  9359 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.222291  9361 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.212558  9366 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.201939  9367 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.235523  9373 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.245994  9373 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.246891  9367 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.252568  8292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 203) took 2311 ms. Trace:
I20260709 12:26:17.235929  9359 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.253180  9359 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.235880  9321 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.253664  9323 raft_consensus.cc:2955] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:17.255761  9359 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.256240  9321 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.257521  9321 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.236241  9353 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.236367  9364 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.234799  9369 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.262173  9364 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.263681  9356 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.252938  8292 rpcz_store.cc:276] 0709 12:26:14.926445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.926605 (+   160us) service_pool.cc:224] Handling call
0709 12:26:17.237634 (+2311029us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1666,"reported_tablets":1}
I20260709 12:26:17.252108  9363 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.267311  9356 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.267619  9363 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.269304  9356 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.269570  9363 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.270709  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 846) took 1936 ms. Trace:
I20260709 12:26:17.270771  9361 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.260106  9366 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.259948  9353 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.271114  8467 rpcz_store.cc:276] 0709 12:26:15.314772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.316086 (+  1314us) service_pool.cc:224] Handling call
0709 12:26:17.247434 (+1931348us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b58001c7198. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:17.247628 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:17.247791 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.247817 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:17.247851 (+    34us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:17.247875 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:17.247924 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:17.251469 (+  3545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9344896}
I20260709 12:26:17.269778  9356 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.274389  9359 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.285940  9370 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.277060  9361 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.274684  9330 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.273212  9352 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.284700  9374 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.280367  9360 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.288812  9363 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.290019  9370 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.291836  9364 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.273643  9321 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.262343  9369 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:17.292244  9352 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.292640  9330 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.286227  9356 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.291916  9359 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.291126  9353 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.299448  9370 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.295332  9366 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.299678  9364 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.303550  9371 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.307685  9353 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.308326  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.297497  9363 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.290745  9361 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.300884  9365 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.320990  9364 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.292876  9360 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.321724  9372 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.297443  9373 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.296545  9374 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.310600  9370 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.336217  9373 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.331084  9363 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.339499  9370 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.340153  9363 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.340179  9373 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.341027  9363 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.341707  9370 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.333639  9371 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.343003  9363 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.343514  9363 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.343621  9373 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.344230  9373 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.343989  9363 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.344725  9353 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.329636  9352 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.344687  9372 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.354223  9361 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.363904  9356 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.330598  9365 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.344461  9371 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.348397  9364 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.347308  9370 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.346748  9378 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.367348  9375 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.367448  9359 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.350342  9373 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.370445  9360 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.354189  9376 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.372364  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.376045  8390 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:17.365847  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.369163  9321 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.368464  9356 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.379784  9365 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.382372  9369 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.384665  9353 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.371589  9370 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.381156  9016 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:17.410125  9382 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.388563  9356 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.378836  9364 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.409355  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.385110  9353 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.448876  9049 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:17.379503  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.409484  9371 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.449371  9359 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.417809  9382 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.450953  9366 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.379235  9378 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.377517  9376 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.372486  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.418715  9375 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.535082  9359 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.452556  9364 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.539255  9352 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.585711  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.577466  9365 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.577316  9381 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.591229  8467 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.579705  9321 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.577198  8388 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:17.540753  9372 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.541383  9366 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:17.607821  8418 debug-util.cc:398] Leaking SignalData structure 0x7b080009a760 after lost signal to thread 8329
W20260709 12:26:17.608206  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08000ccc00 after lost signal to thread 8343
I20260709 12:26:17.609030  9366 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:17.609261  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac320 after lost signal to thread 8421
I20260709 12:26:17.586458  9359 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.583545  9360 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.584580  9363 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.604105  9321 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.605991  9372 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.606130  9356 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.606621  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.606621  9380 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.607182  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.579546  9371 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.614010  9323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50334 (request call id 7) took 2676 ms. Trace:
I20260709 12:26:17.633704  9380 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.627442  9323 rpcz_store.cc:276] 0709 12:26:14.919736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.919901 (+   165us) service_pool.cc:224] Handling call
0709 12:26:14.930438 (+ 10537us) log.cc:844] Serialized 492 byte log entry
0709 12:26:17.595620 (+2665182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1573,"raft.queue_time_us":2408,"raft.run_cpu_time_us":1772,"raft.run_wall_time_us":6050,"thread_start_us":2929,"threads_started":1,"wal-append.queue_time_us":1079,"wal-append.run_cpu_time_us":28497,"wal-append.run_wall_time_us":2329490}
I20260709 12:26:17.635773  9380 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.636512  9370 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.636725  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 842) took 2323 ms. Trace:
I20260709 12:26:17.610453  9365 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.637200  8464 rpcz_store.cc:276] 0709 12:26:15.313542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.315726 (+  2184us) service_pool.cc:224] Handling call
0709 12:26:17.634919 (+2319193us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b58001c7198. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:17.635115 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:17.635315 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.635345 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:17.635388 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:17.636435 (+  1047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:17.636512 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:17.636643 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6406016}
I20260709 12:26:17.640228  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.640717  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.641363  8470 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.642432  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.642724  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.643575  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.643880  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.650892  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.629771  9360 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:17.652566  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.640784  8472 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.656349  8468 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.627302  9372 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.590404  9352 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.611968  9381 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.632530  9373 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.669708  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.660899  9353 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.670307  8470 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
W20260709 12:26:17.665896  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 213757us
I20260709 12:26:17.663944  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.672370  9364 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.673421  8463 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.674253  9381 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.674734  9353 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.675242  9353 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.677215  9353 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.677459  9374 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.678241  9321 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.672647  9356 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.679127  9356 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.679993  8389 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:17.665302  9378 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.674340  9371 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.667151  9380 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.682535  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.709125  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.710721  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.711155  9375 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.712666  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.713855  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.714048  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.714895  8470 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.690164  9372 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.690033  8394 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.721316  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.719091  8510 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:17.715575  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.681038  9356 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.684329  9378 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.724198  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.684032  9365 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.685508  9360 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.687212  9382 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.687829  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.717201  9375 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.680920  9352 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.731683  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.732079  9382 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.732251  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.732636  9382 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.732856  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.727286  9371 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.729808  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.729717  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.733408  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.734498  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.734717  9371 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:17.735163  9371 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.735224  9382 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.735574  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.730347  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.731426  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.723331  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.736721  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.738667  9364 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.687023  9380 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.736295  9378 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.746834  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.750698  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.727582  9376 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.757179  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.758426  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.753618  9364 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.759001  8472 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.765520  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.766520  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.767127  8546 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.731690  9375 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.739235  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.763630  9389 ts_tablet_manager.cc:933] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:17.769949  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.771750  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.771903  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.772608  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.780190  8395 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.772791  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.779825  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.773346  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.773358  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.775250  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.775547  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.775663  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.769956  9378 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.776360  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.769376  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.779604  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.786662  8469 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
W20260709 12:26:17.781302  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800309c60 after lost signal to thread 8496
I20260709 12:26:17.782282  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.787724  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.788404  8539 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.784751  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.784183  8545 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.786203  8472 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.788769  9330 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.789309  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.790601  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.791186  9387 ts_tablet_manager.cc:933] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:17.791707  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.792096  9380 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.792749  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.793107  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.793277  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.793777  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.793304  9364 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.788831  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.781790  8544 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.789366  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.796657  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.797758  8463 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.794898  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.796727  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.799320  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.801280  8546 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.804601  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.792317  9016 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:17.805294  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.805692  9374 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.807092  9374 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.807325  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.807489  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.806661  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:17.808490  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800304b40 after lost signal to thread 8570
I20260709 12:26:17.808933  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:17.808796  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800257820 after lost signal to thread 8571
I20260709 12:26:17.809232  8546 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.806653  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.809319  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.807483  9374 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.808835  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.811019  8542 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.805948  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.816855  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.817675  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.819236  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.819566  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.819816  8472 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.820132  8463 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.820940  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.821466  8472 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.822739  8438 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:17.823767  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.824494  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:17.810416  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9600 after lost signal to thread 9074
I20260709 12:26:17.831193  9374 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.799147  9359 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.825563  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.827585  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.828056  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.836050  9048 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 2: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:17.836230  8466 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:17.836598  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.828804  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 179) took 2486 ms. Trace:
I20260709 12:26:17.837636  8293 rpcz_store.cc:276] 0709 12:26:15.342653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.342809 (+   156us) service_pool.cc:224] Handling call
0709 12:26:17.828748 (+2485939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1890730,"reported_tablets":1}
I20260709 12:26:17.837915  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.836179  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.831674  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.832152  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.828953  8472 raft_consensus.cc:2955] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:17.833447  9369 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.827385  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.839133  9369 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.839597  9369 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.840175  9359 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.842208  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:17.834407  8511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.001s	sys 0.024s
I20260709 12:26:17.843699  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:17.844152  8511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.001s	sys 0.024s
I20260709 12:26:17.847796  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.836130  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.848045  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.844470  8470 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:17.848433  9375 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.850153  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:17.850219  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 933793us
I20260709 12:26:17.851636  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.855718  8544 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.847764  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.861851  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.848111  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.864907  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.848879  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.865460  8544 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.866257  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:17.852298  9374 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.868381  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.869171  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.869979  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.870551  8544 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.852330  9389 tablet_copy_client.cc:323] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:17.873623  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:17.874344  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.875739  9364 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.876181  9364 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:17.876540  9364 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.876632  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.880694  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.877768  9330 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.878182  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.883440  9330 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.884192  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.884729  8542 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.885494  9330 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.885725  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.886099  9386 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.886270  8542 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.886618  9386 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.888444  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.888994  8546 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.890403  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.891620  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.891893  9386 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:17.896508  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.892163  8545 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.905972  9330 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.906472  9330 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.896771  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.910009  9330 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:17.910640  8361 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7efab53f2634a5abbadd798832d128c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.891922  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:17.897162  9044 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:17.897367  9387 tablet_copy_client.cc:323] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:17.915618  9388 consensus_queue.cc:1059] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:17.916877  9388 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:17.917235  9388 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:17.918061  9388 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.919651  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.920354  9388 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.921190  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.922456  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.923585  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.923887  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.925288  8544 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.926457  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:17.922382  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62186.4us
I20260709 12:26:17.916858  9371 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:17.926703  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.927400  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:17.926203  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.928311  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet fea9eaca8b50473cb6788b0928b3f8c4 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:26:17.928378  9364 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.928804  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.929001  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet fea9eaca8b50473cb6788b0928b3f8c4 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-fea9eaca8b50473cb6788b0928b3f8c4
I20260709 12:26:17.929432  8545 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:17.929661  8463 raft_consensus.cc:1240] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:17.918370  8293 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.932093  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.932591  8545 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:17.932626  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.932909  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.935031  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.935596  9364 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.937906  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet f7de1dd05702461da4c0319fda01a7ca from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:17.938134  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.938513  8406 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet df155d204dc041d7b2ce5467f8825efd from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:17.938728  8545 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:17.939051  8406 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet df155d204dc041d7b2ce5467f8825efd from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-df155d204dc041d7b2ce5467f8825efd
I20260709 12:26:17.940807  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.943523  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.944342  8542 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:17.944904  8436 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:17.945465  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet f7de1dd05702461da4c0319fda01a7ca from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-f7de1dd05702461da4c0319fda01a7ca
I20260709 12:26:17.945856  9380 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.946031  8436 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:17.945222  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.947194  9356 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.947157  8436 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:17.948146  9356 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.948958  8436 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:17.940873  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.950307  9364 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:17.953148  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:17.957479  8406 tablet_copy_source_session.cc:215] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:17.958950  8556 tablet_copy_source_session.cc:215] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:17.961411  9387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df155d204dc041d7b2ce5467f8825efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.962035  9375 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:17.962396  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.960536  9369 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:17.967046  9375 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:17.967490  9375 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:17.968132  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.968506  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:17.970847  8407 tablet_copy_source_session.cc:215] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:17.974956  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.976742  9389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7de1dd05702461da4c0319fda01a7ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:17.977914  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:17.978603  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:17.978006  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.973209  9371 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:17.982280  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.984045  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:17.985925  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.987082  9369 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:17.989306  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.989833  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.990877  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.992269  8546 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:17.992322  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.992815  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.993645  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:17.987876  9375 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:17.998906  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.000950  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.999166  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:17.998322  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.003984  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.011492  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.012151  8539 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:18.011426  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:18.012336  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.012869  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.012830  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.016420  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.018481  9387 tablet_copy_client.cc:806] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.019127  9387 tablet_copy_client.cc:670] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.019577  9388 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.019819  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.021314  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.022440  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.029481  9375 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.029363  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.029682  9389 tablet_copy_client.cc:806] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.030431  9389 tablet_copy_client.cc:670] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.032538  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.035398  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.036412  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.037988  8436 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.039134  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.041349  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.040006  9378 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.042308  9356 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.042534  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.042724  9356 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.041966  9364 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.043357  9380 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.040136  9387 tablet_copy_client.cc:538] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.043713  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.043102  9356 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.043123  8539 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.045763  8436 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.046550  8436 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.047667  8436 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.048496  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.049418  9383 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.049738  8436 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.049834  9383 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.051396  9383 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.050726  8436 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.052690  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.052735  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.053773  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.054872  9321 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.053689  9376 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.056033  9389 tablet_copy_client.cc:538] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.054551  8436 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.047151  9380 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.047032  9364 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.047955  9378 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.048899  9369 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.061900  9369 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.062301  9369 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.057899  9386 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.056286  9376 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.066573  9376 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.055076  9384 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.049412  9363 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.060582  9372 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.058926  9364 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.069553  9363 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.071933  9363 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.071925  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.073189  9380 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.073542  8436 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.073936  9380 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.074694  9380 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.076227  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.075621  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.077229  9375 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.071323  9372 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.076678  9384 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.083602  9389 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:18.085753  9384 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.086680  9384 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.086697  9044 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.086215  9372 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.096942  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.098415  9386 consensus_queue.cc:1059] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:18.099439  9371 raft_consensus.cc:3055] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.099812  9371 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:18.100590  9371 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.101948  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.102545  8436 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.103201  9378 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.103567  8436 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.103819  9371 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.103577  9378 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.104578  9378 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.104605  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.106170  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.105351  9375 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:18.106829  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.106890  9353 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.106977  9375 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.107206  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.107457  9353 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.107743  9375 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.107965  9353 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.107081  9321 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.112175  9321 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.112519  9321 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.115120  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.116830  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.114382  9387 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:18.123117  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.138902  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.208453  9396 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.209239  9396 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.138494  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:18.260402  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:18.278177  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 155123us
I20260709 12:26:18.277307  8362 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.278884  8436 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.280965  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.281224  9344 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.285590  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.285625  9344 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.286286  9344 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.287565  9374 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.287294  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.290144  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:18.290551  9369 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.291322  9359 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.293061  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.293584  9364 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.295495  9364 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.290963  9015 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.294094  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.295542  9374 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.297416  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.297807  9374 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.298216  9374 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.301553  9378 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.305222  9374 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.305622  9375 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.307613  9359 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.309180  9015 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.309500  9396 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.309904  9396 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.310617  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.310770  9359 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.311128  9364 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.311522  9397 consensus_queue.cc:1059] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:18.310264  9396 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.321867  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.321758  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.318486  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.318351  8436 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.320355  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.307317  9374 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.322556  9364 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.319103  9369 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.334529  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:18.334342  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 55091.6us
I20260709 12:26:18.318277  8539 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:18.326690  9375 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.340440  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.341535  9403 ts_tablet_manager.cc:933] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:18.331626  9378 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.346927  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.353826  8436 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.337064  9364 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.354887  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.345719  9397 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.356956  8545 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:18.346623  9378 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.360877  9380 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.355141  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.362876  9378 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.367614  8436 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.369071  9363 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.371701  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.372624  9380 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.372851  9363 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.373407  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.373621  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.374462  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.377259  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.367816  9369 raft_consensus.cc:3055] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.380563  8436 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.382091  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.380673  8362 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.371127  9344 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.385306  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.384167  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.385679  8436 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.387223  8436 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.388285  8436 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.381664  9369 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:18.390569  8436 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.391561  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.391891  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.385058  9363 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.395071  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.394714  8469 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.395619  8545 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:18.387113  9380 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.388329  9378 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.394398  9351 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.389321  9403 tablet_copy_client.cc:323] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:18.399637  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.393302  9375 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.396976  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.412801  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.413633  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.414620  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.399605  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.400225  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.398473  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.413038  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.417084  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.419610  9363 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.423722  9369 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.419880  9376 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.423857  8466 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.398999  9351 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.419516  9399 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.441025  9399 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.441424  9399 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.442296  8537 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:26:18.426772  8546 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.423731  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.426573  9344 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.429013  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet c7efab53f2634a5abbadd798832d128c from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:18.430727  9321 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.437858  9376 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.438581  9356 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.432036  9363 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:18.425935  9369 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.451766  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet c7efab53f2634a5abbadd798832d128c from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-c7efab53f2634a5abbadd798832d128c
I20260709 12:26:18.453743  8511 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.443142  9351 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.444114  9402 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.458006  9330 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.421931  9364 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.459987  9363 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.456712  9383 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.447394  9372 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.464548  9408 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.459120  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.431339  9384 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.474886  9364 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.480695  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.483557  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.490094  8407 tablet_copy_source_session.cc:215] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:18.492076  8511 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.495937  9372 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.490144  8293 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:18.499468  8361 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.534s (SENT) [suppressed 3 similar messages]
I20260709 12:26:18.487462  9330 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.491084  9360 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.514928  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.498888  9352 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.519217  8466 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:18.519696  9383 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:18.520658  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 140084us
I20260709 12:26:18.518406  9366 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.520366  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:18.528932  9377 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.529139  9374 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.520411  9387 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.523360  8362 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.531366  8362 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.533200  9401 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.533480  9323 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.533622  9401 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.533917  9323 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.534032  8362 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.498692  9365 consensus_queue.cc:1059] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:26:18.534372  9323 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.537010  9327 raft_consensus.cc:3055] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.538821  9353 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.540668  9327 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:18.541669  9327 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.542871  9327 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.529726  9374 raft_consensus.cc:697] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:18.549111  9321 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.549232  9362 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.549664  9362 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.549996  9362 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.537974  9401 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.547263  9323 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:18.558755  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 59359.6us
I20260709 12:26:18.564314  9387 tablet_bootstrap.cc:492] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:18.561766  9356 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.571761  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.573282  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.573968  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.568639  9323 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.574388  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.575172  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.579689  9387 ts_tablet_manager.cc:1403] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.466s	user 0.023s	sys 0.016s
I20260709 12:26:18.580770  9396 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.584046  9387 raft_consensus.cc:359] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.584846  9387 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:18.577934  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.580416  9384 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.583282  9396 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.590957  9410 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.588891  9403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7efab53f2634a5abbadd798832d128c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.569983  9374 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.615269  9362 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:18.622006  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 88029.6us
I20260709 12:26:18.622643  8362 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.592451  9410 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.625590  9411 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.585435  9387 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.628279  9411 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.628715  9411 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.631707  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.638717  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.638594  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.633029  9353 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.648676  9351 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.649840  9399 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.655972  9401 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.657341  9351 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.660938  9410 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.669342  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.673036  9399 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.673636  9387 ts_tablet_manager.cc:1434] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.094s	user 0.003s	sys 0.004s
I20260709 12:26:18.675464  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-df155d204dc041d7b2ce5467f8825efd received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:18.675904  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-df155d204dc041d7b2ce5467f8825efd on tablet df155d204dc041d7b2ce5467f8825efd with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.675858  9401 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.672325  9411 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.678743  9389 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.658998  9362 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.680469  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:18.687194  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.687674  9389 tablet_bootstrap.cc:492] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:18.691344  9048 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:18.692157  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 177294us
I20260709 12:26:18.693962  8511 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.694622  9327 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.695396  9327 consensus_queue.cc:1059] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:18.695811  8511 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.696167  9327 consensus_queue.cc:1243] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer e3660d999c0a41658a1f1dbe7cc90746 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:18.696547  9330 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.696900  9371 raft_consensus.cc:3055] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.697244  9371 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:18.697870  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.698063  9371 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.699275  9371 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.699380  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.700706  8511 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.701874  9389 ts_tablet_manager.cc:1403] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.619s	user 0.022s	sys 0.020s
I20260709 12:26:18.698583  9330 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.702925  9377 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.704157  9411 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.703613  8292 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 2 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.704901  9327 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.705191  8511 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.710850  9327 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.712561  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.713817  8511 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.708045  9403 tablet_copy_client.cc:806] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
W20260709 12:26:18.709749  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 76408.6us
I20260709 12:26:18.714075  9327 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.714718  8362 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.716068  9411 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.707196  9389 raft_consensus.cc:359] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.716471  9411 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.716843  9411 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.722633  8362 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.715855  9415 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.723438  9344 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.723909  9344 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.715880  8511 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.724359  9344 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.725114  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.726126  8511 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.727052  9327 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.727720  9327 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.727742  9330 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.728929  8511 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.729592  9330 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.729990  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.730638  9330 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.731010  8511 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.731330  9403 tablet_copy_client.cc:670] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.731729  9330 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.736017  9344 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.738293  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.738929  8362 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.739151  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:18.739445  9014 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.740646  9014 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.741255  9374 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.741647  9374 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.741988  9374 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.742265  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:18.743147  9359 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.743793  9359 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.744120  9359 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:18.744511  9359 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.744223  9411 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.716776  9389 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:18.738322  9403 tablet_copy_client.cc:538] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.747125  9401 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.747527  9401 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.747900  9401 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.749593  8362 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.750735  8362 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.751327  8362 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.751811  9417 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.752218  9417 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.752342  9362 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.752625  9417 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.753093  9362 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.754073  8362 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.754591  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.754799  8362 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.752668  9359 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.755388  9351 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.756172  9414 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.756379  9351 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.756595  9414 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.756824  9351 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.756969  9414 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.762836  8469 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:18.753818  9362 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.753589  9344 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.759158  9323 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.764554  9323 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.764984  9323 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.766314  9410 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.763907  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.766784  9410 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.768009  8466 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.753912  9411 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.778028  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.778343  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.779243  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.779721  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.776320  9410 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.781083  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.779326  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.782562  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.784081  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.777138  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.786846  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.788275  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.788388  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.789121  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.789426  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.785437  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.788445  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.791443  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:18.792294  8472 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.794687  8542 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:18.794829  8511 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.796164  9371 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.796265  8511 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:18.797147  9330 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.798243  8511 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.799017  9415 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:18.799479  9415 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:18.803738  8546 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:18.764508  9359 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.751984  9389 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.802927  9323 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.802829  9415 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.817034  9323 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.819255  9374 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.822213  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.817025  9389 ts_tablet_manager.cc:1434] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.115s	user 0.004s	sys 0.003s
I20260709 12:26:18.828644  9417 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.831367  9371 consensus_queue.cc:1059] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:18.833115  9371 raft_consensus.cc:3055] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.833463  9371 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:18.834415  9371 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.835671  9371 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.841440  9351 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.838122  9401 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.845315  9401 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.846029  9414 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.841327  9374 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.850394  9414 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:18.852258  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 96059.6us
I20260709 12:26:18.853645  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.854180  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:18.808665  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 66483.8us
I20260709 12:26:18.856828  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.851722  9417 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.858683  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.859265  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-f7de1dd05702461da4c0319fda01a7ca received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:18.859709  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-f7de1dd05702461da4c0319fda01a7ca on tablet f7de1dd05702461da4c0319fda01a7ca with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.861034  8292 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 2, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.856482  9403 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:18.856961  9351 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.856040  9362 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.870260  9014 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.870782  9362 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.871531  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.876224  9374 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.876216  9359 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:18.866663  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 107658us
I20260709 12:26:18.879017  9342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fea9eaca8b50473cb6788b0928b3f8c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:18.879390  8362 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:18.880782  9351 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.881134  9351 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.881507  9351 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.881319  9362 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:18.889053  9351 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.891911  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.893029  9351 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:18.896243  9359 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.896339  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.897070  8463 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.898648  9359 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.899135  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.901486  8463 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.906800  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.907030  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.907510  9351 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.907785  8463 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:18.909654  8463 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.909782  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.910521  9344 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.910642  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.913206  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:18.913349  8466 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.915602  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.914512  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.921965  8463 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.921722  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.922887  9359 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.923364  9014 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.924192  9359 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.912833  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.925493  9344 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.925763  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.927716  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.929070  8466 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.927037  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:18.930583  9344 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:18.930948  9344 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:18.931304  9344 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.933239  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.933458  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.934998  8469 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.935781  8466 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.936399  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.936894  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.937392  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.936300  8469 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.937996  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.939165  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.939600  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.934957  9342 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:47416 (request call id 78) took 3616 ms. Trace:
I20260709 12:26:18.943306  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.944075  9342 rpcz_store.cc:276] 0709 12:26:15.318238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:15.318409 (+   171us) service_pool.cc:224] Handling call
0709 12:26:15.355785 (+ 37376us) ts_tablet_manager.cc:934] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
0709 12:26:18.877858 (+3522073us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:18.902107 (+ 24249us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:18.902220 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:18.934239 (+ 32019us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:18.934507 (+   268us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:18.934829 (+   322us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:18.934885 (+    56us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":280,"tablet-copy.queue_time_us":35035,"thread_start_us":76690,"threads_started":2}
I20260709 12:26:18.943709  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.945115  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.943591  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.945724  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.960668  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.960752  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.961676  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.961844  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.962559  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:18.960822  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.946543  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.947752  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.964190  8396 raft_consensus.cc:3055] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.951381  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.964553  8393 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.965157  8396 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:18.953897  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.954377  9048 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Advancing to term 2
I20260709 12:26:18.966089  9351 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.965957  8396 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:18.966464  9342 tablet_copy_client.cc:806] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:18.949579  9344 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:18.958496  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.958915  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.962668  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:18.945856  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:18.961870  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:18.967283  9342 tablet_copy_client.cc:670] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:18.967278  8396 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:18.970319  8463 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.973506  9342 tablet_copy_client.cc:538] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:18.957108  9403 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:26:18.976615  8396 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:18.977480  9344 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:18.979286  9048 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:18.980331  9403 tablet_bootstrap.cc:492] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:18.989028  8466 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.989532  8463 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:18.989717  9403 ts_tablet_manager.cc:1403] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.139s	user 0.019s	sys 0.005s
I20260709 12:26:18.991042  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.992110  9410 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:18.992053  9353 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:18.993290  9403 raft_consensus.cc:359] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:18.998389  8538 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:18.999316  9403 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:19.003530  9419 consensus_queue.cc:1059] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:18.988605  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.999812  8438 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.004786  9421 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.005353  9417 consensus_queue.cc:1059] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.001379  9344 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.001863  9351 consensus_queue.cc:1059] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.002499  9406 consensus_queue.cc:1059] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.006330  9419 raft_consensus.cc:3055] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.006842  9414 raft_consensus.cc:3055] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.006919  9419 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.005579  9353 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.006395  9417 raft_consensus.cc:3055] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.007263  9406 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.005329  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:18.999929  9410 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.007701  9406 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.007898  9414 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.008741  9406 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.008741  9414 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.010007  9414 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.010084  9406 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.006276  9323 raft_consensus.cc:3055] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.011277  9323 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.010653  8538 raft_consensus.cc:2955] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:19.012164  9323 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.013407  9323 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.003495  9362 consensus_queue.cc:1059] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.007566  9417 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.016332  9417 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.005549  9421 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.015534  9362 raft_consensus.cc:3055] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:18.986972  9342 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:19.020716  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.021279  8438 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.019011  9421 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.022105  9401 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.025661  9353 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.022491  9362 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.023677  9351 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:19.027776  9362 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.028842  9362 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.029214  9351 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.029877  9351 raft_consensus.cc:3055] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.030185  9351 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.022797  9410 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.030915  9351 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.034904  9417 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.034449  9403 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.054657  9411 consensus_queue.cc:1059] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.053901  9401 consensus_queue.cc:1059] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:19.050863  9344 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:19.056383  9403 ts_tablet_manager.cc:1434] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.002s
I20260709 12:26:19.056529  9344 raft_consensus.cc:3055] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.056923  9344 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.057749  9344 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.058156  9411 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.058651  9411 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.059504  9401 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.059882  9401 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.059036  9344 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.060575  9401 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.061821  9401 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.050282  9419 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.063205  9421 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.064103  9419 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.064826  9421 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.066717  9414 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.059508  9411 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.068632  9411 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.070894  8438 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.071791  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.072392  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-c7efab53f2634a5abbadd798832d128c received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:19.072770  9353 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.068054  9323 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.072803  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-c7efab53f2634a5abbadd798832d128c on tablet c7efab53f2634a5abbadd798832d128c with peer e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:26:19.076964  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 56317us
I20260709 12:26:19.077075  8396 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.077231  8438 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.077703  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.078399  8438 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.074888  9410 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.079769  9414 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.080013  9353 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.080247  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.080690  9353 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.081015  9399 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.074712  9415 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:26:19.083146  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.083822  9399 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.084389  9330 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.084802  9330 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.085664  9330 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.086843  9330 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.087990  8463 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.075073  9351 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.093489  9396 raft_consensus.cc:1064] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:19.084438  8438 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:19.093967  9396 raft_consensus.cc:1068] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Unable to promote non-voter e3660d999c0a41658a1f1dbe7cc90746: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:19.075863  9323 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.101222  8438 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.102306  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.102651  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:19.103750  9353 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.104521  8438 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.102758  9396 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.107064  8438 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.106958  9399 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.103832  9410 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.109802  8361 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.111881  8438 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.113874  9323 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.116165  9323 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.103797  9371 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:19.118358  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.117374  9428 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.120615  9428 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.120756  8361 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.108875  9353 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.119819  9396 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.124193  9410 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.124715  8466 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:19.128872  8438 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.112323  9425 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:19.132303  9425 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:19.132768  9425 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.134215  9382 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.134629  9382 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.136371  9411 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:19.138777  9382 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.144133  9382 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.145529  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.139752  9369 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:19.146318  9353 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.147208  9425 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.155378  8397 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.153002  9396 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.153947  9406 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.153915  8361 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.160997  8397 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.162385  8393 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.129614  9362 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.164117  8391 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.158742  9369 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.172667  9369 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:19.167775  8388 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.170634  9366 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.175010  9366 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.164810  8389 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.175344  9366 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.176388  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:19.176960  9366 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.178198  9366 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.180292  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.183588  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.185251  8361 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.181365  9421 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.186540  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.188120  8361 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.183923  9351 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.191918  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.185441  9362 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.185940  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:19.186141  9344 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.191210  9426 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.188527  9415 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:26:19.199400  9323 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.197312  8361 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:19.191577  9428 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.200522  9323 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.201082  9323 raft_consensus.cc:697] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.201998  9323 consensus_queue.cc:237] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.209287  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.211241  9428 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.212565  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.214084  8438 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.215068  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.215873  9377 consensus_queue.cc:1059] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.218140  9377 raft_consensus.cc:3055] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.218365  9399 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.218502  9377 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.219321  9377 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.220293  9428 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.213863  9425 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:19.217362  9415 raft_consensus.cc:3055] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.221521  9415 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.222081  8538 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.222388  9415 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.223374  9406 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.223704  9415 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.226008  9411 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:50334 (request call id 8) took 1571 ms. Trace:
I20260709 12:26:19.226449  9411 rpcz_store.cc:276] 0709 12:26:17.655803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.659000 (+  3197us) service_pool.cc:224] Handling call
0709 12:26:17.686210 (+ 27210us) log.cc:844] Serialized 492 byte log entry
0709 12:26:17.826839 (+140629us) spinlock_profiling.cc:243] Waited 8.17 ms on lock 0x7b18002c39e0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c522 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:26:17.836862 (+ 10023us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b18002c39e0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:26:19.225924 (+1389062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":455,"raft.queue_time_us":14609,"raft.run_cpu_time_us":1789,"raft.run_wall_time_us":5561,"spinlock_wait_cycles":40218752,"thread_start_us":77359,"threads_started":1,"wal-append.queue_time_us":126009,"wal-append.run_cpu_time_us":1648,"wal-append.run_wall_time_us":1014503}
I20260709 12:26:19.229714  8466 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.229527  9371 consensus_queue.cc:1059] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.231189  9431 raft_consensus.cc:3055] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.231115  9359 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:19.231698  9431 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.236137  9327 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:19.237169  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.237766  9327 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.238547  9327 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.239277  9327 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.239749  9425 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.240507  9327 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.240075  8292 catalog_manager.cc:5697] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:19.233369  9431 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.245718  9044 raft_consensus.cc:1217] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:26:19.246701  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:19.247424  9431 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.248013  9043 raft_consensus.cc:1240] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.247453  9045 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 2: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:19.253845  9048 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.253930  9377 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.258013  8463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:19.258703  8463 raft_consensus.cc:606] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:19.262583  8391 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.262919  9359 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.263376  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:19.264181  9045 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 2: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:19.263932  9366 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.271826  9330 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.272213  9330 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.272725  8463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:19.276870  8463 raft_consensus.cc:606] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:19.282641  8391 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.283218  9399 raft_consensus.cc:1064] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
W20260709 12:26:19.283661  9399 raft_consensus.cc:1068] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Unable to promote non-voter e3660d999c0a41658a1f1dbe7cc90746: Service unavailable: leader transfer in progress
I20260709 12:26:19.284698  9377 consensus_queue.cc:1059] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.285724  9377 raft_consensus.cc:3055] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.286067  9377 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.286916  9377 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.288722  9377 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.292632  8467 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.293423  8470 raft_consensus.cc:1240] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.300673  8463 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.309085  9439 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:19.309298  9323 consensus_queue.cc:1059] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.310137  9366 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.310292  9323 consensus_queue.cc:1059] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.310604  9366 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.311189  8393 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.311306  9323 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.312048  9426 raft_consensus.cc:3055] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.311574  9366 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.312228  9323 raft_consensus.cc:3055] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.312572  9428 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.312647  9323 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.313019  9428 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.313815  9428 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.314821  8396 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.287041  9330 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.316071  9323 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.318671  9323 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.318827  9330 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.312378  9426 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.322707  8396 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.314908  9428 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.322893  9426 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.329030  9439 consensus_queue.cc:1059] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:19.330142  9426 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.327847  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.315915  9366 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.337260  8281 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 58956.7us
I20260709 12:26:19.345101  9327 raft_consensus.cc:3055] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.345541  9327 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.346441  9327 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.347118  8396 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.345156  9425 consensus_queue.cc:1059] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:26:19.349078  9431 consensus_queue.cc:1059] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:19.355566  9425 raft_consensus.cc:3055] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.355967  9425 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.356081  9048 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:19.356810  9425 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.357925  9425 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.360538  8463 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:19.348372  9327 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.402115  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:19.402611  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:19.403208  8546 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:19.404819  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:19.407502  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:19.407727  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:19.402737  8542 raft_consensus.cc:2376] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2. Re-sending same reply.
I20260709 12:26:19.348932  9415 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:26:19.443941  8470 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.444242  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:19.447556  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:19.450294  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:19.348354  9411 consensus_queue.cc:1059] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:26:19.455330  8537 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:19.460426  9411 raft_consensus.cc:3055] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.460839  9411 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.461642  9411 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.462880  9411 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.466594  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:19.468176  9382 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.471244  8293 catalog_manager.cc:5697] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 2 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.472730  9045 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.484184  8546 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:19.371796  9362 consensus_queue.cc:1059] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:26:19.438378  8463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:19.409427  9371 consensus_queue.cc:1059] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:26:19.498275  8542 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:19.500708  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.504079  8544 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:19.505316  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:19.506821  9353 raft_consensus.cc:993] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:19.510397  9045 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.510169  8545 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:19.496469  8463 raft_consensus.cc:606] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Received request to transfer leadership
I20260709 12:26:19.512547  9353 raft_consensus.cc:1081] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:19.514664  8389 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:19.515357  8389 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:19.515774  8389 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.516119  9439 raft_consensus.cc:3055] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.516552  9439 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.517479  9439 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.511000  9362 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.521942  9425 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.522449  9425 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.523221  9432 raft_consensus.cc:3055] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.525600  9432 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.526383  9432 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.527458  9425 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.536211  9362 raft_consensus.cc:1064] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:19.529708  8389 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.527454  9432 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.541913  8343 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:26:19.542315  8343 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for df155d204dc041d7b2ce5467f8825efd already in progress
I20260709 12:26:19.541765  9362 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:19.542587  8343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for df155d204dc041d7b2ce5467f8825efd already in progress
I20260709 12:26:19.543380  9406 raft_consensus.cc:3055] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.543788  9406 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:26:19.539610  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.547636  9406 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.548741  9406 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:19.556766  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.557272  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:19.558388  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:19.560448  8361 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:19.561015  9342 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:19.561750  9342 tablet_bootstrap.cc:492] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:19.562268  9342 ts_tablet_manager.cc:1403] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.575s	user 0.050s	sys 0.048s
I20260709 12:26:19.564872  9323 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.565410  9323 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.565528  9421 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.565982  9421 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.566267  9323 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.566684  9421 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.564549  9342 raft_consensus.cc:359] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.569716  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:19.574030  9442 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:19.574395  9442 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.575204  9442 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.576351  9442 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.569038  9342 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:19.546988  9439 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.579048  9426 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.583372  9430 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:19.593595  9430 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:19.553107  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49250.7us
I20260709 12:26:19.595850  9430 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:19.596814  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:19.597067  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:19.597426  8396 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:19.597555  8467 raft_consensus.cc:3055] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:19.597862  8467 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:19.560254  9428 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:19.598567  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:19.599076  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:19.599529  9430 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:19.599936  9430 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:19.600292  9430 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.599613  8545 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.600596  8539 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.609261  8545 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:19.598496  9426 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.598627  8467 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.610915  8361 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:19.611390  8467 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:19.596287  8389 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:19.615610  9428 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:19.617019  9428 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:19.617837  9428 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.624361  9344 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:26:19.622943  9371 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:26:19.636888  9426 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.615191  9342 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:19.645399  9430 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.648074  9342 ts_tablet_manager.cc:1434] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 12:26:19.647523  8294 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 2 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.665074  8556 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-fea9eaca8b50473cb6788b0928b3f8c4 received from {username='slave'} at 127.0.0.1:58406
I20260709 12:26:19.665534  8556 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-fea9eaca8b50473cb6788b0928b3f8c4 on tablet fea9eaca8b50473cb6788b0928b3f8c4 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:19.668897  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:19.670225  9048 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.673218  8539 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.676131  9428 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.677183  9430 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:19.677666  9428 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:19.688593  8466 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:26:19.690670  8389 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:19.693825  8467 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:19.691999  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:19.710726  9442 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.706420  9425 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:26:19.720028  9442 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.728175  9442 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.728519  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:19.741194  9323 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.743844  9048 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.747434  8467 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.761498  8463 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:19.762303  8539 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.770412  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:19.766012  9406 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:26:19.791061  8293 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 2 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.792649  8293 catalog_manager.cc:5697] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 2 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.794059  8293 catalog_manager.cc:5697] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 2 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.798092  8293 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 2 to 3, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.832607  8294 catalog_manager.cc:5697] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 2 to 3, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.868185  9377 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:19.868813  9377 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.869143  9371 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:19.869709  9371 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.870903  9377 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:19.871665  9371 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:19.872756  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:19.873366  8389 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:19.873740  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:19.874332  8396 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:19.875555  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:19.876322  8466 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:19.879127  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:19.880196  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:19.880885  9371 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:19.881234  9371 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:19.881562  9371 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.882848  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:19.883577  9377 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:19.883963  9377 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:19.884318  9377 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:19.883611  8466 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:19.893497  8396 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:19.894305  9377 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.899046  9048 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:19.898813  9371 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.900501  9323 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.900933  8466 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:26:19.907627  9323 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:19.913335  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:19.914077  8466 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:19.914134  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:19.916661  9426 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.917969  9377 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:19.920864  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:19.922271  9048 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.929611  8463 raft_consensus.cc:2955] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.931628  8389 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:19.933139  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:19.934492  9430 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.935813  9371 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:19.938004  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:19.938434  9430 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.947615  8466 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:19.947918  9430 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.939723  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7efab53f2634a5abbadd798832d128c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:19.941133  9045 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.951834  9426 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:19.946808  8396 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:19.955263  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:19.953698  8295 catalog_manager.cc:5697] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 3 to 4, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New cstate: current_term: 1 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:19.958839  9371 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:19.959594  9371 raft_consensus.cc:697] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:19.960404  9371 consensus_queue.cc:237] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:19.974980  8541 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:19.977495  9406 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:19.981972  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet c7efab53f2634a5abbadd798832d128c with delete_type TABLET_DATA_TOMBSTONED (TS aef8c9f023564378a04e3e1e6171930d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:20.018770  8539 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.020488  9323 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.021116  9464 tablet_replica.cc:333] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:26:20.022186  9464 raft_consensus.cc:2243] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.022940  9464 raft_consensus.cc:2272] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.024387  8292 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.026319  9464 ts_tablet_manager.cc:1916] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:20.046556  9464 ts_tablet_manager.cc:1929] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:26:20.047235  9464 log.cc:1199] T c7efab53f2634a5abbadd798832d128c P aef8c9f023564378a04e3e1e6171930d: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/wals/c7efab53f2634a5abbadd798832d128c
I20260709 12:26:20.054526  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet c7efab53f2634a5abbadd798832d128c (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:20.055730  8545 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.059263  9323 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.069407  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet c7efab53f2634a5abbadd798832d128c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:20.070973  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet c7efab53f2634a5abbadd798832d128c (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:20.081218  9045 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.100121  9426 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:20.119243  8466 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.127795  8466 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.129132  9425 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.129626  8541 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.131233  9425 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:20.099865  9430 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.167343  8463 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:20.168989  9430 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.181658  9430 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.183209  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.183822  8396 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:20.184719  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.185483  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.187043  8545 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:20.185956  8466 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:20.188424  9377 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.196130  9428 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:20.196288  9377 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.198477  9377 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.188681  9430 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:20.222736  8294 catalog_manager.cc:5697] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.228176  8294 catalog_manager.cc:5697] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.221781  9430 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.228684  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.231982  9048 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEARNER]: Advancing to term 3
I20260709 12:26:20.232735  8463 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:20.231652  9430 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.240295  9048 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:26:20.263310  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 71286.8us
I20260709 12:26:20.266849  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.267509  8396 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:20.269044  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:20.272498  9371 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:20.273907  9465 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:26:20.274160  9371 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.274588  9371 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.283901  8463 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.264106  9471 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:26:20.292316  9430 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.293258  9472 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:26:20.294291  8463 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.295650  9396 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.296133  9396 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.301942  9045 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.302863  9472 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.305697  9442 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:20.310117  9396 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.311503  9384 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.311986  9384 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.313886  9384 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.314321  9384 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.311728  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.314766  9384 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.317369  8545 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.318813  9384 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.320005  8436 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.320600  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.321249  8545 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.322139  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.322904  8396 raft_consensus.cc:2393] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.324267  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.316776  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:20.325582  8467 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.332831  8467 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:20.338042  9432 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.345465  9432 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.315373  9430 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.347853  8511 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.329106  9384 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:20.320760  9353 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.351655  9384 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.353634  9384 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.354094  9432 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.355307  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.355953  8396 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:20.356472  9406 raft_consensus.cc:1064] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:20.358603  9406 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:20.361627  8393 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.337836  9396 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:20.363163  9396 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.363583  9396 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.363924  9439 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.364387  9439 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.364629  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:20.365281  8389 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.365516  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.366112  8541 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.366379  9439 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.367658  8512 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.368006  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.368541  8396 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:20.368654  9473 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.371359  8512 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.372625  9432 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.374063  9432 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:20.374661  9432 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.377691  9045 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:20.378227  9425 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.378669  9425 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.339890  9371 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.380716  9425 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.382961  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.386093  8545 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:20.387048  8361 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.369129  9473 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.352439  9430 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:20.379395  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.349169  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.392333  8436 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.375021  9432 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.381711  9442 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:20.381258  9371 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.390316  9439 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.401618  9479 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.402109  9479 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.403746  8391 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.404548  9473 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.405048  9439 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.405671  8541 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:20.407024  9439 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.381423  9353 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.393536  9425 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:20.398072  9430 raft_consensus.cc:697] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:20.397502  9442 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.415848  8388 raft_consensus.cc:2393] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.390245  9406 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:26:20.411037  9384 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.430670  9430 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.417196  9425 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.437238  9478 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:20.427999  9442 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.430966  9473 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:26:20.429554  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.446066  8396 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.446220  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.459359  8397 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:20.431740  9359 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.446677  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:20.462634  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.462854  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.465500  8396 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.463307  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:20.466084  8392 raft_consensus.cc:2393] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.468070  9439 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:20.468489  9439 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.468856  9439 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.468948  8391 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:20.440835  9425 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.464643  9377 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:26:20.470072  9359 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:20.473773  9353 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.478034  8393 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:20.479590  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.440748  9478 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.447918  8389 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:20.485807  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.486104  9479 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.486586  8391 raft_consensus.cc:2393] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:26:20.488596  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 96326.8us
I20260709 12:26:20.480005  9396 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.481858  9377 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:26:20.483525  9478 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:20.482888  9371 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:20.541652  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.537202  9479 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.562117  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.561275  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.564258  9359 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.562773  8389 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:20.581295  9425 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.584828  9425 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.556176  9439 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.589267  9483 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.591722  9384 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.595041  9353 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.556020  9479 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:20.604650  9479 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.598021  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:20.602214  9483 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:20.606135  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.612115  8392 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.613356  8545 raft_consensus.cc:2368] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:20.597250  8539 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.601965  9377 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.611819  9473 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.621913  8391 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.623370  9377 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.612035  9353 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.614957  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:20.623222  9396 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.643227  9428 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.645000  9428 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.647104  9428 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.648392  9425 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.648590  9483 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.650029  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.650626  8396 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.652192  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:20.664462  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.664718  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.665305  8467 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:20.666174  8470 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:20.667481  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:20.668134  8469 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:20.629468  9473 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:20.648821  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 47710.8us
I20260709 12:26:20.648898  9359 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:20.669826  9483 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:20.676204  9483 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.675928  9478 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.676563  9483 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.676062  9359 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.667426  9425 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.679983  9359 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.681351  9425 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.683193  9483 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:20.672083  9432 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.685467  9439 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.686251  9432 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.686379  9472 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.686897  9472 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.689761  9483 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.689874  9472 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.690975  9396 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.691306  9478 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.691901  9478 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.692348  9478 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.693409  9384 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.693881  9384 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.673652  9442 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.696290  9442 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.697212  9377 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.696398  9384 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.700821  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:20.700181  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:20.701557  8392 raft_consensus.cc:2393] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.701702  8396 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.702059  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.702764  8393 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.699492  9473 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.704603  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.718115  8466 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:20.718993  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.719581  8466 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:20.706221  8469 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.708985  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.710336  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.711040  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.703231  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.720896  8468 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:20.698011  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:20.717463  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.724463  8465 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:20.721819  8467 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:20.721962  8397 raft_consensus.cc:2393] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.720395  8470 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:20.720873  8472 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:20.691449  9396 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.723503  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.740270  8471 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:20.700189  9478 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.743705  8396 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:20.725003  9483 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.736999  9428 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.741240  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:20.748607  8391 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:20.755867  9482 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.746057  9353 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.752038  9359 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:20.758365  8464 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.756335  9482 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.760903  8471 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:20.762817  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.762879  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:20.763613  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:20.761189  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:20.764146  8470 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.763945  8466 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:20.765034  8471 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:20.765508  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:20.766810  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 200774us
I20260709 12:26:20.759019  9353 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.775517  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.778838  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:20.780575  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.779800  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.766026  9371 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:20.793273  8537 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.753428  9483 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.757026  9428 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.780874  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.793962  8436 leader_election.cc:400] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:20.797183  8436 leader_election.cc:403] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:20.769093  9488 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:20.775905  9430 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.785524  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:20.771656  9442 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.776017  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:20.774353  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:20.806481  9396 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.806890  9359 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.792685  9353 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.808863  9491 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.769963  9489 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.809301  9491 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.809412  9489 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.810462  9428 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.799249  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.793315  8538 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.777066  9432 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.808658  9377 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:20.776185  9439 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:26:20.794728  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 53049.6us
I20260709 12:26:20.811945  8465 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:20.811571  9489 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.811302  8545 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.799757  9488 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:20.802901  9421 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.858984  8295 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.861811  8544 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.859066  8362 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:20.873744  9323 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:20.874387  9323 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.874900  9323 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.811285  9491 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:20.809451  9353 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.844732  9488 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:20.887115  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 109578us
I20260709 12:26:20.887857  8470 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
W20260709 12:26:20.889627  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.891155  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.892414  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.896310  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:20.897400  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:20.897563  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 98548us
I20260709 12:26:20.896881  8467 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:20.844035  9489 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:20.814196  9482 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:20.901754  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 125121us
I20260709 12:26:20.838555  9432 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.906912  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:20.907527  8544 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.805732  9430 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.814706  9442 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:20.910745  8511 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.901301  9478 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:20.900727  9477 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.911281  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.916625  8543 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:20.878510  9421 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.920511  8542 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:20.910126  9482 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.923866  8546 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:20.908795  9489 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.926131  9323 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.916575  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.927989  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:20.936017  8544 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:20.936937  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.937476  8544 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:20.963254  9323 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:20.966642  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 107655us
I20260709 12:26:20.967384  8362 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:26:20.969141  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 70947.5us
I20260709 12:26:20.921169  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:20.970781  8436 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:20.971117  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:20.902671  9371 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.973969  8544 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:20.974344  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:20.975095  9323 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.994127  9323 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.002372  8537 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:21.002684  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:20.923561  8540 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:20.970803  9483 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.019598  9323 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:20.920915  9477 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:20.973341  8538 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
W20260709 12:26:21.008587  9475 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:20.928601  9482 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.015600  8544 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:21.008145  9499 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:21.019145  9384 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:21.010098  9498 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:21.116942  9384 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.017882  9494 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.020141  9510 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.114283  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:21.022909  9479 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.251016  8392 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.107965  9473 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.204604  9432 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.215653  9477 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.221951  8539 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.216620  9489 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.199018  9442 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.028585  9483 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:21.117362  9384 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:21.250931  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 282741us
I20260709 12:26:21.216878  9504 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.029908  9497 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:21.183701  9430 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.037364  9377 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:21.130533  9498 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:21.219625  9505 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.289551  9471 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.216324  9482 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.359810  9323 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.217468  8464 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:21.254446  9494 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.368940  9323 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.250871  9353 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.203068  9512 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.362589  8362 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:21.385038  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:21.268335  9479 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.250756  9499 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.386842  9425 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.253391  9510 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.292083  9483 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.386790  9499 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.387771  9512 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:21.387770  9483 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.390687  9512 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.278204  9488 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.393918  9488 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.367605  9377 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.363824  9442 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.397027  9442 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.398186  9377 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.398972  9442 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:21.401065  8541 consensus_meta.cc:287] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.002s
I20260709 12:26:21.401477  8541 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.402590  9499 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.363942  9511 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.385672  9323 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.387280  9425 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.395903  9510 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.395022  9483 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:21.365871  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 363227us
I20260709 12:26:21.368515  9497 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.372251  9494 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.403357  9384 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.269953  9473 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.363005  9426 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.365028  9506 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.411896  8392 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:21.436230  8436 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:21.373494  9519 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.443212  8436 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:21.411587  9512 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.446484  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:21.444288  9506 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.448566  9516 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.445412  9384 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.449082  9516 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.449960  9516 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.450762  9406 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.451164  9406 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.451529  9406 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.446718  9501 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.445251  9473 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.452307  9501 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.412250  9425 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.453177  9501 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.446599  9519 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.449100  9499 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.446565  9426 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.456948  9426 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.457204  9421 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.457484  9483 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.448096  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:26:21.458276  8511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.000s	sys 0.020s
W20260709 12:26:21.458583  8511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.000s	sys 0.021s
W20260709 12:26:21.458866  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 531731us
I20260709 12:26:21.459362  9497 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.461194  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.467011  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.467599  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.467664  8545 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.468972  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.469718  8467 raft_consensus.cc:2393] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:21.470698  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.471381  8472 raft_consensus.cc:2368] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:21.471748  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.472533  8466 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:21.474817  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.475432  8469 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:21.476202  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.471488  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.473277  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.480230  8466 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:21.481357  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.481879  8537 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.482259  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.483784  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.484360  8544 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.366575  9504 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.487565  9504 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.445372  9479 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.412382  9353 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.372684  9471 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:21.493767  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.459515  9506 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.477838  9499 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.491060  8465 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:21.490594  9494 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.477857  9359 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:21.503826  8537 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:21.478636  9483 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:21.484547  9377 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.485069  9497 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:21.488425  8511 leader_election.cc:400] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:21.505036  8511 leader_election.cc:403] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:21.488517  9488 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.492504  9371 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:21.471774  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 75270.2us
I20260709 12:26:21.387889  9498 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.435786  9511 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:21.510185  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 125215us
I20260709 12:26:21.494418  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.469055  9512 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.513911  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.384160  9505 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.506664  9483 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.506938  9499 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.511758  9371 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.522154  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.520380  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.511292  9507 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.507962  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.522725  8546 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.528049  8469 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:21.523307  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.510041  9497 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.529673  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.530275  8539 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.530786  9497 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.511133  9377 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.533030  9377 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.525727  9499 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.533442  9512 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.523010  9371 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.534902  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.535524  8543 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.536304  8541 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:21.528049  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.520776  9483 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.537097  8544 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.527472  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.538151  8537 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.541185  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.541702  8537 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:21.511641  9488 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.544736  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.545282  8466 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:21.543342  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.542954  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.547132  8361 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.549759  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.552521  8436 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.552898  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.552973  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.553464  8542 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:21.553900  9504 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.554260  9504 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.554571  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.555202  8539 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.554605  9504 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.557139  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.557898  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.515372  8362 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:21.557137  8468 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:26:21.559849  9518 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.168s	user 0.003s	sys 0.000s
I20260709 12:26:21.518296  9493 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:26:21.564771  8544 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.565569  9522 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:21.566107  9522 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:21.558235  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.536368  9353 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.567816  8537 raft_consensus.cc:2368] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:21.560695  8545 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.562812  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.539793  9519 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.572273  8436 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.573594  9471 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.546286  9512 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.566895  9522 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.576262  8436 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:21.578034  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 62736.3us
I20260709 12:26:21.579893  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.581720  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:21.587985  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.591329  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.591673  9514 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:21.591935  8467 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.592662  9514 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.593073  9514 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.597311  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.600272  9505 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.600601  9511 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.567586  9428 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.601121  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.601560  9428 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.601950  9428 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.602315  9488 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.602900  9494 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:21.571381  9430 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.586990  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:21.609858  8468 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.604166  8436 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.608690  9323 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.610471  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.610409  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.609104  9384 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:21.610880  9323 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.612040  9323 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.611160  8472 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:21.575531  9482 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.615633  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.613185  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.614678  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.617487  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.618094  8466 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.619524  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.606613  9479 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.630025  8436 leader_election.cc:400] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:21.630357  8436 leader_election.cc:403] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:21.625669  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:21.631067  8465 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.626641  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.609568  9430 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.556107  9510 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:21.629012  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 102438us
I20260709 12:26:21.652088  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.617550  9511 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:21.615800  9482 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.580911  9512 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.633498  9473 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.641824  9488 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.655786  9430 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.628832  9477 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:21.663231  9323 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.628613  9479 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.607831  9472 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:26:21.627215  9384 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.656920  9359 raft_consensus.cc:697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:21.657398  8469 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.654698  9506 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.672894  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.681247  9323 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:21.681354  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 54776us
I20260709 12:26:21.669237  9482 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.692998  9323 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:21.695979  9323 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.671967  9473 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.693471  8361 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.677886  9421 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.679927  9479 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.676076  9477 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.680088  9488 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.729812  9323 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.741448  9323 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.741513  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.741462  9477 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:21.744074  9323 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.753471  9323 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.720322  9519 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.698283  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:21.713572  9421 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.685778  9406 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.700732  9473 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.701500  9495 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.758785  8465 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
W20260709 12:26:21.741689  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 111780us
I20260709 12:26:21.685865  9514 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.764484  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.765728  9514 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.738915  9471 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:21.764571  8472 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.766394  9471 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.768555  9471 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.711076  8540 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:21.765887  9498 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:21.769599  9498 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:21.770154  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.696225  9425 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.775897  8468 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:21.708329  9359 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:21.785059  8436 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.697885  9506 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.792109  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.753753  9510 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.710299  9483 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.736825  9371 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.762328  9421 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.795367  9323 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:21.798408  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.719290  9504 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.774260  9501 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:21.763306  8463 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:21.791123  9495 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.805212  9323 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.707932  9384 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:21.760838  9519 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.793896  9514 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.797003  9471 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.807654  8471 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:21.797832  9505 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:21.807989  9323 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:21.812594  9323 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.817811  9323 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.800954  9511 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:21.807487  9495 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.808393  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.823205  9323 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:21.823666  9323 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.809217  9532 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:21.812075  9471 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.815019  9505 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:21.829854  9323 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.810390  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:21.815671  9514 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.846081  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.846313  9477 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.846899  9514 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.848390  8464 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:21.831614  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:21.832656  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:21.797210  9498 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.851521  9532 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.852563  9532 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:21.830946  9471 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.811936  9488 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.862727  8397 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:21.833645  9507 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:21.834131  9504 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.835320  9425 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.825883  9512 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.819604  9428 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.837285  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:21.838354  9519 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.831246  9505 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.840571  9506 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.858983  9495 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.842840  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:21.845095  9483 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.845896  9406 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.850831  9494 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:21.864694  8396 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:21.884905  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.840996  9530 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:21.839061  9479 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.830299  8540 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:21.898207  8391 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.930151  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.930740  8393 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:21.919181  9359 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:21.923728  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.862396  9502 raft_consensus.cc:2955] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:21.907770  8537 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.929471  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.936229  8394 raft_consensus.cc:2368] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:21.932369  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.937089  8467 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:21.937476  8393 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:21.895483  9471 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.886335  8539 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:21.933591  8396 raft_consensus.cc:2368] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:21.950986  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.951191  8395 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:21.951540  8396 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:21.938267  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.952877  8393 raft_consensus.cc:2368] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:21.953560  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:21.954035  8393 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:21.921096  9511 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:21.944082  9479 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:21.945297  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.949579  8537 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:21.969442  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.970165  8396 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:21.971002  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:21.989068  8396 raft_consensus.cc:2368] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:22.020880  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.020897  9371 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:22.027129  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.015832  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.044200  9535 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:22.015679  9406 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:22.045190  8395 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:22.066975  8396 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.068207  8397 raft_consensus.cc:2368] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
W20260709 12:26:22.069520  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 181342us
I20260709 12:26:22.100638  8537 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.069893  8393 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:22.109916  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.103606  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:21.930380  9530 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.119081  8436 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:22.123318  9479 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.123876  9479 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:21.937103  9359 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:22.126471  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:22.070559  8538 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
W20260709 12:26:22.124687  9513 log.cc:927] Time spent T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.590s	user 0.000s	sys 0.006s
I20260709 12:26:22.142620  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.125130  9488 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.092698  8390 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:22.150715  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:22.127489  9477 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.149458  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:22.153496  8396 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:22.073418  9482 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.143541  9540 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:22.145506  9483 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.155246  9504 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:22.123417  9530 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.159749  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:22.162829  9541 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:26:22.124764  9479 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.150058  9353 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:22.118144  9406 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.142349  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:22.141474  9428 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.149118  9488 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.185182  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.175227  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.196370  9520 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:22.198422  8395 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:22.091675  9535 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.238255  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 951) took 1341 ms. Trace:
I20260709 12:26:22.193926  9483 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.193674  9522 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:22.242458  8537 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:22.195397  9495 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.245668  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:22.247869  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 51736.5us
I20260709 12:26:22.251044  8396 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.246177  8470 rpcz_store.cc:276] 0709 12:26:20.896538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.896632 (+    94us) service_pool.cc:224] Handling call
0709 12:26:20.897002 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:20.900194 (+  3192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.900222 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:20.982768 (+ 82546us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b2c00010988. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6462c82a11 00007f6462c92372 00007f64643c4a01 00007f646438943a 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2
0709 12:26:20.983165 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 12:26:21.447912 (+464747us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:21.447953 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:21.448026 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:22.123941 (+675915us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:22.238001 (+114060us) raft_consensus.cc:1685] finished
0709 12:26:22.238025 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.238186 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3906,"raft.queue_time_us":7933,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6709,"spinlock_wait_cycles":17503360,"thread_start_us":464349,"threads_started":1,"wal-append.queue_time_us":535606}
I20260709 12:26:22.254027  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.241817  8539 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.243000  9488 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.254602  8395 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:22.248040  8390 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:22.249866  9483 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.260540  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.262625  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.267558  8472 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.254757  9520 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.266554  9377 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:22.260144  9543 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:26:22.269670  9520 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.267112  8395 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:22.271014  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.271651  8395 raft_consensus.cc:2368] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:22.272315  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.272933  8395 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.273905  8395 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.269686  9377 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.275941  9406 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.276353  9377 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:22.266114  9549 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:22.280004  8471 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:22.286005  9535 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.276393  9421 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.286420  9498 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:22.254058  9478 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:22.292073  8472 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:22.297302  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:22.299582  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 46244.7us
I20260709 12:26:22.301331  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:22.311885  8436 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:22.238766  9540 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.313830  8393 raft_consensus.cc:2410] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:22.315439  8395 raft_consensus.cc:2368] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:22.254956  9522 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.316855  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.291010  9482 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.322609  8394 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.325340  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.318055  9359 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:22.327135  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.328972  8395 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.318174  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.316807  9377 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:22.327543  9533 log.cc:927] Time spent T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.371s	user 0.002s	sys 0.007s
W20260709 12:26:22.333741  9542 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:26:22.334120  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.335193  9421 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.315130  9505 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.314137  9498 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:22.351296  8390 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.336947  9377 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.316780  9478 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:22.345564  9477 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:26:22.351909  9473 consensus_meta.cc:287] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.560s	user 0.006s	sys 0.004s
I20260709 12:26:22.356316  9377 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.358435  9471 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.327867  9504 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:22.377710  8395 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:22.378739  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.379468  8395 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.380175  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:22.381253  9545 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 12:26:22.366573  9430 consensus_meta.cc:287] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.687s	user 0.003s	sys 0.007s
I20260709 12:26:22.380673  8395 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:22.393970  8391 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:22.370183  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.388917  9477 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:22.368167  9473 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.366071  9488 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.388679  9430 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.402338  8539 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:22.401538  9540 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.417944  8545 raft_consensus.cc:2368] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:22.415038  8390 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.411626  9494 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:22.420851  9499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.018s	sys 0.013s
I20260709 12:26:22.424831  9498 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:22.425333  9494 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:22.426798  9430 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:22.427903  9494 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:22.428092  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 115002us
I20260709 12:26:22.423539  9477 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.429463  9478 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.425282  9473 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.429807  9430 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:22.431388  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:22.432934  9430 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.433442  9430 raft_consensus.cc:697] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:22.435879  8467 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:22.437152  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.437765  8472 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:22.438794  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.441464  8467 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.445735  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:22.447144  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:22.447791  8537 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:22.448336  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:22.423269  9499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.018s	sys 0.013s
I20260709 12:26:22.451297  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:22.451462  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:22.452052  8540 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:22.453020  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:22.452899  9483 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.453106  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:22.455571  8467 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:22.446643  9522 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.445269  9489 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:26:22.451951  8541 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:22.472910  9430 consensus_queue.cc:237] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:22.476480  9547 log.cc:927] Time spent T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 12:26:22.439855  9504 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.480906  9483 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.488260  9488 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.490098  9377 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.491824  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:22.492695  8538 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:22.494257  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.494930  8397 raft_consensus.cc:2368] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:22.496526  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.497156  8397 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.498129  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.498783  8393 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.500254  9045 raft_consensus.cc:2955] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:22.505330  8392 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:22.739650  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 186778us
I20260709 12:26:22.503392  8436 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:22.744002  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.748757  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.749637  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.750665  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.751157  8472 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.756873  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.757197  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:22.756803  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:22.758528  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 255187us
I20260709 12:26:22.760350  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.760682  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.761197  8465 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.763072  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.763520  8470 raft_consensus.cc:2393] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:22.506009  8390 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:22.539537  9505 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.504069  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.763291  9396 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:22.730558  9377 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:22.706254  9488 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.787657  9488 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.788595  8467 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.790014  9488 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.777812  9540 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.793335  9540 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:22.794693  8467 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:22.795253  9511 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.795729  9511 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.765765  9483 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.797763  9483 raft_consensus.cc:697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:22.797694  9511 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.798696  9483 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:22.811869  9561 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:26:22.803273  8388 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.814301  8362 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:22.815930  9511 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.816334  9511 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.816668  9511 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.823567  9511 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:22.825930  9511 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.828939  9540 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:22.830823  8362 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:22.833647  8362 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:22.832299  9540 raft_consensus.cc:2764] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:22.834713  9511 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.835094  9511 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.835443  9511 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.836141  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.841369  8390 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:22.830713  8389 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:22.767671  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.769956  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.770656  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:22.847400  8470 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:22.847792  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 77218.1us
I20260709 12:26:22.839186  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.849493  8438 leader_election.cc:400] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:22.544952  9498 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:22.759207  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.780402  8465 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:22.786765  8472 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:22.536319  9494 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:22.851722  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.874843  8466 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:22.872571  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:22.844744  9502 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.030s	sys 0.051s
I20260709 12:26:22.877405  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.877681  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.880712  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:22.881364  8470 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:22.853448  9488 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:22.884001  8438 leader_election.cc:400] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:22.891059  8362 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:22.893064  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:22.893782  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.894390  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.894856  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.895571  8465 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:22.893633  9540 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.897878  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.895046  8438 leader_election.cc:400] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3.
I20260709 12:26:22.902006  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.890820  9488 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:22.898672  8391 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.905133  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.896755  9505 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:22.908593  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.905943  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.865903  9498 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:22.891916  9502 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.030s	sys 0.052s
I20260709 12:26:22.892114  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.877524  9494 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:22.900349  9473 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:22.913470  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.900903  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.920794  8295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 187) took 2158 ms. Trace:
I20260709 12:26:22.907227  9488 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:22.903713  9540 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:22.924870  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:22.926792  8466 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:22.910967  9552 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:26:22.928821  8362 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:22.931588  8469 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:22.904752  9477 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:26:22.919720  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.912264  9505 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:26:22.964175  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:22.938037  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.967782  9498 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:22.983741  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 940) took 1044 ms. Trace:
W20260709 12:26:23.013067  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 84298.9us
I20260709 12:26:23.013792  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 619) took 1185 ms. Trace:
I20260709 12:26:22.951197  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:22.954205  9532 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:22.921150  8295 rpcz_store.cc:276] 0709 12:26:20.762607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.762742 (+   135us) service_pool.cc:224] Handling call
0709 12:26:22.920739 (+2157997us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:21.115146 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:21.173192 (+ 58046us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:21.173228 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:26:21.173245 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:21.173588 (+   343us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:21.173642 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:21.173674 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:21.173849 (+   175us) tablet.cc:701] Row locks acquired
0709 12:26:21.173866 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:21.174000 (+   134us) write_op.cc:270] Start()
0709 12:26:21.174106 (+   106us) write_op.cc:276] Timestamp: P: 1783599981173955 usec, L: 0
0709 12:26:21.174128 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:21.174790 (+   662us) log.cc:844] Serialized 534 byte log entry
0709 12:26:21.364484 (+189694us) op_driver.cc:464] REPLICATION: finished
0709 12:26:21.575127 (+210643us) write_op.cc:301] APPLY: starting
0709 12:26:21.575222 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:21.575314 (+    92us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:21.576693 (+  1379us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:21.576919 (+   226us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:21.607364 (+ 30445us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:21.612873 (+  5509us) write_op.cc:312] APPLY: finished
0709 12:26:21.642326 (+ 29453us) log.cc:844] Serialized 22 byte log entry
0709 12:26:21.660987 (+ 18661us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:21.670233 (+  9246us) write_op.cc:454] Released schema lock
0709 12:26:21.671524 (+  1291us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:21.683935 (+ 12411us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:21.694303 (+ 10368us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":253654,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":190199,"apply.run_cpu_time_us":1996,"apply.run_wall_time_us":111891,"num_ops":1,"prepare.queue_time_us":150411,"prepare.run_cpu_time_us":2612,"prepare.run_wall_time_us":81248,"replication_time_us":77876,"spinlock_wait_cycles":3456,"thread_start_us":184714,"threads_started":2}]]}
I20260709 12:26:23.014446  8545 rpcz_store.cc:276] 0709 12:26:21.798003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.798143 (+   140us) service_pool.cc:224] Handling call
0709 12:26:22.983248 (+1185105us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b540003a2d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:22.983424 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417043328}
I20260709 12:26:23.018518  8362 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:23.013882  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:22.984201  8394 rpcz_store.cc:276] 0709 12:26:21.939034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.945071 (+  6037us) service_pool.cc:224] Handling call
0709 12:26:22.983570 (+1038499us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540032a854. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:22.983677 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828955008}
W20260709 12:26:23.023864  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 116198us
I20260709 12:26:22.983902  9473 raft_consensus.cc:697] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:23.017521  9532 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:23.032888  8394 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:22.966010  9511 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.027055  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.040505  9473 consensus_queue.cc:237] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.020422  9494 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:23.034439  9580 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:23.040477  8391 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:23.039891  8390 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:22.983249  9540 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.043512  9359 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.044059  9511 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:23.044129  9359 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.068674  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:23.051584  9579 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:23.083830  9532 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:23.115705  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62008.4us
I20260709 12:26:23.045325  9499 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:26:23.059311  9573 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:23.135435  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.135996  8546 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.125314  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 942) took 1167 ms. Trace:
I20260709 12:26:23.126387  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.140401  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.140903  8545 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.131717  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.141710  8537 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.133016  8542 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.144541  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.145601  8542 raft_consensus.cc:2410] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:26:23.144439  8396 rpcz_store.cc:276] 0709 12:26:21.957653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.255335 (+297682us) service_pool.cc:224] Handling call
0709 12:26:22.493387 (+238052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:22.493558 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:26:22.507099 (+ 13541us) log.cc:844] Serialized 14 byte log entry
0709 12:26:22.634246 (+127147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:22.634300 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:22.634339 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.634403 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.085790 (+451387us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b540029ccd0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:23.125256 (+ 39466us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13716,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":12257,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":556619264,"thread_start_us":126792,"threads_started":1,"wal-append.queue_time_us":339838}
I20260709 12:26:23.153303  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.153908  8542 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:26:23.158002  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.160920  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:23.163184  8546 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:23.175096  8537 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:23.182168  8545 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:23.135793  9580 raft_consensus.cc:697] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:23.147804  9514 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.147607  9501 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.172633  9532 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.199115  8542 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:23.171787  9396 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.172328  9478 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:23.131513  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:23.184791  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.213642  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.205516  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:23.214205  8542 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.214673  8395 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:23.206449  8393 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.210148  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:23.211674  8467 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:23.232021  8542 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:23.195792  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.236732  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.237532  8542 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:23.205049  9359 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:23.234748  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:23.242071  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.216359  9478 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.205925  9514 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.259335  9359 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.259860  9359 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.260778  9514 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:23.205788  9501 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.261760  9359 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:23.262260  9359 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.227949  9477 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.262707  9501 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:23.262988  9477 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.249689  9494 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.248483  8541 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:23.216456  9552 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.234635  8390 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.233539  9377 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.238663  9507 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:23.232781  9483 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.244500  9580 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.250320  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.216060  9396 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:23.274062  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 57707.7us
I20260709 12:26:23.257738  9589 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.288530  8397 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.294646  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:23.264647  8388 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:23.285641  8542 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.263870  9494 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.300128  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:23.301252  8361 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:23.306039  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 92046.7us
I20260709 12:26:23.306476  9511 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.306869  9511 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.307195  9511 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:23.295121  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.310382  8542 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:23.312131  8469 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:23.314294  9396 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:23.309128  9573 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.315685  9573 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.315884  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.317534  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.318424  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.318606  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.318621  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.303874  9589 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.321346  8542 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:23.322825  9589 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:23.318234  9488 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.309568  9531 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:23.309288  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.319705  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.324687  8539 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.280555  9552 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.325445  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.326409  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.316035  9573 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.328840  9494 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:23.329301  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:23.292492  9483 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.332373  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:23.311508  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 119031us
I20260709 12:26:23.334249  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:23.334587  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:23.335155  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.335681  8537 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.336221  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:23.339231  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.342412  8467 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:23.342427  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.345715  8395 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:23.347537  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.348656  9478 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:23.349507  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.328913  8389 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:23.350546  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.355108  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.356580  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:23.357308  8393 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:23.282148  9377 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.285398  9507 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.327217  9488 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:23.319042  8538 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.363296  8537 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:23.326653  9552 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:23.333894  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.370343  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.380031  8545 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:23.380393  8537 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:23.312872  9579 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:23.322101  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.382030  8542 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:23.354072  9371 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.382930  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:23.383716  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.354395  9442 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:23.385402  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.388253  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:23.388741  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 52588.1us
I20260709 12:26:23.389425  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:23.390102  8546 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:23.390740  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:23.393217  8542 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:23.391099  8537 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:23.384114  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:23.392069  9477 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:23.358493  9595 consensus_queue.cc:1059] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:26:23.404563  9483 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:23.405843  9507 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:23.407788  9579 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.384995  9396 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:26:23.379926  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.400087  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.400743  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:23.411161  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:23.399196  8396 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:23.411661  8393 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:23.411767  8471 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:23.416980  8438 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:23.384279  9377 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:23.382804  9371 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:23.501137  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 101946us
W20260709 12:26:23.505733  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 168502us
I20260709 12:26:23.507596  8512 leader_election.cc:400] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
W20260709 12:26:23.574635  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 67249.8us
I20260709 12:26:23.575428  8512 leader_election.cc:400] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:23.575851  8512 leader_election.cc:403] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:23.577596  8512 leader_election.cc:400] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:23.577939  8512 leader_election.cc:403] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:23.578821  8512 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:23.583797  8542 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
W20260709 12:26:23.423629  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 1.08849e+06us
I20260709 12:26:23.419586  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:23.415779  9359 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:23.593932  8512 leader_election.cc:400] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:23.650686  8512 leader_election.cc:403] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:23.651397  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 57626.5us
I20260709 12:26:23.393558  9442 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.652067  8512 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:23.593225  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 175442us
I20260709 12:26:23.415660  9581 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:23.649158  8436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.855s (SENT) [suppressed 16 similar messages]
I20260709 12:26:23.630535  8542 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:23.619815  9396 raft_consensus.cc:3055] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:23.620085  9489 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:23.495536  9501 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.565920  9477 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:23.654184  9569 log.cc:927] Time spent T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.772s	user 0.000s	sys 0.005s
I20260709 12:26:23.565342  9592 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:23.636713  9589 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.576604  9540 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:23.737210  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:23.755461  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 252291us
I20260709 12:26:23.632848  9377 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:23.653013  9359 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:23.637310  9507 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 12:26:23.496892  9573 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.752192  9586 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.743793  9396 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:23.777901  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:23.757871  9588 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:23.781947  8544 raft_consensus.cc:2955] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:23.769889  9550 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:26:23.783545  9359 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:23.757544  9501 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.785193  9489 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:23.786711  9594 raft_consensus.cc:2764] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:23.618877  9593 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.206s
I20260709 12:26:23.754526  8539 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:23.769652  9477 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:23.774394  8541 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:23.822491  9602 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:26:23.822886  9479 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:23.823750  9552 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:23.824903  9442 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:23.825814  9371 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:23.761543  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:23.812978  9586 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.813750  9588 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.771467  9589 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:23.832728  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 57566.6us
W20260709 12:26:23.834848  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 447936us
I20260709 12:26:23.812538  9504 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:23.953006  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:23.809271  9488 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 12:26:23.912220  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 263079us
W20260709 12:26:23.933378  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 281369us
W20260709 12:26:23.955040  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.939200  8394 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:23.957629  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:23.827598  9514 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:23.968933  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:23.968256  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:23.973490  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:23.904829  9479 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:23.953753  9483 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:23.960465  9514 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:23.968403  9377 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.968585  9603 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:26:23.988198  9479 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:23.977664  9488 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.910897  9396 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.004359  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.961169  9504 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:23.989887  9514 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:24.034225  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 71781us
I20260709 12:26:23.969059  8543 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:24.030483  9511 consensus_meta.cc:287] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.723s	user 0.006s	sys 0.003s
I20260709 12:26:24.035341  9593 consensus_queue.cc:1059] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:26:24.036160  9377 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.972147  9477 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:24.052381  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 78952.1us
I20260709 12:26:23.963824  9611 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:24.034104  8538 consensus_meta.cc:287] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260709 12:26:24.030840  9603 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:23.969123  9489 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:26:23.984649  9483 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:24.084056  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 125915us
I20260709 12:26:24.087965  9626 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:24.088511  9626 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:24.089314  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 349309us
I20260709 12:26:24.090677  9626 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:24.091346  8363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.029s	sys 0.063s
W20260709 12:26:24.091660  8363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.029s	sys 0.063s
I20260709 12:26:24.041126  9590 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:24.093340  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:24.007726  9488 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.068890  9596 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:26:24.102219  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.080667  8538 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:24.089057  9619 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:24.107554  9613 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:26:24.068229  9511 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.106652  8543 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:24.123064  8538 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.127913  9619 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:24.150722  9616 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:26:24.152387  9619 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.156111  9586 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:24.144527  9605 raft_consensus.cc:2764] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:24.144946  9501 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.158807  9483 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.160221  9504 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:24.105037  9618 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.160822  9618 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:24.161204  9618 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.161479  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:24.162042  8395 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.163448  9589 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.119843  9617 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:24.164273  9617 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.104420  9590 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:24.114724  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:24.171496  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 56841.2us
I20260709 12:26:24.177452  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:24.178598  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:24.179246  9603 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.179746  9603 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.181716  9603 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:24.183383  9504 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.183902  9504 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:24.184695  9504 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.186796  9359 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:24.188647  9589 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.118983  9045 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Advancing to term 2
I20260709 12:26:24.244211  8392 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:24.189226  9044 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 1 LEARNER]: Advancing to term 3
I20260709 12:26:24.190407  9396 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.204330  9488 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.169135  9573 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.146586  9594 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.247663  9511 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.118837  9596 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:24.248059  9594 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.250089  9594 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:24.155319  9592 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:24.250677  9592 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.252195  9359 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:24.124477  9552 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:24.230816  8395 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:24.234503  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 55983us
I20260709 12:26:24.238683  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 609) took 1101 ms. Trace:
I20260709 12:26:24.119560  9532 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:24.124675  9612 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:24.122854  9588 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.243526  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 648) took 1026 ms. Trace:
I20260709 12:26:24.261145  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:24.254350  8436 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:24.263343  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:24.259833  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 290962us
I20260709 12:26:24.244477  9478 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:24.269423  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.270004  8395 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:24.250113  9596 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.261894  9589 raft_consensus.cc:697] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:24.262908  9488 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.272785  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.273437  8438 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:24.262660  8538 rpcz_store.cc:276] 0709 12:26:23.216716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.122384 (+905668us) service_pool.cc:224] Handling call
0709 12:26:24.122723 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.145868 (+ 23145us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.231335 (+ 85467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:24.264703  9532 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:24.281149  9552 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:24.266588  9501 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.267791  9483 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:24.268165  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 653) took 1003 ms. Trace:
I20260709 12:26:24.292975  9625 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.293469  9625 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.295814  9625 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:24.296481  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.297094  8395 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:24.298036  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:24.298274  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.299054  8395 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:24.298936  9478 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.299499  9478 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:24.299860  9478 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.301335  9501 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:24.302205  9501 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.302845  9532 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:24.286136  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:24.287505  8392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 604) took 1775 ms (client timeout 1689 ms). Trace:
I20260709 12:26:24.259740  9618 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:24.288136  9489 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
W20260709 12:26:24.306720  8392 rpcz_store.cc:269] 0709 12:26:22.506581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.738974 (+232393us) service_pool.cc:224] Handling call
0709 12:26:23.329163 (+590189us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:24.279286 (+950123us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b5400103e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:24.282067 (+  2781us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113325184}
I20260709 12:26:24.315743  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.309535  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 638) took 1175 ms. Trace:
I20260709 12:26:24.316421  8537 rpcz_store.cc:276] 0709 12:26:23.133802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.413163 (+279361us) service_pool.cc:224] Handling call
0709 12:26:23.413650 (+   487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.761308 (+347658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.761336 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.761374 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:23.761402 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.309308 (+547906us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54000389d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:24.309347 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:24.309464 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799145216}
I20260709 12:26:24.316026  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:24.318567  8469 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.310005  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 657) took 1026 ms. Trace:
I20260709 12:26:24.322477  8545 rpcz_store.cc:276] 0709 12:26:23.283563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.326194 (+ 42631us) service_pool.cc:224] Handling call
0709 12:26:24.309848 (+983654us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b54000398d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:24.309954 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122118912}
I20260709 12:26:24.327706  8472 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:24.328938  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:24.331697  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.334268  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:24.341346  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.340716  8466 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:24.342835  8545 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:24.343526  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 656) took 1064 ms. Trace:
I20260709 12:26:24.343822  8545 rpcz_store.cc:276] 0709 12:26:23.279157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.323475 (+1044318us) service_pool.cc:224] Handling call
0709 12:26:24.323770 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.343229 (+ 19459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.343471 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:24.346117  8545 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:24.347657  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.292196  8541 rpcz_store.cc:276] 0709 12:26:23.264403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.168928 (+904525us) service_pool.cc:224] Handling call
0709 12:26:24.243541 (+ 74613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.243742 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.243784 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.245517 (+  1733us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:24.254321 (+  8804us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.261901 (+  7580us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:24.267160 (+  5259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:24.274161  9621 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 12:26:24.331302  9594 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:24.348671  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 62614.6us
I20260709 12:26:24.306449  9514 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.308434  9044 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:24.364885  9620 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:24.259534  8391 rpcz_store.cc:276] 0709 12:26:23.137308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.147748 (+ 10440us) service_pool.cc:224] Handling call
0709 12:26:23.653017 (+505269us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:23.753050 (+100033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:23.774438 (+ 21388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.776375 (+  1937us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:23.824421 (+ 48046us) log.cc:844] Serialized 26 byte log entry
0709 12:26:24.083597 (+259176us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:24.097291 (+ 13694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.104859 (+  7568us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:24.170084 (+ 65225us) raft_consensus.cc:1685] finished
0709 12:26:24.176616 (+  6532us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:24.238593 (+ 61977us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15546,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":13871488,"thread_start_us":231411,"threads_started":1,"wal-append.queue_time_us":220096}
I20260709 12:26:24.377458  8537 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:24.365286  8538 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:24.362010  8395 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:24.307073  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.264791  9612 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.376185  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:24.380187  8396 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:24.381930  9499 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:24.385268  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 224) took 3011 ms. Trace:
I20260709 12:26:24.415872  8293 rpcz_store.cc:276] 0709 12:26:21.374191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.374331 (+   140us) service_pool.cc:224] Handling call
0709 12:26:21.642361 (+268030us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f3090 00007f6464391f3a 00007f646a147e9c 00007f646a24604e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc 00007f6468706392 00007f64626c448c 00007f64626c38c6
0709 12:26:24.385195 (+2742834us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21138,"reported_tablets":3,"spinlock_wait_cycles":315069184}
W20260709 12:26:24.387626  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.387777  8292 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 3, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 3 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:24.393272  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 644) took 1245 ms. Trace:
I20260709 12:26:24.419677  8542 rpcz_store.cc:276] 0709 12:26:23.147606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.739070 (+591464us) service_pool.cc:224] Handling call
0709 12:26:24.153852 (+414782us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b5800144098. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:24.392479 (+238627us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b5800144098. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264e9c 00007f6461264a5b 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:24.392663 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.392842 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.392867 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.393010 (+   143us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:24.393044 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.393099 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:24.393213 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39252992}
I20260709 12:26:24.396966  8471 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:24.387113  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:24.398250  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 306312us
I20260709 12:26:24.292339  9552 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:24.350903  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 63389.6us
I20260709 12:26:24.288767  9488 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:24.412348  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.424690  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.439028  8396 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:24.439957  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:24.442881  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 66774.7us
I20260709 12:26:24.447389  8396 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:24.448313  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.452778  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:24.489167  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:24.489832  8395 raft_consensus.cc:2368] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:24.490525  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.490350  9592 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.404074  9620 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:24.437302  9589 consensus_queue.cc:237] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.491602  9620 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:24.415612  9499 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:24.461779  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.462245  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.496110  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.497429  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.429381  8469 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:24.463079  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.446674  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 654) took 1167 ms. Trace:
I20260709 12:26:24.479580  8361 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:24.480873  9618 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:24.482136  9514 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.482692  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.459651  9478 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.488054  9050 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:24.452528  9594 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:24.517026  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:24.517728  8542 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.516978  9594 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:24.493170  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.498495  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:24.466925  8546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1108) took 1299 ms (client timeout 1536 ms). Trace:
I20260709 12:26:24.497749  8395 raft_consensus.cc:2368] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:24.497457  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:24.499646  9612 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:24.462949  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 613) took 1121 ms. Trace:
I20260709 12:26:24.512717  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:24.459545  9576 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.151s
I20260709 12:26:24.455881  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:24.532480  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.532181  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.532980  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.526850  8511 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:24.534435  8472 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:24.523284  8546 rpcz_store.cc:269] 0709 12:26:23.167620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.176890 (+  9270us) service_pool.cc:224] Handling call
0709 12:26:23.332247 (+155357us) spinlock_profiling.cc:243] Waited 20.1 ms on lock 0x7b5800144098. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:24.466754 (+1134507us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b54000384d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:24.466865 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177741568}
I20260709 12:26:24.535338  8542 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:24.536610  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.537328  8395 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:24.534462  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:24.539326  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:24.524139  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:24.544823  8545 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:24.543851  8544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.020s	sys 0.022s
W20260709 12:26:24.545346  8544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.020s	sys 0.022s
I20260709 12:26:24.546036  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1102) took 1379 ms. Trace:
I20260709 12:26:24.546464  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:24.547003  8546 raft_consensus.cc:2376] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3. Re-sending same reply.
I20260709 12:26:24.548094  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.518787  9473 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:24.517311  9593 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:24.549772  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.549962  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:24.548702  8395 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:24.550984  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.551978  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:24.546399  8544 rpcz_store.cc:276] 0709 12:26:23.166209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.781437 (+615228us) service_pool.cc:224] Handling call
0709 12:26:23.781669 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.781839 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:23.837007 (+ 55168us) log.cc:844] Serialized 14 byte log entry
0709 12:26:24.545714 (+708707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.545765 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:24.545808 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.545882 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:24.545984 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":708375,"threads_started":1}
I20260709 12:26:24.524245  9594 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:24.587152  8396 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:24.587314  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:24.534646  9627 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:24.502523  8538 rpcz_store.cc:276] 0709 12:26:23.275886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.308161 (+1032275us) service_pool.cc:224] Handling call
0709 12:26:24.347806 (+ 39645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.400248 (+ 52442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.443618 (+ 43370us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:24.602711  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 63466us
I20260709 12:26:24.540369  9609 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:24.606456  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:24.612412  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:24.649307  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.549266  9371 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:24.704470  8395 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:24.708956  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 96626.2us
I20260709 12:26:24.586886  9618 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:24.726751  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:24.727443  8545 raft_consensus.cc:2376] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3. Re-sending same reply.
I20260709 12:26:24.585636  9489 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:24.728972  9614 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:24.729612  9396 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:24.729990  9573 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:24.759991  9573 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:24.759866  9396 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.760941  9573 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.762122  9396 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.707046  9609 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:24.591820  8541 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:24.763783  9609 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:24.585740  9608 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:24.595595  9045 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:26:24.734443  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:24.788913  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:24.790268  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:24.790900  9478 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.791260  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:24.791672  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:24.876763  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:24.532393  8390 rpcz_store.cc:276] 0709 12:26:23.338706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.354549 (+ 15843us) service_pool.cc:224] Handling call
0709 12:26:24.306929 (+952380us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:24.460215 (+153286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4737408}
I20260709 12:26:24.594694  9629 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.589107  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:24.564093  9593 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.900060  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:24.591554  9628 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.305s
W20260709 12:26:24.767889  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 59596.5us
I20260709 12:26:24.913408  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:24.913754  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:24.914325  8538 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:24.914431  8541 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:24.914696  9624 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:24.915947  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:24.901862  9488 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.906908  9552 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:24.936064  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:24.915547  9629 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.939073  9624 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.933298  9592 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:24.947194  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:24.958864  8438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.015s	sys 0.048s
W20260709 12:26:24.959209  8438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.015s	sys 0.048s
I20260709 12:26:24.946573  8545 raft_consensus.cc:2376] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3. Re-sending same reply.
W20260709 12:26:24.948151  9501 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.028s	sys 0.074s
W20260709 12:26:24.956255  9504 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.042s	sys 0.035s
W20260709 12:26:25.060868  8389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.035s	sys 0.056s
W20260709 12:26:25.041007  9611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.921s	user 0.041s	sys 0.081s
W20260709 12:26:24.958252  9550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.020s	sys 0.067s
I20260709 12:26:25.074306  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.077070  9630 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:24.983852  9504 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.042s	sys 0.035s
W20260709 12:26:24.981896  9501 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.028s	sys 0.074s
I20260709 12:26:24.956528  9016 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:24.841214  9627 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:24.958631  8538 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
W20260709 12:26:25.247766  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.006s
W20260709 12:26:25.463268  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.004s	sys 0.013s
W20260709 12:26:25.463712  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 746604us
W20260709 12:26:25.493803  8394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.126s	user 0.000s	sys 0.038s
I20260709 12:26:25.070705  9396 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:25.352288  9632 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.274s	user 0.000s	sys 0.000s
W20260709 12:26:25.352872  9618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.002s	sys 0.010s
W20260709 12:26:25.115211  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.335505  9013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.012s	sys 0.010s
W20260709 12:26:25.159102  9611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.045s	sys 0.081s
W20260709 12:26:25.494320  8394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.000s	sys 0.039s
W20260709 12:26:25.453382  9550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.370s	user 0.028s	sys 0.086s
I20260709 12:26:25.520543  9586 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:25.523900  9620 consensus_meta.cc:287] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.032s	user 0.009s	sys 0.000s
I20260709 12:26:25.524328  9620 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.525425  8471 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:25.507737  9396 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.148898  9552 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:25.537062  9552 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:25.537930  9594 consensus_meta.cc:287] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.943s	user 0.007s	sys 0.000s
I20260709 12:26:25.538340  9594 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.539211  9552 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.278291  9488 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.414696  9624 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:25.473119  9612 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.162395  9629 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:25.475627  9628 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:25.545272  9612 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.545629  9552 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:25.546042  9628 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:25.546835  9552 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.547273  9612 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:25.526763  9620 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.536553  9396 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:25.507786  9618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.003s	sys 0.011s
W20260709 12:26:25.501482  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 553402us
W20260709 12:26:25.508196  9013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.012s	sys 0.016s
I20260709 12:26:25.543108  9488 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.514412  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.507223  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:25.552839  8468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.000s	sys 0.005s
W20260709 12:26:25.647241  8468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.000s	sys 0.007s
I20260709 12:26:25.517377  9611 raft_consensus.cc:697] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:25.520293  9593 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.518028  9646 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:25.608779  8538 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:25.659169  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 658) took 1134 ms. Trace:
I20260709 12:26:25.659641  8538 rpcz_store.cc:276] 0709 12:26:24.525145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.514085 (+988940us) service_pool.cc:224] Handling call
0709 12:26:25.659108 (+145023us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.659693  9611 consensus_queue.cc:237] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.660938  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:25.554601  9609 consensus_meta.cc:287] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.790s	user 0.005s	sys 0.007s
I20260709 12:26:25.505542  9630 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:25.553117  9573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.000s	sys 0.006s
W20260709 12:26:25.706110  9573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.002s	sys 0.006s
I20260709 12:26:25.587049  9628 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.580626  9618 raft_consensus.cc:697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:25.601559  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 661) took 1075 ms. Trace:
I20260709 12:26:25.707070  8545 rpcz_store.cc:276] 0709 12:26:24.525882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.483110 (+957228us) service_pool.cc:224] Handling call
0709 12:26:25.601485 (+118375us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.701143  9612 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:25.707522  9618 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:25.707872  9612 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.702101  9609 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:25.709502  9552 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.711158  9609 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.712033  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.713171  8545 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:25.713687  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 39) took 1193 ms. Trace:
I20260709 12:26:25.717423  8545 rpcz_store.cc:276] 0709 12:26:24.519932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.711757 (+1191825us) service_pool.cc:224] Handling call
0709 12:26:25.713629 (+  1872us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.711998  9627 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:25.662132  9647 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.002s
I20260709 12:26:25.742022  9594 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:25.776621  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 311920us
W20260709 12:26:25.161810  8389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.036s	sys 0.057s
I20260709 12:26:25.776976  8393 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:25.778825  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 631) took 1843 ms. Trace:
I20260709 12:26:25.518075  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 636) took 1580 ms. Trace:
I20260709 12:26:25.779328  8393 rpcz_store.cc:276] 0709 12:26:23.935160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.774960 (+1839800us) service_pool.cc:224] Handling call
0709 12:26:25.776096 (+  1136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.778368 (+  2272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.778713 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.780993  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 634) took 1843 ms. Trace:
I20260709 12:26:25.805094  8389 rpcz_store.cc:276] 0709 12:26:23.937595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.946250 (+  8655us) service_pool.cc:224] Handling call
0709 12:26:23.977650 (+ 31400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:24.007575 (+ 29925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.029867 (+ 22292us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:24.105425 (+ 75558us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.778684 (+1673259us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.778795 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.778906 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:25.779033 (+   127us) raft_consensus.cc:1685] finished
0709 12:26:25.779052 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.780790 (+  1738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5958,"raft.queue_time_us":15128,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":25477,"thread_start_us":1609310,"threads_started":1,"wal-append.queue_time_us":1482130}
I20260709 12:26:25.807252  9653 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.550433  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 964) took 1474 ms. Trace:
I20260709 12:26:25.782963  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 632) took 1847 ms. Trace:
I20260709 12:26:25.808352  9653 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.779134  8361 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:25.809747  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.787638  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1007) took 1266 ms. Trace:
I20260709 12:26:25.788877  9592 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:25.799757  9576 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.800382  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:25.661568  8538 raft_consensus.cc:2376] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3. Re-sending same reply.
I20260709 12:26:25.804016  8464 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:25.804324  8436 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.006s	sys 0.000s
W20260709 12:26:25.811020  8541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1136) took 1303 ms (client timeout 1719 ms). Trace:
W20260709 12:26:25.860499  8541 rpcz_store.cc:269] 0709 12:26:24.507226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.917894 (+410668us) service_pool.cc:224] Handling call
0709 12:26:25.809312 (+891418us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b5800144098. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:25.810869 (+  1557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8989440}
I20260709 12:26:25.861182  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.862349  8545 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:25.862905  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:25.863323  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 671) took 1258 ms. Trace:
I20260709 12:26:25.808399  8388 rpcz_store.cc:276] 0709 12:26:23.935388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.946842 (+ 11454us) service_pool.cc:224] Handling call
0709 12:26:25.781748 (+1834906us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264eee 000000000036eb39 00007f64692d81e0 00007f64693a10c4 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:25.782065 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.782441 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.782478 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.782535 (+    57us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.782572 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.782631 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.782774 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5444480}
I20260709 12:26:25.820925  9639 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:25.832664  9644 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:25.829635  9488 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.866585  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 965) took 1790 ms. Trace:
W20260709 12:26:25.867055  8436 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.009s	sys 0.001s
I20260709 12:26:25.866794  9574 raft_consensus.cc:3055] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:26:25.891851  8292 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.451s	user 0.017s	sys 0.012s
I20260709 12:26:25.808758  8396 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:25.823622  8466 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:25.826867  9628 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:25.779702  8394 rpcz_store.cc:276] 0709 12:26:23.938090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.956869 (+ 18779us) service_pool.cc:224] Handling call
0709 12:26:23.957096 (+   227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.957259 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:26:24.367289 (+410030us) log.cc:844] Serialized 14 byte log entry
0709 12:26:25.517715 (+1150426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.517765 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:25.517802 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.517896 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.518020 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":605860,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":2688,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":1540309,"threads_started":2,"wal-append.queue_time_us":1181468}
I20260709 12:26:25.836153  9630 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:25.808722  8395 rpcz_store.cc:276] 0709 12:26:24.076184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.705554 (+629370us) service_pool.cc:224] Handling call
0709 12:26:24.705828 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.706023 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:26:25.072988 (+366965us) log.cc:844] Serialized 14 byte log entry
0709 12:26:25.550100 (+477112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.550154 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:25.550198 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.550262 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.550378 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5930,"prepare.queue_time_us":19763,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":4439,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":7514,"thread_start_us":812246,"threads_started":2,"wal-append.queue_time_us":667687}
I20260709 12:26:25.837389  9573 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:25.874128  9371 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:25.874366  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1140) took 1360 ms. Trace:
I20260709 12:26:25.810951  9592 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.877143  9653 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:25.843811  9501 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:25.877141  8469 raft_consensus.cc:2955] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:25.881476  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 649) took 2654 ms. Trace:
I20260709 12:26:25.874594  9594 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.885264  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 208) took 2389 ms. Trace:
W20260709 12:26:25.890213  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 102115us
I20260709 12:26:25.845721  8295 catalog_manager.cc:5697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:25.885205  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1002) took 1400 ms. Trace:
I20260709 12:26:25.897708  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 664) took 1371 ms. Trace:
I20260709 12:26:25.898732  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 963) took 1822 ms. Trace:
W20260709 12:26:25.901060  8292 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.460s	user 0.018s	sys 0.012s
I20260709 12:26:25.886463  8545 rpcz_store.cc:276] 0709 12:26:24.604419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.719233 (+1114814us) service_pool.cc:224] Handling call
0709 12:26:25.863214 (+143981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.904719  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1008) took 1379 ms. Trace:
I20260709 12:26:25.900960  9574 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:25.920616  9574 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.907536  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 640) took 1806 ms. Trace:
I20260709 12:26:25.921818  8396 rpcz_store.cc:276] 0709 12:26:24.099485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.807921 (+1708436us) service_pool.cc:224] Handling call
0709 12:26:25.808393 (+   472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.903301 (+ 94908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.905591 (+  2290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.911162  9043 rpcz_store.cc:276] 0709 12:26:23.620099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.652863 (+ 32764us) service_pool.cc:224] Handling call
0709 12:26:25.883847 (+2230984us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264eee 000000000036eb39 00007f64692d81e0 00007f64693a10c4 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:25.884220 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.884672 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.884703 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.884765 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:25.884797 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.884866 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.885001 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30463744}
I20260709 12:26:25.923797  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 647) took 1619 ms. Trace:
I20260709 12:26:25.924254  8396 rpcz_store.cc:276] 0709 12:26:24.304186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.922630 (+1618444us) service_pool.cc:224] Handling call
0709 12:26:25.923042 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.923340 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.923369 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.923435 (+    66us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.923466 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.923523 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.923699 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.823459  9645 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:25.748479  9612 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:25.912410  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 657982us
I20260709 12:26:25.913426  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 643) took 1743 ms. Trace:
I20260709 12:26:25.913764  8394 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:25.906639  8538 rpcz_store.cc:276] 0709 12:26:24.513779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.660655 (+1146876us) service_pool.cc:224] Handling call
0709 12:26:25.874147 (+213492us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.927691  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 968) took 1639 ms. Trace:
I20260709 12:26:25.906446  9371 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:25.928470  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.929106  9371 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.915990  8466 rpcz_store.cc:276] 0709 12:26:24.525153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.798189 (+1273036us) service_pool.cc:224] Handling call
0709 12:26:25.798930 (+   741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.903837 (+104907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.904651 (+   814us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.917145  9653 consensus_queue.cc:1059] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:25.930369  9653 raft_consensus.cc:3055] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:25.915669  8391 rpcz_store.cc:276] 0709 12:26:24.075978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.714350 (+638372us) service_pool.cc:224] Handling call
0709 12:26:24.763731 (+ 49381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:24.900614 (+136883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.900648 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:24.901139 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.041518 (+140379us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:25.373148 (+331630us) log.cc:844] Serialized 14 byte log entry
0709 12:26:25.494239 (+121091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.897914 (+403675us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54002b5a54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:25.898002 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:25.898094 (+    92us) raft_consensus.cc:1685] finished
0709 12:26:25.898234 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.898533 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":275023,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":72792,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9623,"spinlock_wait_cycles":285701504,"thread_start_us":139951,"threads_started":1,"wal-append.queue_time_us":619674}
I20260709 12:26:25.930783  9653 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:25.932096  9653 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.933126  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 639) took 1834 ms. Trace:
I20260709 12:26:25.928824  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.933629  9653 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:25.934312  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1141) took 1420 ms. Trace:
I20260709 12:26:25.934686  8538 rpcz_store.cc:276] 0709 12:26:24.514015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.928412 (+1414397us) service_pool.cc:224] Handling call
0709 12:26:25.934235 (+  5823us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.900874  8390 rpcz_store.cc:276] 0709 12:26:24.076391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.915927 (+839536us) service_pool.cc:224] Handling call
0709 12:26:24.935064 (+ 19137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:24.948109 (+ 13045us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.952329 (+  4220us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:25.112420 (+160091us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.865308 (+752888us) spinlock_profiling.cc:243] Waited 83 ms on lock 0x7b54000d4420. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f3090 00007f64643006b8 00007f646438992b 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c
0709 12:26:25.865409 (+   101us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.865477 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.865592 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:25.866071 (+   479us) raft_consensus.cc:1685] finished
0709 12:26:25.866092 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.866380 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3981,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":9689,"spinlock_wait_cycles":190828416,"thread_start_us":405703,"threads_started":1,"wal-append.queue_time_us":467156}
I20260709 12:26:25.928223  8394 rpcz_store.cc:276] 0709 12:26:24.287283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.910545 (+1623262us) service_pool.cc:224] Handling call
0709 12:26:25.913403 (+  2858us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:25.926913 (+ 13510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.927073 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.935808  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.936369  8438 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:25.936645  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1129) took 1431 ms. Trace:
I20260709 12:26:25.937101  8538 rpcz_store.cc:276] 0709 12:26:24.505661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.935475 (+1429814us) service_pool.cc:224] Handling call
0709 12:26:25.936571 (+  1096us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.938076  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:25.911635  8467 rpcz_store.cc:276] 0709 12:26:24.484639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.535983 (+ 51344us) service_pool.cc:224] Handling call
0709 12:26:24.536223 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.922407 (+386184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.922435 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.922471 (+    36us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:24.922500 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.842867 (+920367us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54000d8ed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:25.875256 (+ 32389us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.885012 (+  9756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":887712000}
I20260709 12:26:25.938766  8538 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:25.871349  8468 rpcz_store.cc:276] 0709 12:26:24.520761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.736330 (+215569us) service_pool.cc:224] Handling call
0709 12:26:24.878050 (+141720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:24.878434 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.878462 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:24.896714 (+ 18252us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.647863 (+751149us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.647907 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.647984 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:25.786783 (+138799us) raft_consensus.cc:1685] finished
0709 12:26:25.786842 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.787262 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":430,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":14968,"thread_start_us":727546,"threads_started":1,"wal-append.queue_time_us":716553}
W20260709 12:26:25.885541  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 276964us
I20260709 12:26:25.926744  8388 rpcz_store.cc:276] 0709 12:26:24.169724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.908408 (+1738684us) service_pool.cc:224] Handling call
0709 12:26:25.912605 (+  4197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.912974 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.913011 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.913081 (+    70us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.913144 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.913212 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.913352 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.910380  8543 rpcz_store.cc:276] 0709 12:26:23.227152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.154644 (+927492us) service_pool.cc:224] Handling call
0709 12:26:25.879762 (+1725118us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5800144098. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:25.880233 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.880792 (+   559us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.880831 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.880903 (+    72us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.880983 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.881076 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.881237 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30128512}
I20260709 12:26:25.947680  9595 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:25.951014  9595 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:25.956377  9595 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:25.955862  9589 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.957188  9589 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:25.933561  8389 rpcz_store.cc:276] 0709 12:26:24.098901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.807540 (+1708639us) service_pool.cc:224] Handling call
0709 12:26:25.915638 (+108098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.932720 (+ 17082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.932757 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:25.932805 (+    48us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.932858 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.932934 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.933064 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.915844  9573 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:25.969520  8295 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:25.970973  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 40) took 1428 ms. Trace:
I20260709 12:26:25.971524  8538 rpcz_store.cc:276] 0709 12:26:24.520161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.937722 (+1417561us) service_pool.cc:224] Handling call
0709 12:26:25.948383 (+ 10661us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:25.973698  9617 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:25.975034  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 175147us
I20260709 12:26:25.943497  9645 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:25.997382  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.977980  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:26.038097  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 259223us
I20260709 12:26:26.002969  8395 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.027129  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:26.037662  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 629) took 2102 ms. Trace:
I20260709 12:26:25.914943  8541 rpcz_store.cc:276] 0709 12:26:24.526573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.862254 (+1335681us) service_pool.cc:224] Handling call
0709 12:26:25.897586 (+ 35332us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:26.003615  9600 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 2.218s	user 0.004s	sys 0.049s
I20260709 12:26:26.061612  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1103) took 2895 ms. Trace:
I20260709 12:26:26.061751  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:26.062304  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 655) took 2784 ms. Trace:
W20260709 12:26:26.066314  9601 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 2.292s	user 0.034s	sys 0.019s
I20260709 12:26:26.068701  9589 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:26.069101  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:26.068876  9499 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:26.006408  9636 log.cc:927] Time spent T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.514s	user 0.002s	sys 0.007s
I20260709 12:26:26.060351  8397 rpcz_store.cc:276] 0709 12:26:23.934674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.036428 (+2101754us) service_pool.cc:224] Handling call
0709 12:26:26.036928 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.037189 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.037218 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:26.037262 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:26.037324 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.037386 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.037502 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.074523  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 966) took 1787 ms. Trace:
I20260709 12:26:26.077158  8395 rpcz_store.cc:276] 0709 12:26:24.283112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.910845 (+1627733us) service_pool.cc:224] Handling call
0709 12:26:26.002524 (+ 91679us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.060924 (+ 58400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.070504 (+  9580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.024379  9592 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:26.078850  9573 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.074129  8537 rpcz_store.cc:276] 0709 12:26:23.278173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.317453 (+1039280us) service_pool.cc:224] Handling call
0709 12:26:24.317811 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.377940 (+ 60129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.061839 (+1683899us) spinlock_profiling.cc:243] Waited 59.4 ms on lock 0x7b540006a9d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:26.062143 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136726784}
I20260709 12:26:25.960518  9639 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.090677  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:25.972426  9644 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:26.092861  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 672) took 1378 ms (client timeout 1811 ms). Trace:
I20260709 12:26:26.076090  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:26.097409  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 669) took 1505 ms (client timeout 1954 ms). Trace:
W20260709 12:26:26.097854  8543 rpcz_store.cc:269] 0709 12:26:24.592411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.950497 (+1358086us) service_pool.cc:224] Handling call
0709 12:26:26.097348 (+146851us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:26.095726  8545 rpcz_store.cc:269] 0709 12:26:24.714745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.951616 (+1236871us) service_pool.cc:224] Handling call
0709 12:26:26.092802 (+141186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.003870  8295 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.106954  9579 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:26.107995  9658 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.111722  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 637) took 2024 ms. Trace:
I20260709 12:26:26.111997  8538 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:26.090744  9645 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.112217  8393 rpcz_store.cc:276] 0709 12:26:24.085391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.781213 (+1695822us) service_pool.cc:224] Handling call
0709 12:26:25.781785 (+   572us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:25.782442 (+   657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:25.782470 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:25.783273 (+   803us) log.cc:844] Serialized 26 byte log entry
0709 12:26:25.906267 (+122994us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:25.906305 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.906795 (+   490us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:26.109177 (+202382us) raft_consensus.cc:1685] finished
0709 12:26:26.109193 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.109322 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35842,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":296,"thread_start_us":122512,"threads_started":1,"wal-append.queue_time_us":234035}
W20260709 12:26:26.114611  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 52992.4us
I20260709 12:26:26.115736  9479 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:26.116433  9479 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.118701  9499 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.118634  9659 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.119817  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:26.120586  9479 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:26.121115  9479 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:26.097779  9550 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:26.112625  8538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 668) took 1547 ms (client timeout 1992 ms). Trace:
I20260709 12:26:26.123838  9532 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.073838  8539 rpcz_store.cc:276] 0709 12:26:23.166468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.932159 (+765691us) service_pool.cc:224] Handling call
0709 12:26:24.341112 (+408953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.361307 (+ 20195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.365609 (+  4302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.365667 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:24.365701 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.371457 (+  5756us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.059766 (+1688309us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54000398d0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:26.061426 (+  1660us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796607744}
W20260709 12:26:26.127535  8538 rpcz_store.cc:269] 0709 12:26:24.564759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:25.974035 (+1409276us) service_pool.cc:224] Handling call
0709 12:26:26.112555 (+138520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.021974  9594 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:26.016848  9628 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.089215  9371 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.133352  8397 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:26.133541  9371 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.120586  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 659) took 1595 ms. Trace:
I20260709 12:26:26.109570  9579 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:26.124894  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:26.130183  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.130442  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:26.031348  9501 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.135363  8542 rpcz_store.cc:276] 0709 12:26:24.525403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.119393 (+1593990us) service_pool.cc:224] Handling call
0709 12:26:26.120533 (+  1140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.134660  9550 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.141458  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 53) took 1961 ms. Trace:
I20260709 12:26:26.141649  8295 catalog_manager.cc:5697] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.141960  9048 rpcz_store.cc:276] 0709 12:26:24.179634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.179776 (+   142us) service_pool.cc:224] Handling call
0709 12:26:26.140237 (+1960461us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:26.140563 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.140951 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.140982 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:26.141049 (+    67us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:26.141079 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.141142 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.141251 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24993536}
I20260709 12:26:26.153805  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 994) took 1706 ms. Trace:
I20260709 12:26:26.143769  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:26.494676  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.310856  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1126) took 1805 ms. Trace:
I20260709 12:26:26.208714  8396 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:26.154914  8537 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:26.327507  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:26.212882  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:26.155385  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1000) took 1693 ms. Trace:
W20260709 12:26:26.504769  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62076.4us
W20260709 12:26:26.396565  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.229851  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:26.237305  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.504272  8546 rpcz_store.cc:276] 0709 12:26:24.504977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.309619 (+1804642us) service_pool.cc:224] Handling call
0709 12:26:26.310065 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.310403 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.310435 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:26.310491 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:26.310517 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.310566 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.310677 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.304986  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:26.507726  8537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1146) took 1988 ms (client timeout 2093 ms). Trace:
I20260709 12:26:26.141337  9550 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:26.511741  8537 rpcz_store.cc:269] 0709 12:26:24.519382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.090340 (+1570958us) service_pool.cc:224] Handling call
0709 12:26:26.503487 (+413147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:26.328333  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.506155  8472 rpcz_store.cc:276] 0709 12:26:24.461843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.461943 (+   100us) service_pool.cc:224] Handling call
0709 12:26:24.462206 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.534856 (+ 72650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.155009 (+1620153us) spinlock_profiling.cc:243] Waited 72 ms on lock 0x7b540018a454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:26.155229 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165645696}
I20260709 12:26:26.287760  9574 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:26.511945  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 486326us
I20260709 12:26:26.285768  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:26.503381  8471 rpcz_store.cc:276] 0709 12:26:24.446881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.447227 (+   346us) service_pool.cc:224] Handling call
0709 12:26:24.451711 (+  4484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:25.525838 (+1074127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.153383 (+627545us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000249d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:26.153640 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2468801280}
I20260709 12:26:26.496322  9628 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:26.153887  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.157001  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.133570  9590 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:26.156244  9658 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.536597  8394 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.538808  8512 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:26.540622  9489 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.545782  9501 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:26.551345  8546 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.239421  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 989) took 3031 ms. Trace:
I20260709 12:26:26.518090  8545 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:26:26.556037  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1142) took 2041 ms (client timeout 2154 ms). Trace:
W20260709 12:26:26.556874  8545 rpcz_store.cc:269] 0709 12:26:24.514237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.123064 (+1608827us) service_pool.cc:224] Handling call
0709 12:26:26.555893 (+432829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.553675  8463 rpcz_store.cc:276] 0709 12:26:23.207769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.214149 (+  6380us) service_pool.cc:224] Handling call
0709 12:26:23.258283 (+ 44134us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:23.285113 (+ 26830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.296549 (+ 11436us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:23.319185 (+ 22636us) log.cc:844] Serialized 26 byte log entry
0709 12:26:23.394640 (+ 75455us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:23.396231 (+  1591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.420872 (+ 24641us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:26.065482 (+2644610us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:26.238924 (+173442us) raft_consensus.cc:1685] finished
0709 12:26:26.238957 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.239240 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2655,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13749,"spinlock_wait_cycles":73399040,"thread_start_us":56957,"threads_started":1,"wal-append.queue_time_us":345332}
I20260709 12:26:26.204535  8295 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 3, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:26.561060  8538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1145) took 2046 ms (client timeout 2230 ms). Trace:
W20260709 12:26:26.561551  8538 rpcz_store.cc:269] 0709 12:26:24.514926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.156667 (+1641741us) service_pool.cc:224] Handling call
0709 12:26:26.561003 (+404336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.562350  8295 catalog_manager.cc:5697] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.231882  9552 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.564260  8395 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.135322  9630 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:26.501725  9639 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:26.207270  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.520756  8543 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:26.569087  8542 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:26.569162  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 660) took 2043 ms (client timeout 2111 ms). Trace:
I20260709 12:26:26.143895  9595 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.204327  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:26.504829  9594 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.521320  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 632) took 4001 ms. Trace:
I20260709 12:26:26.524637  8391 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.551285  8537 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.211563  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.278693  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:26.569590  8543 rpcz_store.cc:269] 0709 12:26:24.525640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.109411 (+1583771us) service_pool.cc:224] Handling call
0709 12:26:26.569101 (+459690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.542531  8512 leader_election.cc:400] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:26.570370  8545 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.572122  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1127) took 2062 ms. Trace:
I20260709 12:26:26.564270  8295 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.581781  8392 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:26.575088  8544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 667) took 2024 ms (client timeout 2188 ms). Trace:
I20260709 12:26:26.597029  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1143) took 2069 ms. Trace:
I20260709 12:26:26.597858  8512 leader_election.cc:403] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.568274  9630 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.567342  9644 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.599208  8537 rpcz_store.cc:276] 0709 12:26:24.514467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.514022 (+1999555us) service_pool.cc:224] Handling call
0709 12:26:26.549507 (+ 35485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.583775 (+ 34268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.583977 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478080}
W20260709 12:26:26.583366  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:26.596410  8544 rpcz_store.cc:269] 0709 12:26:24.550735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.153404 (+1602669us) service_pool.cc:224] Handling call
0709 12:26:26.575033 (+421629us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.599447  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 662) took 2073 ms. Trace:
I20260709 12:26:26.238288  9579 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.604382  8545 rpcz_store.cc:276] 0709 12:26:24.526124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.558458 (+2032334us) service_pool.cc:224] Handling call
0709 12:26:26.559179 (+   721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.597925 (+ 38746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.599374 (+  1449us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.574534  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.596530  8546 rpcz_store.cc:276] 0709 12:26:24.505204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.514607 (+2009403us) service_pool.cc:224] Handling call
0709 12:26:26.548844 (+ 34237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.566479 (+ 17635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:26.567958 (+  1479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.607278  9580 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.603542  9630 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.571952  9552 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.604262  9658 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:26.598584  9628 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:26.602412  8388 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:26.644141  9489 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:26.600801  9501 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:26:26.610502  9046 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:26.650651  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:26.658883  9048 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
W20260709 12:26:26.669185  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 552130us
W20260709 12:26:26.646106  8539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1144) took 2131 ms (client timeout 2206 ms). Trace:
I20260709 12:26:26.581684  8540 rpcz_store.cc:276] 0709 12:26:22.516402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.148566 (+632164us) service_pool.cc:224] Handling call
0709 12:26:23.706632 (+558066us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b5800144098. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:24.472877 (+766245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.485145 (+ 12268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.485177 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.485223 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:24.485254 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.485318 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:26.226693 (+1741375us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54000384d0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:26.516884 (+290191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669280384}
I20260709 12:26:26.640352  8541 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:26.657308  9594 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:26.694168  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:26.695029  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 101111us
I20260709 12:26:26.697788  9502 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:26.700258  9502 consensus_queue.cc:1059] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:26.705973  9540 raft_consensus.cc:3055] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.706403  9540 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:26.709972  8392 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:26.668895  9531 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:26.667699  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 57) took 2480 ms (client timeout 2176 ms). Trace:
I20260709 12:26:26.666779  8390 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
W20260709 12:26:26.686919  8539 rpcz_store.cc:269] 0709 12:26:24.514697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.144230 (+1629533us) service_pool.cc:224] Handling call
0709 12:26:26.643650 (+499420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:26.720391  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:26.714258  8436 leader_election.cc:336] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.855s (SENT)
I20260709 12:26:26.722293  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:26.669986  9628 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.732908  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:26.709009  8541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 665) took 2157 ms (client timeout 2041 ms). Trace:
I20260709 12:26:26.731751  8436 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:26.732940  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.733146  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.742995  9048 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:26.743857  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.743180  8471 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:26.725454  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.750382  9594 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.752128  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.745406  8389 raft_consensus.cc:2393] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:26.754343  9594 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.755024  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.755558  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.755741  8389 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
W20260709 12:26:26.751163  9668 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:26:26.757881  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.748353  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.763046  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.767863  8393 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:26.770578  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 56360.7us
I20260709 12:26:26.770525  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:26.707510  9540 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.749410  9595 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:26.742641  8541 rpcz_store.cc:269] 0709 12:26:24.533798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.096816 (+1563018us) service_pool.cc:224] Handling call
0709 12:26:26.690888 (+594072us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:26.774979  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 232963us
I20260709 12:26:26.774998  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.775579  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:26.724511  9046 rpcz_store.cc:269] 0709 12:26:24.181057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.182573 (+  1516us) service_pool.cc:224] Handling call
0709 12:26:26.158485 (+1975912us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:26.661337 (+502852us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18684672}
I20260709 12:26:26.782882  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:26.784436  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.785224  8463 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 1.
I20260709 12:26:26.786186  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.787015  8469 raft_consensus.cc:2410] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:26.787680  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:26.788908  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.790076  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.791566  8394 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:26.792411  9552 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:26.794761  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:26.795135  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.795359  8471 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.796475  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.798460  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.799517  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:26.800190  8464 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:26.800683  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.800850  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.803037  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:26.783164  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.800596  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.803879  8465 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:26.809545  8392 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:26.791185  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.811314  8396 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:26.771308  9043 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:26.814844  8471 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:26.823000  8394 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.823467  8395 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:26.782160  9501 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.825546  8512 leader_election.cc:400] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:26.827155  8512 leader_election.cc:403] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.773448  9531 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:26:26.830523  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:26.826009  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:26.837865  8542 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
W20260709 12:26:26.838519  8542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1130) took 2332 ms (client timeout 2949 ms). Trace:
W20260709 12:26:26.839032  8542 rpcz_store.cc:269] 0709 12:26:24.505896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.229498 (+1723602us) service_pool.cc:224] Handling call
0709 12:26:26.838464 (+608966us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:26.840890  9673 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:26:26.831099  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.830797  9590 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:26.855165  8392 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:26.856561  8388 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:26.858196  9015 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:26.859565  9644 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:26.859982  8469 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:26.860517  9670 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:26.860924  9670 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:26.861272  9670 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.862108  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:26.863669  9618 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:26.864352  9501 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.865098  9618 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:26.865808  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:26.844301  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.868208  8463 raft_consensus.cc:2410] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:26:26.872640  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 98699.3us
I20260709 12:26:26.874089  9015 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:26.860122  9644 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.877444  9540 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.878706  9644 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:26.881992  9663 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:26:26.879208  9644 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:26.887058  9644 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:26.887481  9644 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.888576  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:26.890322  8389 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.891023  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:26.882408  9618 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:26:26.891698  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:26.882683  9628 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.892913  9531 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:26.893311  9531 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.893647  9531 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.894609  9670 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.895644  9625 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3.
I20260709 12:26:26.895884  9046 raft_consensus.cc:2393] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 2: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
W20260709 12:26:26.896471  9665 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.218s	user 0.000s	sys 0.002s
I20260709 12:26:26.901265  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.901889  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:26.902452  8466 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.903857  8541 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.905772  9594 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.905707  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:26.906368  9594 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.907163  8464 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:26.908447  9594 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.908664  9639 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.910192  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:26.892282  8388 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:26.911207  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.911872  8540 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:26.912798  9639 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:26.910485  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.914762  9670 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:26.913194  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.919829  9644 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.921579  9050 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:26.922940  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:26.892220  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:26.923498  8467 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:26.925540  9630 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:26.928251  9594 consensus_queue.cc:1059] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:26.928556  8391 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:26.943336  8467 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:26.982002  8466 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:26.988159  8541 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:26.988688  8541 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:26.989830  8541 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:26.990994  8541 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:26.991707  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:26.929261  9594 raft_consensus.cc:3055] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:26.994015  9594 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:26:26.998304  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.022570  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:27.025882  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 133822us
I20260709 12:26:27.014931  9630 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:27.027781  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:26.995007  9594 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:27.032841  8542 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:27.024233  9625 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.024521  9502 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:27.024151  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:27.023023  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 158034us
I20260709 12:26:27.036247  8544 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:27.051735  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 189767us
W20260709 12:26:27.054867  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 238057us
I20260709 12:26:27.055809  8512 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:27.047010  9644 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.047466  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.062165  8362 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.063133  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.063879  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.043227  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.075534  8537 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.076737  9494 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:27.068539  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 670) took 2463 ms. Trace:
I20260709 12:26:27.078239  9489 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.078622  8388 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:27.078778  9489 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:27.080942  9489 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.077564  8538 rpcz_store.cc:276] 0709 12:26:24.600138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.562337 (+1962199us) service_pool.cc:224] Handling call
0709 12:26:26.562810 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:26.563166 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:26:26.568694 (+  5528us) log.cc:844] Serialized 14 byte log entry
0709 12:26:27.032438 (+463744us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:27.032970 (+   532us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:27.038538 (+  5568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:27.048679 (+ 10141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:27.062668 (+ 13989us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":715,"prepare.queue_time_us":219,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":26165,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"thread_start_us":368329,"threads_started":2,"wal-append.queue_time_us":273705}
I20260709 12:26:27.081390  9489 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.081813  9489 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.035033  9015 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:27.089336  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:27.087186  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.088537  8544 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:27.090543  8542 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:27.084045  8512 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:27.088809  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 57989.5us
I20260709 12:26:27.121567  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:27.119493  8546 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:27.126356  8545 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:27.083150  9552 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.068516  9630 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:27.082306  9588 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:27.127759  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 43851.6us
I20260709 12:26:27.120800  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.114718  9594 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.132880  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.136176  8544 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:27.133363  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.138166  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:27.061844  9625 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.140076  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.124413  9644 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.085932  9592 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:26:27.122211  9690 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.149947  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.077301  9494 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.087702  9574 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:26:27.132862  9588 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:27.154709  8537 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:27.127764  8539 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:27.381255  8511 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:27.173717  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.162832  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:27.483114  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.485522  8543 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:27.193049  9531 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:27.154172  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 91190.8us
I20260709 12:26:27.486865  8436 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:26:27.123199  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 96188.6us
I20260709 12:26:27.156395  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:27.189572  9686 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.322s
I20260709 12:26:27.477501  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:27.191960  9501 raft_consensus.cc:2764] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:26:27.328261  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 171657us
W20260709 12:26:27.407799  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 281320us
I20260709 12:26:27.329937  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:27.494966  8292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46076 (request call id 87) took 3664 ms. Trace:
I20260709 12:26:27.495137  9685 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.156332  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.151707  9630 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:27.496675  9630 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:27.154572  9684 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:27.497946  9684 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.498929  9630 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:27.499462  9630 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.499614  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:27.500080  8512 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:27.500598  9688 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:26:27.173722  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:27.501451  9681 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
I20260709 12:26:27.487355  8438 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.492586  9050 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:27.189215  9689 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:27.189765  9690 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.502818  9630 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.503556  9550 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:27.503824  9574 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:27.504312  9574 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.504662  9574 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.502578  8438 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.507568  9682 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:27.507745  8388 raft_consensus.cc:1240] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:26:27.508253  9479 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.508859  9479 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:27.509829  9479 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.511512  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.512385  9504 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.512745  9504 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:27.513088  9504 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.514858  9531 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:27.502543  9689 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:27.515784  9689 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:27.517221  9540 consensus_meta.cc:287] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.002s
I20260709 12:26:27.517750  8393 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:27.519757  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 667) took 1309 ms. Trace:
I20260709 12:26:27.520157  8393 rpcz_store.cc:276] 0709 12:26:26.210725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.768598 (+557873us) service_pool.cc:224] Handling call
0709 12:26:27.519593 (+750995us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b54003dd1d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:27.519701 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697093888}
I20260709 12:26:27.520494  9489 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.520807  9494 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.521307  9494 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:27.521548  9625 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.522327  9625 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.523386  9630 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.495615  8292 rpcz_store.cc:276] 0709 12:26:23.822562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.824867 (+  2305us) service_pool.cc:224] Handling call
0709 12:26:27.474929 (+3650062us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:25.823224 (+     0us) spinlock_profiling.cc:243] Waited 39 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f646127f0ac 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f6461299455 00007f6467dbe16c
0709 12:26:26.069695 (+246471us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:26.114558 (+ 44863us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:26.114604 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:26:26.114652 (+    48us) tablet.cc:662] Decoding operations
0709 12:26:26.115079 (+   427us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:26.115171 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:26.115215 (+    44us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:26.115569 (+   354us) tablet.cc:701] Row locks acquired
0709 12:26:26.115618 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:26:26.115834 (+   216us) write_op.cc:270] Start()
0709 12:26:26.116097 (+   263us) write_op.cc:276] Timestamp: P: 1783599986115774 usec, L: 0
0709 12:26:26.116135 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:26:26.313965 (+197830us) log.cc:844] Serialized 529 byte log entry
0709 12:26:26.855234 (+541269us) op_driver.cc:464] REPLICATION: finished
0709 12:26:27.124539 (+269305us) write_op.cc:301] APPLY: starting
0709 12:26:27.124632 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:27.124759 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:27.124788 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:27.125076 (+   288us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:27.135618 (+ 10542us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:27.150106 (+ 14488us) write_op.cc:312] APPLY: finished
0709 12:26:27.174151 (+ 24045us) log.cc:844] Serialized 22 byte log entry
0709 12:26:27.174349 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:27.174423 (+    74us) write_op.cc:454] Released schema lock
0709 12:26:27.174488 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:27.174934 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:27.174959 (+    25us) write_op.cc:454] Released schema lock
0709 12:26:27.191371 (+ 16412us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438632a 00007f646430bf14 00007f646430bec3 00007f646430be38 00007f646430bdf3 00007f646430b0dc 00007f6464334e16 00007f646431ccbb 00007f646430739d 00007f646430ad75
Metrics: {"mutex_wait_us":433906,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":242282,"apply.run_cpu_time_us":2241,"apply.run_wall_time_us":50360,"num_ops":1,"prepare.queue_time_us":1605947,"prepare.run_cpu_time_us":12472,"prepare.run_wall_time_us":478163,"raft.queue_time_us":534639,"raft.run_cpu_time_us":13753,"raft.run_wall_time_us":381060,"replication_time_us":735592,"spinlock_wait_cycles":176712192,"thread_start_us":1946319,"threads_started":4,"wal-append.queue_time_us":270093}]]}
I20260709 12:26:27.524736  9504 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.194382  9644 raft_consensus.cc:697] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:26:27.526175  8541 consensus_meta.cc:287] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.000s
W20260709 12:26:27.489089  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.526376  9644 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:27.526899  9504 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.519743  8438 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.150928  9552 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.531235  9552 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.531759  9552 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:27.532156  9552 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:27.532321  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.533289  9639 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.533715  9639 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:27.534065  9639 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.522513  8538 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:27.504577  9683 log.cc:927] Time spent T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 12:26:27.536433  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 671) took 1298 ms. Trace:
I20260709 12:26:27.504604  9690 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.536943  9684 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.536840  8397 rpcz_store.cc:276] 0709 12:26:26.238214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.822101 (+583887us) service_pool.cc:224] Handling call
0709 12:26:26.830921 (+  8820us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:26.842691 (+ 11770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.842726 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:26.846843 (+  4117us) log.cc:844] Serialized 26 byte log entry
0709 12:26:27.023288 (+176445us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:27.023333 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:27.023423 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:27.536261 (+512838us) raft_consensus.cc:1685] finished
0709 12:26:27.536280 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:27.536384 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5788,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8015,"thread_start_us":159695,"threads_started":1,"wal-append.queue_time_us":258956}
I20260709 12:26:27.508190  9682 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:27.541878  9682 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.532615  9552 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:27.526789  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:27.545660  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 50855.7us
I20260709 12:26:27.548322  9573 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:27.331354  8540 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:27.566522  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.521929  9494 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:27.574257  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.503973  9550 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:27.549742  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:27.585970  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 442532us
I20260709 12:26:27.486146  9588 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:27.603583  9014 leader_election.cc:336] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.645s (SENT)
I20260709 12:26:27.604100  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:27.605654  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 118845us
I20260709 12:26:27.606714  8436 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:26:27.608685  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 227666us
I20260709 12:26:27.611867  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:27.611096  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61893.4us
W20260709 12:26:27.624739  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 123039us
W20260709 12:26:27.625629  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.632154  8545 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:27.632498  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.633116  8546 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:27.585069  8541 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:27.626574  9504 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:27.644887  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.636682  9682 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:27.658644  8511 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:27.659861  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.642889  9698 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:27.668797  8546 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:27.656796  9540 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:27.672294  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:27.673812  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:27.654974  9704 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:27.662058  9686 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:27.680625  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 77084.7us
I20260709 12:26:27.682801  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:27.683460  9048 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
W20260709 12:26:27.692510  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 80736.1us
I20260709 12:26:27.671901  9540 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:27.702328  9540 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.703707  9712 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:27.692103  9702 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:26:27.657444  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:27.695443  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:27.697201  9674 log.cc:927] Time spent T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Append to log took a long time: real 0.318s	user 0.003s	sys 0.000s
W20260709 12:26:27.705129  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 62044.3us
I20260709 12:26:27.707645  8361 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:27.681485  8463 pending_rounds.cc:85] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 1
I20260709 12:26:27.681942  9686 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:27.705539  9594 consensus_meta.cc:287] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
W20260709 12:26:27.725332  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 83452.5us
I20260709 12:26:27.684221  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:27.661432  9550 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.680998  9698 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.681316  9574 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:27.744544  9644 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:27.746410  9686 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:27.720978  9639 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.685117  9704 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.725570  9015 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:27.751842  8463 pending_rounds.cc:107] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:27.777164  9705 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:27.777722  9705 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.745744  9588 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:27.758141  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 110717us
I20260709 12:26:27.820228  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:27.818776  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.768016  9550 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.764331  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.753772  9488 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:26:27.756108  9712 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.067s
I20260709 12:26:27.844571  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.850399  8537 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:27.823288  8463 raft_consensus.cc:2889] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:27.852344  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 177664us
I20260709 12:26:27.840978  9594 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:27.857095  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:26:27.824469  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 117804us
I20260709 12:26:27.858968  8512 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:27.839433  9682 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.845144  9504 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:27.849620  8541 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:27.874528  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:27.870407  9711 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.863889  9494 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:27.870769  9704 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.881304  9690 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:27.881713  9690 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.863634  9713 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:27.882037  9690 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.882275  9713 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.868219  9595 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:27.883652  9595 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:27.884438  9713 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:27.884848  9595 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:27.885699  9639 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.886284  9639 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:27.868197  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.871470  9574 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.780377  9721 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.088s
I20260709 12:26:27.875268  9479 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:27.901386  8438 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:27.891546  8510 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:27.887660  9540 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.877204  9682 raft_consensus.cc:697] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:27.907817  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:26:27.924526  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.925529  8295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35638 (request call id 187) took 4103 ms. Trace:
I20260709 12:26:27.925276  9682 consensus_queue.cc:237] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:27.926399  9488 raft_consensus.cc:2764] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:27.910292  9595 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.925865  8295 rpcz_store.cc:276] 0709 12:26:23.822142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.833026 (+ 10884us) service_pool.cc:224] Handling call
0709 12:26:27.925457 (+4092431us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:26.792718 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:26.793243 (+   525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:26.793272 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:26:26.793290 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:26.794132 (+   842us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:26.794175 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:26.794205 (+    30us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:26:26.794770 (+   565us) tablet.cc:701] Row locks acquired
0709 12:26:26.794788 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:26.794931 (+   143us) write_op.cc:270] Start()
0709 12:26:26.795041 (+   110us) write_op.cc:276] Timestamp: P: 1783599986794886 usec, L: 0
0709 12:26:26.795063 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:26.843619 (+ 48556us) log.cc:844] Serialized 2935 byte log entry
0709 12:26:27.191889 (+348270us) op_driver.cc:464] REPLICATION: finished
0709 12:26:27.192551 (+   662us) write_op.cc:301] APPLY: starting
0709 12:26:27.192623 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:27.192834 (+   211us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:27.369905 (+177071us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:27.377944 (+  8039us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:27.378144 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:26:27.378189 (+    45us) write_op.cc:312] APPLY: finished
0709 12:26:27.378471 (+   282us) log.cc:844] Serialized 58 byte log entry
0709 12:26:27.378657 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:27.378770 (+   113us) write_op.cc:454] Released schema lock
0709 12:26:27.378813 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:27.379270 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:27.379297 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194485,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":442,"apply.run_cpu_time_us":2929,"apply.run_wall_time_us":186664,"num_ops":7,"prepare.queue_time_us":17608,"prepare.run_cpu_time_us":3754,"prepare.run_wall_time_us":53650,"replication_time_us":396694}]]}
I20260709 12:26:27.913173  9722 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:27.914155  9540 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.915475  9552 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.920634  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:27.921409  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:27.929327  9698 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.912783  9715 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.944957  8542 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:27.953800  9715 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.955972  9715 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.935284  9713 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:27.956645  9713 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:27.953727  8511 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:27.936757  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.898048  9705 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:27.916469  9711 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.908941  9494 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:27.947798  9504 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:27.948745  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:27.934952  9574 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:27.932092  9639 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:27.949347  9690 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:27.952704  9718 log.cc:927] Time spent T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:26:27.944952  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 237353us
W20260709 12:26:27.961849  9014 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.838s (SENT)
I20260709 12:26:27.952764  9552 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:27.962350  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.957036  9713 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:27.996773  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.011507  8542 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:27.963532  9730 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.013805  9711 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:28.014436  9574 raft_consensus.cc:697] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:28.015695  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.017385  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.018551  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.003320  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.003620  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:28.003911  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.004602  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.005431  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:28.006877  9685 consensus_meta.cc:287] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.004s
I20260709 12:26:28.006996  8361 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:28.002691  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 101206us
I20260709 12:26:28.003214  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.010016  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:28.009807  8436 leader_election.cc:336] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.791s (SENT)
I20260709 12:26:28.015400  9574 consensus_queue.cc:237] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.002648  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.028597  8545 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:27.997064  9594 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:28.028796  9689 consensus_meta.cc:287] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.003s
I20260709 12:26:28.022202  9580 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:26:28.054327  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 44542.8us
W20260709 12:26:28.055565  8436 leader_election.cc:336] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.816s (SENT)
I20260709 12:26:28.055971  8436 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:28.030870  9639 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:28.032632  9685 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.033465  9588 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:28.068444  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 110053us
W20260709 12:26:28.069237  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62349.9us
I20260709 12:26:28.043946  8539 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:28.051483  9711 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.027761  9730 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.080286  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.081527  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.057765  9670 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.054368  9712 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:26:28.083871  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.084131  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.084677  8397 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.084792  9494 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:28.085770  8388 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:28.083899  8464 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:28.088743  8391 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:28.090111  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.090838  8396 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:28.091106  9730 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:28.082720  9594 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:28.091760  8469 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:28.092134  8469 pending_rounds.cc:85] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 1
I20260709 12:26:28.092353  8469 pending_rounds.cc:107] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:28.092571  8469 raft_consensus.cc:2889] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:28.097990  9639 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.080174  9580 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.103019  9580 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:28.103514  9686 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.104583  8472 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:28.105321  8394 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:28.052081  9689 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:28.079461  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 48338.8us
W20260709 12:26:28.123538  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 68113.9us
I20260709 12:26:28.106751  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:28.124871  8436 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:28.125365  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:28.125626  9479 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:28.125975  9048 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:28.126133  9479 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.126565  9479 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.127435  8510 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:28.128278  8511 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:28.107290  9686 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:28.078621  9595 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:28.139714  8394 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:28.120594  9726 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.233s	user 0.000s	sys 0.004s
I20260709 12:26:28.114019  9706 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.121536  9594 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.122159  9712 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:26:28.122565  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.104568  9690 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:28.139195  8397 raft_consensus.cc:2410] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:26:28.080773  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 129034us
I20260709 12:26:28.078969  9502 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:28.146231  8542 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:28.152943  9689 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:28.154024  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 71352us
I20260709 12:26:28.143010  9685 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:26:28.155468  9588 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.156165  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:28.168624  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.162773  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.177331  9689 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:28.177855  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.177898  8361 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:28.138099  9711 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:28.184820  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.186589  8394 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:28.157449  9594 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:28.169042  9695 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.159047  9712 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:28.193805  8392 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:28.205587  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.144785  9715 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:26:28.192631  8390 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:28.213845  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.215224  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:28.216274  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.216894  8392 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:28.195921  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.195725  9580 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.204883  9695 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.232437  9689 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.188035  9502 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.233645  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:28.239086  8397 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:28.206444  9644 consensus_queue.cc:1059] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 12:26:28.248581  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 120368us
I20260709 12:26:28.249392  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:28.241168  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.242029  9711 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:28.257499  8390 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:28.221275  9686 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:26:28.223038  9552 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.247291  9502 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:28.236373  9695 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.251765  8397 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
W20260709 12:26:28.290899  9014 leader_election.cc:336] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.980s (SENT)
I20260709 12:26:28.293376  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:28.293735  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.294308  8394 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.294385  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:28.221100  9504 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
W20260709 12:26:28.300801  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.299602  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.301524  8395 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:28.303732  8397 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:26:28.306107  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 72526.3us
I20260709 12:26:28.267253  9552 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.306793  8436 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:28.306973  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.307327  8397 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:28.289783  9745 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.309305  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:28.240401  9689 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.292568  9712 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.300072  9594 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.325058  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.326110  8395 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:28.326721  8394 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:28.306236  9682 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.318490  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.318429  9747 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:28.329167  9712 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.328994  9479 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.331991  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:28.333071  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:26:28.344120  9751 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 12:26:28.345062  9736 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 12:26:28.348083  9741 log.cc:927] Time spent T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:28.348680  9715 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.349102  9715 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.349427  9479 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:28.311640  9552 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:28.319958  9737 log.cc:927] Time spent T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:26:28.352998  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62143.4us
I20260709 12:26:28.316011  9685 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.323580  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.372084  8392 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:28.366309  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:28.344192  9743 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:28.349442  9715 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.318605  9732 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.366230  9747 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.389189  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:28.378188  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 68953.1us
W20260709 12:26:28.391762  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 58750us
I20260709 12:26:28.392714  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:28.369897  9685 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.415212  8436 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:28.411391  8511 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:28.411912  9048 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:28.412143  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:28.413823  9689 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:28.413618  9713 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.373615  9504 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:28.427735  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:28.386601  9479 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.440311  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:28.427295  9713 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:28.418053  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:28.378448  9732 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:28.427843  9504 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.459237  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.444551  9695 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.445998  9479 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.447577  8395 raft_consensus.cc:1240] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:28.448130  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:28.448937  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:28.450029  8463 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:28.451321  9746 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.417837  9685 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.440845  9747 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:28.457392  8436 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:28.439740  9639 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.439291  9488 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:28.459177  9732 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.462280  9504 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.471112  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:28.420146  9686 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 12:26:28.477921  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 59931.9us
I20260709 12:26:28.471560  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.460405  9730 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.461719  8397 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:28.429754  9046 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:28.441366  9016 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:28.468611  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.476666  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.465075  9712 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:28.470147  9044 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.420014  9550 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:26:28.483477  8545 raft_consensus.cc:1240] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:26:28.487941  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.472859  9639 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.489662  8436 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:26:28.480131  8361 connection.cc:256] RPC call timeout handler was delayed by -2.2776313779995689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 12:26:28.493430  8361 connection.cc:256] RPC call timeout handler was delayed by -1.9158313779998934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 12:26:28.493742  8361 connection.cc:256] RPC call timeout handler was delayed by -1.8609313779998047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 12:26:28.494014  8361 connection.cc:256] RPC call timeout handler was delayed by -1.814131377999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
I20260709 12:26:28.474611  9724 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.492100  8393 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:28.494313  8361 connection.cc:256] RPC call timeout handler was delayed by -1.7925313779996941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
W20260709 12:26:28.495623  8361 connection.cc:256] RPC call timeout handler was delayed by -1.1454313779995573s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2949s for a response
I20260709 12:26:28.480496  9745 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:28.494917  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.483065  9730 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.497414  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.495275  9724 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.509375  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.513419  8545 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:28.492887  9686 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.522560  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.525799  8542 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:28.495194  9734 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:28.495306  9639 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.522629  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.490623  9580 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:26:28.483881  9590 consensus_queue.cc:1059] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:26:28.494339  9712 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.611470  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.529939  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.638506  8542 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:28.642751  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.617892  9044 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:28.620321  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.621287  9479 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:28.566816  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 77206.7us
I20260709 12:26:28.512737  9730 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.647562  8470 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:28.569749  9690 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.618249  9594 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.537529  9747 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.650846  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.651705  8468 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:28.652194  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.621693  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.652972  8537 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:28.653784  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.558141  8392 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:28.495796  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 78364.5us
I20260709 12:26:28.559269  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.512641  9724 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.515323  9488 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:28.668161  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.676221  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.697315  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.677035  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.698225  8542 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:28.615121  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:28.681264  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.619590  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.703099  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.703752  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.616001  9740 raft_consensus.cc:3055] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:28.615736  9595 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:28.525352  9686 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.582782  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.676577  9706 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.699216  9048 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.619544  9552 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.652611  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:28.700495  8465 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:26:28.619882  9734 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:26:28.720733  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:28.595824  9695 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:28.514386  9701 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.170s
W20260709 12:26:28.709647  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 210284us
I20260709 12:26:28.709393  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.710170  8510 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:28.696301  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.719872  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.720083  9580 raft_consensus.cc:3055] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.720589  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.682890  9690 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:28.569753  8294 catalog_manager.cc:5697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.709312  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:28.727274  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 226705us
I20260709 12:26:28.701959  9488 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:28.705722  9595 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:28.705910  9740 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:28.763737  8466 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:28.760181  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.709637  9686 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.780937  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:28.782066  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.783883  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.713217  8538 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:28.706321  9644 consensus_queue.cc:1059] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:26:28.787111  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.791244  8397 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:28.725659  9706 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.798202  9706 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:28.801838  9724 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.803573  8543 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:28.733134  9625 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:28.804464  8294 catalog_manager.cc:5697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.810159  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:28.805105  9759 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:26:28.813308  9711 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.813704  9711 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:28.814061  9711 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:28.814357  9695 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:28.733345  9580 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:28.815250  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:28.743824  9488 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.785666  9479 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:28.834041  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 129849us
I20260709 12:26:28.834398  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:28.838075  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 96188.5us
I20260709 12:26:28.839347  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.839926  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:28.835563  9014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.892s (SENT) [suppressed 49 similar messages]
I20260709 12:26:28.834046  9658 raft_consensus.cc:3055] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.842192  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:28.844272  9658 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:26:28.844898  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 124217us
I20260709 12:26:28.845129  9658 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.846061  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:28.846364  9658 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.829422  9479 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.826725  9625 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:28.828922  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:28.842300  8543 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:28.849954  8294 catalog_manager.cc:5697] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.834576  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:28.848912  8512 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:28.857892  8392 raft_consensus.cc:3055] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:28.861749  8467 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:28.860972  8392 raft_consensus.cc:740] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:28.843885  9494 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:28.851471  9550 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:28.867277  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:28.870467  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 89581.1us
I20260709 12:26:28.860033  9740 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.870739  9771 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:28.872323  9740 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.872892  9771 consensus_queue.cc:1059] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:28.854197  9759 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:28.883015  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 47466.6us
I20260709 12:26:28.888887  9759 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.877231  8512 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:28.853797  9479 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.891033  9759 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:28.877867  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.893371  8543 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:28.893975  9730 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:28.894780  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:28.896209  9745 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.896831  9745 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.897181  9745 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:28.896296  8512 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:28.904479  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 53207.3us
I20260709 12:26:28.851300  9713 consensus_queue.cc:1059] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:26:28.897714  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:28.938556  8438 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:28.898165  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:28.866879  9494 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:28.895998  9730 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:28.900417  8294 catalog_manager.cc:5697] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:28.940744  8392 consensus_queue.cc:260] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:28.886337  9489 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:28.885342  9758 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:28.887277  9712 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:28.885603  9706 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.006083  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:28.939149  8539 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:28.886680  9550 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:28.847702  9595 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:28.996673  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.897755  9586 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.187s
I20260709 12:26:28.946760  9044 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEARNER]: Advancing to term 3
I20260709 12:26:28.998550  8392 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.994298  9494 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:28.869575  8391 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:28.944123  9695 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:28.997202  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:28.936638  9759 consensus_queue.cc:1059] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:26:28.987717  9724 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.011713  8512 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:29.009222  9761 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:28.999945  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61481.5us
W20260709 12:26:29.009204  9757 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:26:28.995451  9758 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.995456  9489 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:28.999959  9552 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.008394  9730 raft_consensus.cc:3055] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:26:29.026393  9504 consensus_meta.cc:287] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.004s
I20260709 12:26:29.052441  8466 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:29.040367  9715 consensus_meta.cc:287] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.624s	user 0.000s	sys 0.009s
I20260709 12:26:29.029065  9740 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.064306  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:29.021168  9574 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:26:29.080581  8468 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:29.040153  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.079706  8469 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.040934  9695 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:29.081849  8438 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:29.020186  9706 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.086112  8466 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:29.085397  9765 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:26:29.062618  9489 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.009794  9625 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.057619  9758 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:29.096195  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.092906  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.098675  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.111714  9769 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.107060  9488 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.067497  9730 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:29.120296  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:29.120282  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 108621us
I20260709 12:26:29.080834  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:26:29.089638  9732 consensus_meta.cc:287] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.001s
I20260709 12:26:29.087126  9695 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.087695  9552 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.127207  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:29.081441  9712 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:26:29.080967  9715 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.080338  9504 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:29.193248  9760 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 12:26:29.120755  9586 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:26:29.051811  9761 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:29.195222  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 146157us
W20260709 12:26:29.196915  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 75901.2us
I20260709 12:26:29.086071  9724 consensus_queue.cc:1059] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:26:29.131464  9780 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:29.211886  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:29.191774  9048 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:29.127511  9732 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.195222  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.125551  9550 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:29.224720  8392 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:29.225550  8361 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.154s (SENT)
I20260709 12:26:29.233584  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:29.237407  8546 consensus_meta.cc:287] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.540s	user 0.000s	sys 0.008s
I20260709 12:26:29.238226  8546 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:29.243716  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.245275  8546 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:29.249591  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.250588  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.255366  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.255952  8546 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:29.256727  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.227710  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:29.248312  9552 raft_consensus.cc:3055] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:29.265583  9552 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:29.266521  9552 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.267782  9552 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:29.246614  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:29.279860  9789 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.286726  9785 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:29.287453  9770 log.cc:927] Time spent T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:26:29.222656  9730 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.258363  9501 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.272079  8541 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:26:29.306826  9772 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
W20260709 12:26:29.312263  9786 log.cc:927] Time spent T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:29.285897  9712 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:29.307929  8391 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:26:29.319314  9686 consensus_meta.cc:287] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 12:26:29.290267  9734 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:26:29.301927  9724 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:26:29.334553  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:29.331287  9488 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.352368  9044 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:29.323993  9706 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.341409  9686 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.353245  8539 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.331568  9712 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:29.447600  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:29.434721  9746 consensus_meta.cc:287] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.959s	user 0.000s	sys 0.010s
W20260709 12:26:29.455861  9594 consensus_meta.cc:287] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.000s
I20260709 12:26:29.443746  9504 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.446144  9715 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:29.469064  9479 consensus_meta.cc:287] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.579s	user 0.008s	sys 0.000s
I20260709 12:26:29.469653  9713 raft_consensus.cc:3055] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:29.469486  9479 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.470049  9713 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:29.473182  9712 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.461826  9746 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.487910  9686 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.478773  8464 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:29.467542  9732 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:29.489849  8539 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:29.505523  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.506690  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:29.470940  9713 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.509689  9479 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:29.519079  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:29.522452  9791 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:26:29.522642  9639 consensus_meta.cc:287] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.830s	user 0.005s	sys 0.004s
I20260709 12:26:29.513856  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:29.544566  9745 consensus_meta.cc:287] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.647s	user 0.006s	sys 0.003s
I20260709 12:26:29.530416  9713 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:29.558419  8545 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:29.557166  8539 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:29.559963  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.560128  9690 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.561117  9690 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.561520  9689 raft_consensus.cc:3055] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:29.561916  9689 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:29.562718  9689 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:29.539906  9658 consensus_meta.cc:287] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.693s	user 0.011s	sys 0.001s
W20260709 12:26:29.563558  9685 consensus_meta.cc:287] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.089s	user 0.004s	sys 0.006s
I20260709 12:26:29.532387  9761 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.572990  8543 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
W20260709 12:26:29.596877  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 371343us
I20260709 12:26:29.532598  9639 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.598415  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:29.563325  9695 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.556931  9745 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:29.599756  8435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.029s	sys 0.029s
I20260709 12:26:29.572360  9685 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:29.603787  8294 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.046s	sys 0.091s
I20260709 12:26:29.605707  8546 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 2: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:26:29.606657  8294 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.046s	sys 0.091s
I20260709 12:26:29.603106  9790 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:29.601806  9689 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:29.597177  8540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.010s	sys 0.036s
W20260709 12:26:29.605064  9711 consensus_meta.cc:287] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.791s	user 0.002s	sys 0.009s
W20260709 12:26:29.614289  8540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.010s	sys 0.037s
I20260709 12:26:29.565755  9580 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.599910  9552 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
W20260709 12:26:29.606361  8435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.029s	sys 0.029s
W20260709 12:26:29.629958  8436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.000s	sys 0.013s
W20260709 12:26:29.630357  8436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.000s	sys 0.014s
I20260709 12:26:29.633291  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:29.634629  9479 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:29.635053  9479 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.635479  9479 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:29.638702  9767 log.cc:927] Time spent T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.768s	user 0.005s	sys 0.002s
I20260709 12:26:29.641698  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 53) took 1014 ms. Trace:
I20260709 12:26:29.642140  8541 rpcz_store.cc:276] 0709 12:26:28.627233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.628429 (+  1196us) service_pool.cc:224] Handling call
0709 12:26:29.241532 (+613103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.316155 (+ 74623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.641487 (+325332us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b54004489d0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:29.641638 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1237052288}
I20260709 12:26:29.643339  9479 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.644995  8510 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:29.649763  8546 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.669672  9552 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.624688  9711 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:29.660722  8437 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.009s
I20260709 12:26:29.654524  9707 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.668763  8436 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:29.659648  9780 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:29.660477  9695 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.664466  9595 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.674096  8538 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:29.705037  8544 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:29.675504  9730 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:29.706619  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1149) took 1034 ms. Trace:
W20260709 12:26:29.677785  9778 log.cc:927] Time spent T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.661s	user 0.000s	sys 0.012s
W20260709 12:26:29.679047  9489 consensus_meta.cc:287] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.000s
I20260709 12:26:29.680584  9745 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.683599  9639 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.668457  9686 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.690673  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.690984  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.631903  9580 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:29.694205  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 49296.6us
I20260709 12:26:29.720007  8543 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:29.695967  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:29.696523  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1148) took 1024 ms. Trace:
I20260709 12:26:29.721145  8545 rpcz_store.cc:276] 0709 12:26:28.672234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.675962 (+  3728us) service_pool.cc:224] Handling call
0709 12:26:29.696361 (+1020399us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b5400387f54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:29.696463 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1855272192}
I20260709 12:26:29.696913  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:29.699220  8437 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.005s	sys 0.009s
W20260709 12:26:29.723265  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.701437  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.706950  8544 rpcz_store.cc:276] 0709 12:26:28.672500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.672614 (+   114us) service_pool.cc:224] Handling call
0709 12:26:28.672955 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.705406 (+1032451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.706422 (+  1016us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001b3354. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:29.706567 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369663744}
I20260709 12:26:29.693482  9712 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.708209  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:29.699551  9594 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:29.728655  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.728771  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.729226  8541 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.731899  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.732666  9762 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:29.736483  9711 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:29.737102  9780 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.704169  9746 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:29.698365  9552 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.756708  8471 raft_consensus.cc:1240] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.702167  9740 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:26:29.748474  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 79777.5us
W20260709 12:26:29.748881  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 526636us
I20260709 12:26:29.749352  8397 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:29.719866  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.757067  8470 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.759769  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.760442  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.764386  8436 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:29.740629  8396 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:29.750960  9758 consensus_meta.cc:287] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.001s
I20260709 12:26:29.740644  9698 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:29.766959  8466 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:26:29.767660  8361 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.206s (SENT)
I20260709 12:26:29.770478  8470 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:29.770545  8467 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:29.747991  9690 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.782316  9759 consensus_queue.cc:1059] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:29.725168  9686 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.783720  9759 raft_consensus.cc:3055] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:29.784078  9759 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:29.784709  9686 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.784875  9759 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.785967  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.786150  9759 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:29.704272  9707 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.715386  9489 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.779207  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1156) took 1095 ms. Trace:
I20260709 12:26:29.772482  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:29.774500  9594 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:29.781042  9501 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.749138  9712 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.789214  8468 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:29.750756  9790 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:29.750552  9685 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.789764  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.790474  8472 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:29.791306  8396 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:29.750617  9762 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:29.752583  9588 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:29.766058  9773 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.785s	user 0.000s	sys 0.013s
I20260709 12:26:29.792790  8511 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:29.792994  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.748960  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:29.792730  8469 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.794116  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:29.787555  8537 rpcz_store.cc:276] 0709 12:26:28.683601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.794213 (+110612us) service_pool.cc:224] Handling call
0709 12:26:28.805050 (+ 10837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.821504 (+ 16454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.821539 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:28.836855 (+ 15316us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.009565 (+172710us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:29.009605 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.009670 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.677280 (+667610us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:29.773186 (+ 95906us) raft_consensus.cc:1685] finished
0709 12:26:29.773205 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.779150 (+  5945us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3891,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"spinlock_wait_cycles":2505472,"thread_start_us":141323,"threads_started":1,"wal-append.queue_time_us":163431}
I20260709 12:26:29.796700  8471 raft_consensus.cc:1240] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:29.809779  8468 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:29.807657  8472 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:29.797410  8512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.010s	sys 0.023s
I20260709 12:26:29.797477  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.803603  8397 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:29.825484  8537 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:29.820083  8512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.010s	sys 0.023s
W20260709 12:26:29.870100  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 79991.6us
I20260709 12:26:29.874217  8469 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:29.796274  9695 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.870313  8540 raft_consensus.cc:2376] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2. Re-sending same reply.
I20260709 12:26:29.881049  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1151) took 1199 ms. Trace:
I20260709 12:26:29.824554  9574 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:29.777608  9758 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.888677  8436 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:29.890192  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 745) took 1032 ms. Trace:
I20260709 12:26:29.762184  9746 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.891306  8537 rpcz_store.cc:276] 0709 12:26:28.857283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.812797 (+955514us) service_pool.cc:224] Handling call
0709 12:26:29.813053 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.825834 (+ 12781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.889980 (+ 64146us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54004493d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:29.890139 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27886464}
I20260709 12:26:29.891570  8436 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:29.883458  8542 rpcz_store.cc:276] 0709 12:26:28.681934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.709610 (+ 27676us) service_pool.cc:224] Handling call
0709 12:26:28.709944 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:28.723895 (+ 13951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:28.723927 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:28.786725 (+ 62798us) log.cc:844] Serialized 26 byte log entry
0709 12:26:28.871528 (+ 84803us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:28.935658 (+ 64130us) log.cc:844] Serialized 14 byte log entry
0709 12:26:28.939437 (+  3779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.939564 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:29.650786 (+711222us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:29.811162 (+160376us) raft_consensus.cc:1685] finished
0709 12:26:29.880868 (+ 69706us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:29.880998 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38847,"prepare.queue_time_us":149225,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":39,"raft.queue_time_us":4823,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":48419,"spinlock_wait_cycles":13070208,"thread_start_us":98528,"threads_started":2,"wal-append.queue_time_us":45270}
I20260709 12:26:29.891876  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.793598  9698 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.923372  8544 raft_consensus.cc:1240] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 12:26:29.907050  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.881464  9580 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:29.929361  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 136637us
I20260709 12:26:29.933494  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:29.809633  9588 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.938421  8511 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:29.923110  8539 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:26:29.876130  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 51757.4us
W20260709 12:26:29.940657  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 173049us
I20260709 12:26:29.805001  9501 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:29.931993  9494 consensus_meta.cc:287] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.890s	user 0.011s	sys 0.001s
W20260709 12:26:29.928300  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 57154us
I20260709 12:26:29.881935  9801 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.936409  9625 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:29.809254  9762 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.952849  9800 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:29.953373  9489 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.953996  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:29.956265  9479 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.808020  9796 consensus_queue.cc:1059] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 12:26:29.930545  8541 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:29.936515  9713 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:29.880223  9734 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:26:29.961153  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:29.982667  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:29.983085  8542 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:29.961544  8511 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:29.962819  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 71311.6us
I20260709 12:26:29.937157  9740 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:29.963518  9695 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.932253  9784 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.957646  9758 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.942581  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:29.937031  9594 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.960510  9795 consensus_queue.cc:1059] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:26:29.999078  9734 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:29.999444  9795 raft_consensus.cc:3055] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:29.961557  9494 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:29.999873  9795 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:29.965070  8470 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:29.965271  8361 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.230s (SENT)
I20260709 12:26:29.957540  9712 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.971608  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.964622  9747 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:29.960661  9780 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.958839  9707 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:29.985031  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.020567  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.021256  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:29.985258  8511 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:30.023518  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:30.023597  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.960405  9711 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:26:29.966504  9777 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:29.988181  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:29.967690  9762 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:29.996878  8438 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:30.007644  8361 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:29.990818  9695 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.011247  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 744) took 1154 ms. Trace:
I20260709 12:26:30.012253  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:30.012558  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 739) took 1156 ms. Trace:
I20260709 12:26:30.014292  9502 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:29.966691  9540 consensus_queue.cc:1059] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:26:30.018134  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1166) took 1160 ms. Trace:
I20260709 12:26:30.018579  9588 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:29.963501  9625 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.052052  9711 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:30.024838  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.010340  9733 consensus_queue.cc:1059] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:26:30.027603  8511 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:30.084753  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 57213.9us
I20260709 12:26:30.021170  8393 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:30.030364  8438 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:26:30.085742  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 55453.8us
I20260709 12:26:30.056612  9782 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.052156  9707 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:30.029768  9758 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.000349  9489 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.980393  9586 consensus_queue.cc:1059] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:26:30.060262  8545 rpcz_store.cc:276] 0709 12:26:28.855802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.722086 (+866284us) service_pool.cc:224] Handling call
0709 12:26:29.722382 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.739743 (+ 17361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.739770 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.761567 (+ 21797us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.887190 (+125623us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:29.887229 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.887289 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:30.012353 (+125064us) raft_consensus.cc:1685] finished
0709 12:26:30.012376 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.012498 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45766,"raft.queue_time_us":17446,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5873,"thread_start_us":121415,"threads_started":1,"wal-append.queue_time_us":198330}
I20260709 12:26:29.962767  9801 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:29.980693  9761 consensus_queue.cc:1059] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:26:30.097013  9793 raft_consensus.cc:3055] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.097195  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.069957  8396 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:30.029489  9790 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:29.982134  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 740) took 1126 ms. Trace:
I20260709 12:26:30.104202  8544 rpcz_store.cc:276] 0709 12:26:28.856068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.724624 (+868556us) service_pool.cc:224] Handling call
0709 12:26:29.749736 (+ 25112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.934482 (+184746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.981887 (+ 47405us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540006b8d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:29.982076 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397154048}
I20260709 12:26:30.052305  9686 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.057072  9800 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:30.075103  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.109653  8397 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:30.059295  9724 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:30.057688  9712 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.113802  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:29.990387  9740 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:30.074414  9808 log.cc:927] Time spent T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:26:30.063390  9502 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.091940  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:30.092458  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 67687.2us
I20260709 12:26:30.094061  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.062958  9580 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:29.999603  9734 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.105378  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:30.076551  9711 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.127892  9711 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.110328  9686 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:30.122167  9658 raft_consensus.cc:3055] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:30.121860  9689 consensus_queue.cc:1059] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:26:30.129374  9658 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.130070  9689 raft_consensus.cc:3055] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:30.130446  9689 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:30.130187  9658 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.058233  9780 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.087747  9747 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:30.003625  9784 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:30.108994  8542 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:30.086618  9501 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:30.112757  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.092058  9595 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.090775  9777 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:30.115278  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:30.118256  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 159938us
I20260709 12:26:30.095755  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:30.104234  9758 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.119236  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.136831  8396 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:30.141785  8397 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:30.059583  8541 rpcz_store.cc:276] 0709 12:26:28.857029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.785807 (+928778us) service_pool.cc:224] Handling call
0709 12:26:29.786095 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.982801 (+196706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.010968 (+ 28167us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b5400448ed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:30.011175 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195337600}
I20260709 12:26:30.119697  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:30.140352  9804 consensus_queue.cc:1059] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:30.143064  9550 consensus_queue.cc:1059] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.144299  9780 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.098275  9746 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:30.123554  8545 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:30.069610  8539 rpcz_store.cc:276] 0709 12:26:28.860145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.559678 (+699533us) service_pool.cc:224] Handling call
0709 12:26:30.017944 (+458266us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001b2e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:30.018078 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579672832}
I20260709 12:26:30.126314  9824 consensus_queue.cc:1059] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:30.127022  9740 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.128782  9494 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.134225  9711 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:30.150501  9812 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:30.111370  9800 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.137401  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.110630  9793 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.120865  9724 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:30.072712  9795 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.134981  9790 consensus_queue.cc:1059] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:30.111727  9690 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:26:30.175448  9501 raft_consensus.cc:3055] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.103757  9707 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.145351  8544 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.177557  9707 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:30.144547  9625 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.131330  9658 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:30.182222  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.133885  9686 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.184439  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:30.124528  9698 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:30.152464  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:30.192314  8542 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.114108  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:30.154541  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 742) took 1298 ms. Trace:
I20260709 12:26:30.154651  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:30.196261  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:30.196799  8545 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.108209  8511 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:30.157464  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.127048  9734 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.158699  8537 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.133375  8393 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:30.165081  8397 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:30.131201  9689 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.169260  8388 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:30.170010  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:30.166752  8464 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:30.160137  9502 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.170898  9758 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.157903  9780 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:30.158404  9747 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:30.159811  9732 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:26:30.154917  9777 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:30.151846  9479 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:26:30.173854  8394 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:30.174527  9795 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.175827  9501 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:30.190856  8544 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:30.164780  9769 raft_consensus.cc:3055] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:26:30.235579  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 91672.8us
W20260709 12:26:30.293457  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.194283  8543 rpcz_store.cc:276] 0709 12:26:28.856549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.738828 (+882279us) service_pool.cc:224] Handling call
0709 12:26:29.739112 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.771361 (+ 32249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.771388 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.771772 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.882672 (+110900us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:29.882709 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.882775 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:30.154340 (+271565us) raft_consensus.cc:1685] finished
0709 12:26:30.154359 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.154487 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155981,"raft.queue_time_us":33557,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":19185,"thread_start_us":109942,"threads_started":1,"wal-append.queue_time_us":380950}
I20260709 12:26:30.467942  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:26:30.461966  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 353826us
I20260709 12:26:30.212293  8438 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:30.468133  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.312389  8390 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:30.491587  8511 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:30.492738  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.269861  9625 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:30.493718  8395 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:26:30.270925  9760 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:26:30.491520  8394 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.173908  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:30.378391  9759 consensus_meta.cc:287] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.592s	user 0.005s	sys 0.001s
I20260709 12:26:30.481272  8545 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:30.546964  8542 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:30.535710  9625 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.557103  9479 raft_consensus.cc:3055] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.557015  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 737) took 1701 ms. Trace:
I20260709 12:26:30.557518  9479 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:30.494099  8541 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.558679  9625 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.535490  9502 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.408281  9734 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:30.559383  9501 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.560446  9501 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.374676  9724 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.217263  9804 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.337849  9784 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:30.411839  9695 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.458096  9799 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:30.552368  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:30.557756  8538 rpcz_store.cc:276] 0709 12:26:28.855266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.705440 (+850174us) service_pool.cc:224] Handling call
0709 12:26:29.705784 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.739450 (+ 33666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.748926 (+  9476us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.805003 (+ 56077us) log.cc:844] Serialized 26 byte log entry
0709 12:26:30.075222 (+270219us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:30.479788 (+404566us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.556677 (+ 76889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.556769 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:30.556817 (+    48us) raft_consensus.cc:1685] finished
0709 12:26:30.556829 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.556964 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75223,"raft.queue_time_us":20119,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":17049,"thread_start_us":331465,"threads_started":2,"wal-append.queue_time_us":224519}
I20260709 12:26:30.490214  9780 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:26:30.563817  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 351586us
W20260709 12:26:30.565178  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.494611  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:30.563603  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 95749.3us
I20260709 12:26:30.592631  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:30.492734  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.557369  9689 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.566656  9488 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.567181  9771 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:30.563452  9044 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:30.567919  9734 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.604688  9734 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:30.568907  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:30.535177  9801 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:30.554428  8394 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.572841  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:30.212877  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 105631us
I20260709 12:26:30.378134  9686 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.481316  9639 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.495687  9793 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.575084  8541 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:30.591948  8389 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:30.536406  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:30.556569  9820 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:26:30.618884  8510 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:30.494045  9769 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:30.537283  8395 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:30.623807  8395 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.590523  8537 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:30.593806  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:26:30.538188  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 46697.4us
I20260709 12:26:30.626046  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:30.462642  9747 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.537834  9494 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:30.564173  9805 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:30.607667  8545 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:30.588183  9588 raft_consensus.cc:3055] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:30.585340  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:30.270697  9824 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.644130  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.618804  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.599310  9771 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.600333  9550 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:30.630045  8511 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:30.622373  9793 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.633294  8388 raft_consensus.cc:2410] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:30.558382  9479 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.618368  8389 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.628391  9746 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:30.658747  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.658595  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.575229  9777 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.659792  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:30.617635  9639 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.629769  9747 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:30.661090  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 55) took 1005 ms. Trace:
I20260709 12:26:30.635622  9588 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.691952  9769 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.629704  9804 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.611549  9799 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.654418  9595 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:30.697265  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.697755  9552 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:30.656546  9824 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:30.701670  9800 consensus_meta.cc:287] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.003s
W20260709 12:26:30.705003  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.705282  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:30.727160  9824 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.727466  8539 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.726989  9800 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.730731  9800 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:30.730966  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 54) took 1075 ms. Trace:
I20260709 12:26:30.731346  8546 rpcz_store.cc:276] 0709 12:26:29.655520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.695728 (+ 40208us) service_pool.cc:224] Handling call
0709 12:26:30.730794 (+1035066us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400099554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:30.730917 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2151660928}
I20260709 12:26:30.657536  9761 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 12:26:30.708194  8542 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:30.694650  9746 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:30.710654  8537 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:30.713552  8545 rpcz_store.cc:276] 0709 12:26:29.655813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.631691 (+975878us) service_pool.cc:224] Handling call
0709 12:26:30.660644 (+ 28953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.660806 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:30.660827 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:30.660864 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:30.660891 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.660952 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.661041 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185216}
I20260709 12:26:30.715616  9796 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:30.719065  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 59356.1us
I20260709 12:26:30.658227  9550 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.659004  9771 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.712570  9734 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.720546  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.722944  8538 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:30.661293  9783 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.632380  9784 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.083s
I20260709 12:26:30.635463  9494 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.693342  9790 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.722388  9594 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:30.726610  9552 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:30.726791  9595 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:30.728928  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.772307  9734 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.787312  9734 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:30.788990  9713 consensus_meta.cc:287] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.803s	user 0.006s	sys 0.003s
I20260709 12:26:30.789108  8391 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:30.791136  9494 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.793355  9790 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:30.794064  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.795567  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1169) took 1849 ms. Trace:
I20260709 12:26:30.796061  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:30.798718  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.656427  9730 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 12:26:30.627928  9780 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.674295  8540 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:30.727386  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.710644  9479 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.692174  8541 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:30.738487  9588 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.739929  9639 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:30.740988  9540 raft_consensus.cc:3055] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:30.745059  9825 raft_consensus.cc:3055] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:30.712368  8389 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.748405  8394 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.749585  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:30.750097  9762 consensus_meta.cc:287] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.000s
I20260709 12:26:30.754211  8466 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:30.756197  8469 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:30.757035  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.805707  9540 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:30.759006  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.759747  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.761775  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:30.770255  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:30.820209  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 60548.8us
I20260709 12:26:30.822072  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:30.772902  8470 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:30.735169  9805 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.760047  8539 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:30.752889  9746 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:30.759613  9769 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.752439  9701 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.760529  9550 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.784859  9707 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.770028  9759 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:30.804160  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 76851.8us
I20260709 12:26:30.810822  8397 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:30.812563  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.758013  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.781594  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.777444  9574 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:26:30.821602  9686 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:30.796005  8538 rpcz_store.cc:276] 0709 12:26:28.946414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.620450 (+1674036us) service_pool.cc:224] Handling call
0709 12:26:30.689506 (+ 69056us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.769787 (+ 80281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.782226 (+ 12439us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:30.793908  9790 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.805737  9580 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.824400  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:30.825057  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 129584us
I20260709 12:26:30.881942  8394 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:30.882289  8436 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:30.883374  8436 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:30.804139  9713 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.881068  9746 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.900520  9685 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:30.880529  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 764) took 1007 ms. Trace:
I20260709 12:26:30.902364  9746 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:30.902572  9827 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.768s	user 0.005s	sys 0.005s
I20260709 12:26:30.813207  8463 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:30.807108  9825 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:30.835935  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:30.836333  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:30.906317  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 85063.1us
I20260709 12:26:30.831811  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.810014  9747 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.841213  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:30.841308  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:30.911470  8537 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:30.912468  8542 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:30.880616  9824 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.818256  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.807531  9690 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:26:30.824034  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1172) took 1816 ms. Trace:
I20260709 12:26:30.827538  9780 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.827750  8389 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:30.853353  8544 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:30.858359  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:30.859086  9540 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.833230  9625 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.867583  8388 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:30.868984  9501 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.868999  8395 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:30.910566  9713 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:30.873253  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:30.838477  9595 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.874358  8393 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:30.853063  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:30.849449  9707 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:30.875952  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 763) took 1003 ms. Trace:
I20260709 12:26:30.879892  9771 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.904655  8546 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:30.903429  8543 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:30.869055  9799 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:30.908874  8436 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:30.907172  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 70915.3us
I20260709 12:26:30.848165  8467 raft_consensus.cc:2393] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:30.913790  8542 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:30.856388  9777 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.921641  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 754) took 1100 ms. Trace:
I20260709 12:26:30.910006  9639 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:30.922276  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.905014  9685 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:26:30.922664  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 64408.2us
I20260709 12:26:30.946628  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:30.947781  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:30.949178  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:30.904994  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 120797us
I20260709 12:26:30.924274  8395 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.060315  9761 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:30.839807  9805 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.853580  9759 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.934463  8511 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:31.075613  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 141228us
I20260709 12:26:30.934425  8544 rpcz_store.cc:276] 0709 12:26:29.821683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.852925 (+1031242us) service_pool.cc:224] Handling call
0709 12:26:30.853198 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.921402 (+ 68204us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.921588 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:30.936066  8436 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:30.902261  8538 rpcz_store.cc:276] 0709 12:26:29.872903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.879595 (+1006692us) service_pool.cc:224] Handling call
0709 12:26:30.879964 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.880152 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:30.880184 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:30.880231 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:30.880291 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.880349 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.880467 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:30.950537  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:31.079640  9685 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:31.080250  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 129788us
I20260709 12:26:31.079317  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:30.961350  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.080993  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:31.080492  9701 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:26:31.081663  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.081909  9701 raft_consensus.cc:697] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:31.082406  9795 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:30.981329  8472 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
W20260709 12:26:30.983736  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.005431  8542 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:30.926606  9711 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:31.070004  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:30.939939  9540 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:30.921631  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 99593.7us
W20260709 12:26:31.092782  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.093456  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.072959  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 237120us
I20260709 12:26:31.078591  8511 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:31.095145  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.925251  9625 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:31.082087  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.105741  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.931577  8539 rpcz_store.cc:276] 0709 12:26:29.872674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.854138 (+981464us) service_pool.cc:224] Handling call
0709 12:26:30.875361 (+ 21223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.875593 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:30.875623 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:30.875671 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:30.875720 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.875781 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.875892 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:31.056941  9580 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.110533  9580 consensus_queue.cc:1059] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.112061  8537 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:31.112632  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:31.087038  9711 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:30.920087  8541 rpcz_store.cc:276] 0709 12:26:29.004469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.632068 (+1627599us) service_pool.cc:224] Handling call
0709 12:26:30.691995 (+ 59927us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.805783 (+113788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.821200 (+ 15417us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:31.066815  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:31.064042  9639 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:30.985394  9777 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:30.941061  9799 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.068730  9825 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:31.082011  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:31.047025  9732 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.101068  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:31.145318  9048 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:31.145445  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:30.927397  9501 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.060501  9793 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:31.146106  8394 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:31.146338  9793 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:31.146812  9793 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.109414  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:31.083154  9783 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.156067  9044 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Advancing to term 4
I20260709 12:26:31.149605  9501 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.156646  9707 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:31.139547  9689 consensus_meta.cc:287] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260709 12:26:31.156366  9639 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.153425  8395 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:31.155314  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:31.158990  8464 raft_consensus.cc:2393] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:31.159824  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:31.124552  8544 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:31.124621  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:31.107100  9713 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.085954  9846 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:31.140542  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 204540us
I20260709 12:26:31.090845  9594 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:31.169040  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:31.170348  8436 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:31.142619  9799 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.153810  9825 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.114321  8511 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:31.082755  9701 consensus_queue.cc:237] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.115816  9711 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.120440  9801 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.118228  9488 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.161021  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:31.172127  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.172076  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 57882.3us
I20260709 12:26:31.174117  9501 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.156503  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:31.175063  9550 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:31.155203  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 54759.5us
I20260709 12:26:31.116156  9746 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:26:31.175230  9795 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:31.191812  8471 raft_consensus.cc:2410] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:31.155488  9852 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:31.166955  9783 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.174266  9842 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:26:31.177001  9690 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:31.216686  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:31.232174  8544 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:31.192246  8390 raft_consensus.cc:3055] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:31.223534  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:31.225104  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:31.236289  8395 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.185218  9790 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.177597  9836 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:31.173985  9594 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:31.216092  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 131221us
I20260709 12:26:31.216894  9852 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:31.240209  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:31.252007  8392 raft_consensus.cc:2410] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:31.214897  9796 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:31.216291  9801 raft_consensus.cc:697] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.259804  9801 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.263494  9799 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.265087  9550 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:31.213297  9795 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:31.265846  9795 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.265967  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:31.266568  8388 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.268453  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:31.268603  9793 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.270717  9793 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.213807  9501 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.249941  8395 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:31.273686  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:31.235733  9044 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:31.279929  8395 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:31.200861  9488 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.256269  9747 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.270933  8470 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:31.277638  8392 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:31.244582  9835 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:31.234795  8390 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:31.282560  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:31.245837  9836 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:26:31.287606  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 117315us
I20260709 12:26:31.257892  9824 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.253332  9769 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:26:31.295087  9769 consensus_queue.cc:1243] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer 21c151c99bcf4cbeb819de06e68d95bf log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:26:31.297858  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:31.298472  8395 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:31.302129  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 220171us
I20260709 12:26:31.303937  8361 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:31.271289  9793 consensus_queue.cc:1059] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:26:31.313202  8395 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:31.229637  9783 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.322064  9783 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.277697  9796 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.294217  9835 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.296609  9771 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.304961  9849 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:31.297204  9836 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.358064  8470 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:31.307633  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:31.384922  9849 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.391793  9856 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:31.394078  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.354792  9835 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.306582  9790 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 12:26:31.354182  9852 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:31.407085  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 105426us
W20260709 12:26:31.384603  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 81400us
I20260709 12:26:31.356700  9783 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.404968  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 730) took 1310 ms. Trace:
I20260709 12:26:31.311502  9015 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:31.417547  8396 rpcz_store.cc:276] 0709 12:26:30.094506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.141965 (+ 47459us) service_pool.cc:224] Handling call
0709 12:26:30.155567 (+ 13602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.155740 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:30.933028 (+777288us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b18003c9760. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6463f314bc 00007f646127f48b 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f6461299455 00007f6467d813c7 00007f64643939a7 00007f64643a30bf
0709 12:26:30.933162 (+   134us) log.cc:844] Serialized 14 byte log entry
0709 12:26:31.116989 (+183827us) log.cc:844] Serialized 14 byte log entry
0709 12:26:31.404618 (+287629us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:31.404667 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:31.404708 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.404773 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:31.404905 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36487,"prepare.run_cpu_time_us":7730,"prepare.run_wall_time_us":16149,"raft.queue_time_us":115964,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"spinlock_wait_cycles":31712128,"thread_start_us":644846,"threads_started":3,"wal-append.queue_time_us":209981}
I20260709 12:26:31.420109  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 752) took 1598 ms. Trace:
I20260709 12:26:31.417677  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 753) took 1596 ms. Trace:
I20260709 12:26:31.393416  9746 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:31.409070  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 103834us
I20260709 12:26:31.421008  8546 rpcz_store.cc:276] 0709 12:26:29.821469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.794356 (+972887us) service_pool.cc:224] Handling call
0709 12:26:30.794708 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.929778 (+135070us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.417438 (+487660us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400447ad4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:31.417618 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252399360}
I20260709 12:26:31.422055  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:31.400434  9849 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.416884  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:31.392880  9855 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.357483  9747 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.427134  8472 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:31.386803  9550 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:26:31.420532  8545 rpcz_store.cc:276] 0709 12:26:29.821246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.737623 (+916377us) service_pool.cc:224] Handling call
0709 12:26:30.738306 (+   683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.799353 (+ 61047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:30.799381 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:30.800213 (+   832us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:30.800252 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.419866 (+619614us) spinlock_profiling.cc:243] Waited 60.9 ms on lock 0x7b54000389d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:31.419912 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:31.420049 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139965824}
I20260709 12:26:31.428241  8397 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:31.432572  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:31.434146  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:31.392791  8390 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:31.412348  9625 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:31.444892  9780 consensus_meta.cc:287] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.522s	user 0.006s	sys 0.002s
I20260709 12:26:31.416671  9805 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.429157  9777 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.432484  9852 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.422343  9795 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.445541  9824 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:31.468333  9793 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.469094  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:31.479156  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 366780us
W20260709 12:26:31.450731  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 156101us
I20260709 12:26:31.481912  9793 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.485247  9771 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:31.469570  9801 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:31.468519  9867 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:31.486485  9769 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:31.470058  9790 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:31.407052  9501 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.487540  9574 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:31.487886  9574 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.488741  9574 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.431111  9746 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.489833  9574 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.440104  9841 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:31.490559  9841 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.490932  9841 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.450680  9550 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:31.458158  8390 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.438568  9747 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.492924  9746 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.491910  9550 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.493391  9747 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.494107  9550 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.495030  9550 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.495748  9793 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.499837  9769 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.500751  9769 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.501837  9769 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.486704  9801 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.502852  8390 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:31.438138  9783 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:31.480129  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:31.460309  9865 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.470531  9594 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:31.518304  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 49303.7us
I20260709 12:26:31.519649  9796 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.527478  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:31.527597  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 47531.1us
W20260709 12:26:31.541210  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62584.4us
W20260709 12:26:31.543397  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.544651  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:31.540378  9594 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:31.527220  9580 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.557472  8465 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:31.517318  9488 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.555176  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:31.556113  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:31.559677  8395 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:31.559929  9016 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:31.556357  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:31.561036  8397 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:31.533898  9824 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:31.562593  9861 log.cc:927] Time spent T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:26:31.563375  9046 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:31.565178  9761 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.565889  9594 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:31.533874  9865 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.568895  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:31.569545  9050 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.541558  9870 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:31.572540  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.585352  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:31.585924  8542 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.589351  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:31.590032  8537 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:31.592612  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.566735  9790 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:31.567554  9824 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:31.596076  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:31.596650  8537 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.599480  9042 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
W20260709 12:26:31.599862  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 148844us
I20260709 12:26:31.577087  9707 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:31.567480  9580 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:31.633179  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.684043  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.611655  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:31.609898  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:31.682528  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 72441.6us
I20260709 12:26:31.685328  8545 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:31.600804  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:31.594008  9015 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:31.566759  9594 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.579053  9488 consensus_queue.cc:1059] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:26:31.580120  9867 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:26:31.641999  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 82150.1us
I20260709 12:26:31.601493  9824 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.612757  9746 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.686592  9479 consensus_meta.cc:287] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.881s	user 0.000s	sys 0.010s
I20260709 12:26:31.703212  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:31.682212  9747 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.607959  9801 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:31.619992  9869 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:31.609845  9707 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:31.609818  9872 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.758129  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:31.612047  9769 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 12:26:31.763278  8546 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:31.757615  9758 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.713342  9795 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.694814  8397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "016be601898642f5bfd00376e81080bd"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:31.763942  9707 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:31.779464  8397 raft_consensus.cc:606] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Received request to transfer leadership to TS e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:31.776979  8542 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:31.783378  8537 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:31.780606  8397 raft_consensus.cc:614] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:31.762432  9796 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:31.771799  9871 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:31.808885  8542 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:31.814239  8545 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:31.763375  9747 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.757283  9746 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:31.771375  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:26:31.767494  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 190592us
I20260709 12:26:31.771369  9783 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:31.812285  9860 log.cc:927] Time spent T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
W20260709 12:26:31.817108  9877 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:26:31.824570  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:31.809852  9843 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:31.770475  9835 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.781701  9758 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.713209  9867 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.848201  9050 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
W20260709 12:26:31.825984  9863 log.cc:927] Time spent T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.284s	user 0.010s	sys 0.000s
I20260709 12:26:31.827745  9046 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 3: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:31.820590  9796 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:31.854779  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.853063  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:26:31.861598  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.856921  9843 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.768229  9869 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.863925  8397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:31.864029  8470 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:31.868036  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:31.847673  8541 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:31.871733  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:31.853060  9878 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.862444  9868 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:26:31.874924  9724 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.876405  9856 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:31.876816  9856 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.877121  9856 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:31.870260  9595 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:26:31.879606  9595 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.879887  9747 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.880030  9595 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:31.862951  9769 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.880632  8546 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:31.867609  9843 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:31.892256  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:31.894797  9758 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:31.895802  9045 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:31.896766  9869 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.897027  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:31.897866  9595 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.899266  9835 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:31.900698  9746 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:31.901103  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1060) took 1093 ms. Trace:
I20260709 12:26:31.901443  8468 rpcz_store.cc:276] 0709 12:26:30.808067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.918662 (+110595us) service_pool.cc:224] Handling call
0709 12:26:31.900909 (+982247us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b5400299354. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:31.901049 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350793088}
I20260709 12:26:31.903190  9050 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:26:31.905098  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.902732  9580 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:31.907143  9540 consensus_meta.cc:287] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.803s	user 0.007s	sys 0.003s
I20260709 12:26:31.867066  9874 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:26:31.908823  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.885815  8436 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:31.879946  9873 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:26:31.760931  9865 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.880741  9724 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:31.867750  9882 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.823531  9871 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:31.928864  8436 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:26:31.929606  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.931391  9876 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:26:31.889751  9854 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:31.934106  9574 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:31.897861  9550 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:26:31.995635  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 66855.4us
I20260709 12:26:31.997745  9885 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:26:31.927881  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 57) took 1104 ms. Trace:
I20260709 12:26:31.897351  9769 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:32.006971  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.014493  8468 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.014544  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:31.935334  9874 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:31.909425  9878 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:32.009382  9864 log.cc:927] Time spent T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 12:26:31.992933  9689 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:26:32.042690  8542 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:32.004447  9712 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:26:32.020782  9574 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:32.009315  9550 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.063651  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:32.065701  9859 raft_consensus.cc:3055] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.065913  9045 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:32.066123  9859 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:32.067518  9883 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:32.069134  8389 consensus_meta.cc:287] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.145s	user 0.009s	sys 0.000s
I20260709 12:26:32.069819  8389 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:32.070261  8397 raft_consensus.cc:606] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Received request to transfer leadership to TS e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:32.070591  8397 raft_consensus.cc:614] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:31.939024  9882 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:32.057595  9841 consensus_meta.cc:287] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.003s
I20260709 12:26:32.061334  9870 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.085085  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:32.076925  9494 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.026s
I20260709 12:26:32.066947  9859 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.076988  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1028) took 1609 ms. Trace:
I20260709 12:26:32.098868  9594 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:32.104912  9494 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.014s	sys 0.026s
W20260709 12:26:32.103871  9711 consensus_meta.cc:287] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.898s	user 0.010s	sys 0.000s
W20260709 12:26:32.128742  8388 consensus_meta.cc:287] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.862s	user 0.004s	sys 0.008s
W20260709 12:26:32.129410  9836 consensus_meta.cc:287] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.729s	user 0.008s	sys 0.002s
I20260709 12:26:32.098572  9883 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:26:32.100461  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.132121  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.077864  9841 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.086010  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:32.147120  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 73129us
I20260709 12:26:32.116950  9574 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.113693  9796 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:32.140630  9855 consensus_meta.cc:287] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
I20260709 12:26:32.133729  9594 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.151530  8543 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.130640  9859 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.151317  8510 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:32.111434  8389 rpcz_store.cc:276] 0709 12:26:30.467471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.480620 (+ 13149us) service_pool.cc:224] Handling call
0709 12:26:30.583528 (+102908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.070141 (+1486613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.076920 (+  6779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:32.112836  9874 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.138701  9724 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.104336  9856 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.156157  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.137653  8388 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:32.011035  8540 rpcz_store.cc:276] 0709 12:26:30.821196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.116101 (+294905us) service_pool.cc:224] Handling call
0709 12:26:31.169759 (+ 53658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.393420 (+223661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.398239 (+  4819us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.436941 (+ 38702us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.868590 (+431649us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:26:31.873414 (+  4824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.880987 (+  7573us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:31.891570 (+ 10583us) raft_consensus.cc:1685] finished
0709 12:26:31.891595 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:31.925375 (+ 33780us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15654,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":14561,"thread_start_us":559665,"threads_started":2,"wal-append.queue_time_us":406558}
I20260709 12:26:32.163843  9550 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.165548  8545 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:32.168455  9689 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:32.170468  9689 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.170626  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:32.170864  9689 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.137727  9711 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.155020  9854 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.160749  9855 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.174860  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.162086  9769 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:32.184585  8394 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.168664  9586 raft_consensus.cc:2764] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:26:32.141326  9836 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.185842  8545 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.187335  9856 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.163782  9878 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.191056  9841 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.191372  9867 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:32.193171  9825 consensus_meta.cc:287] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 1.016s	user 0.008s	sys 0.004s
I20260709 12:26:32.197366  9479 raft_consensus.cc:3055] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:32.197773  9479 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:32.198658  9479 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.200502  9711 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.196343  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.208160  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:32.210045  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.210484  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:32.211325  8471 raft_consensus.cc:2410] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:32.212134  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.213030  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.213760  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.214730  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.217867  8468 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:26:32.218343  8468 pending_rounds.cc:85] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 1
I20260709 12:26:32.218564  8468 pending_rounds.cc:107] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:26:32.218771  8468 raft_consensus.cc:2889] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:32.218885  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.220296  8469 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:32.221431  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.221570  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.222189  8468 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:32.222417  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.222874  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.223150  8472 raft_consensus.cc:2410] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:32.208261  8545 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:32.223941  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.224484  8545 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.226778  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.227366  8391 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:32.191879  9707 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.187598  9882 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.192940  9594 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:32.230875  9048 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:32.227846  9849 consensus_meta.cc:287] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.790s	user 0.000s	sys 0.011s
I20260709 12:26:32.218152  9871 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:32.227953  8540 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:32.228962  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 756) took 1002 ms. Trace:
W20260709 12:26:32.234808  9845 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.144s	user 0.004s	sys 0.000s
I20260709 12:26:32.188043  9883 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.230883  8463 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.218075  9824 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.232323  9594 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.248317  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:32.235678  9707 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:32.249331  9836 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:32.250036  8471 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:32.249938  9594 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.235109  9712 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:32.248289  8545 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:32.288820  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.249374  9843 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.289680  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:32.262058  9594 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:32.263083  9046 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:32.263437  9689 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.265378  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:32.266131  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.266386  9824 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:32.277611  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:32.302083  8471 raft_consensus.cc:2393] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 2: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:32.239804  8391 rpcz_store.cc:276] 0709 12:26:31.226414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.244784 (+ 18370us) service_pool.cc:224] Handling call
0709 12:26:32.226635 (+981851us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:32.228897 (+  2262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10121472}
I20260709 12:26:32.255421  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:32.281590  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1056) took 1503 ms. Trace:
I20260709 12:26:32.289412  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.290462  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.307722  8469 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:32.290702  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:32.293497  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.296873  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.299767  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.309625  8542 raft_consensus.cc:2368] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:32.309716  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.305502  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.310590  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.298754  9758 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:26:32.312608  9689 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:32.314446  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:32.310948  8471 raft_consensus.cc:2393] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:32.315847  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.298913  9746 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:26:32.314517  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 749) took 1214 ms. Trace:
I20260709 12:26:32.235935  9849 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:32.318220  8394 rpcz_store.cc:276] 0709 12:26:31.099843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.149297 (+ 49454us) service_pool.cc:224] Handling call
0709 12:26:31.492701 (+343404us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:31.492885 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.185022 (+692137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.314287 (+129265us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54002b5554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:32.314456 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618184960}
I20260709 12:26:32.319399  8542 raft_consensus.cc:2393] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 2: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:32.311918  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.321815  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.322355  8544 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.323041  9707 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.323519  9707 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.325047  8468 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:32.310437  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.315760  8466 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.316805  9047 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:32.329137  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:32.333666  8544 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:32.346903  9707 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.348037  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.358515  8545 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:32.308863  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.303393  9712 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.372176  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.372864  8542 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:32.379842  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:32.384752  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.387228  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.387885  8469 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:32.391417  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.398932  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.307277  8464 rpcz_store.cc:276] 0709 12:26:30.778590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.160789 (+382199us) service_pool.cc:224] Handling call
0709 12:26:32.281324 (+1120535us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400302d54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:32.281488 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754731776}
I20260709 12:26:32.402026  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:32.402593  8394 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.399142  8544 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.367566  9859 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:26:32.394399  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.400449  8540 raft_consensus.cc:2368] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:32.374425  9849 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.410670  8545 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.413929  8394 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:26:32.415247  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:32.416872  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:32.417411  9050 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.419745  8542 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.421367  8545 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.422577  8545 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:32.425904  9050 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:32.427446  8510 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:32.428269  9746 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:32.428735  9746 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:32.429577  9746 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.432504  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:32.433291  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.433601  8545 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.436201  8542 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.436352  9043 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 1. Current term is 3. Ops: []
I20260709 12:26:32.437312  8542 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:32.441594  9843 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.443203  9712 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:32.406864  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.446884  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:32.416065  9759 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:32.445901  9707 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:32.407125  9859 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.471441  8472 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.450269  8538 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:32.469036  9707 raft_consensus.cc:697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:32.480463  8397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e001ede544f519292071c2eeb41fb"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:32.481668  8397 raft_consensus.cc:606] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.482034  8397 raft_consensus.cc:614] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:32.476547  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:32.486035  9043 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:32.487653  9859 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.492750  8397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:32.493346  8397 raft_consensus.cc:606] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.497231  9479 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.505864  8544 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:32.508005  8397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:32.508599  8397 raft_consensus.cc:606] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:32.510162  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.512038  8397 pending_rounds.cc:85] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 2
I20260709 12:26:32.512297  8397 pending_rounds.cc:107] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:32.512509  8397 raft_consensus.cc:2889] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:32.512887  9707 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.514109  9869 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.514552  9869 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.516119  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.526366  8394 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:32.529513  8395 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.534714  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:32.535293  8394 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.536361  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1063) took 1714 ms. Trace:
I20260709 12:26:32.538900  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.536729  8470 rpcz_store.cc:276] 0709 12:26:30.821695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.391645 (+569950us) service_pool.cc:224] Handling call
0709 12:26:31.391963 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:31.866744 (+474781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.536164 (+669420us) spinlock_profiling.cc:243] Waited 472 ms on lock 0x7b54003ccdd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:32.536311 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1085205376}
I20260709 12:26:32.540161  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.542280  8393 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:32.540632  9869 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.548771  8391 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:32.551194  9884 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.552s	user 0.003s	sys 0.000s
W20260709 12:26:32.552822  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.553241  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.554288  9588 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.559399  8539 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.563624  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.564201  8396 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:32.568584  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.574110  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1247) took 1819 ms. Trace:
I20260709 12:26:32.574460  8465 rpcz_store.cc:276] 0709 12:26:30.755143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.756336 (+  1193us) service_pool.cc:224] Handling call
0709 12:26:30.760358 (+  4022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:31.557845 (+797487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.573907 (+1016062us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b5400197154. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:32.574057 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832729472}
I20260709 12:26:32.578791  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.579027  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.570125  8390 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:32.579649  8546 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:32.581060  8388 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:32.581658  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:32.581879  9869 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.582614  9869 raft_consensus.cc:3055] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.582911  9869 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:32.583746  9494 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:32.584148  9494 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:32.584498  9494 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:32.585036  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.586555  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.586963  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.590373  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.590942  8543 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
W20260709 12:26:32.591899  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.546743  8389 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:26:32.601346  9795 raft_consensus.cc:993] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:32.601727  9854 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:32.603760  8362 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:32.586514  8511 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.614322  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.617095  8292 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 2 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.611269  8394 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
W20260709 12:26:32.620121  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 423753us
I20260709 12:26:32.621024  8511 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.622098  8511 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.620373  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:32.624361  8292 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 5, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:32.631042  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:32.631326  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.630884  8292 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 2 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.632463  8292 catalog_manager.cc:5697] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 2 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:32.634225  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.612836  9724 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.611769  9502 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:32.631843  9586 raft_consensus.cc:1081] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Signalling peer 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:32.619684  9594 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:32.618680  9897 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.613415  8541 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:32.630435  9689 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:32.635490  9758 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.636397  9761 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:32.631971  9769 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:32.655814  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 363580us
I20260709 12:26:32.635748  9695 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.635675  9712 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.636914  9854 raft_consensus.cc:697] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:32.655709  9580 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.648581  9824 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:26:32.664183  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.648351  9711 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.665761  8294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 188) took 8564 ms. Trace:
I20260709 12:26:32.666231  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:32.666826  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.650957  9870 consensus_queue.cc:1059] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:26:32.681717  8394 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:32.583696  9869 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.647624  8392 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.660943  9701 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.684064  8388 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:32.684342  9701 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.686408  9701 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.687505  9689 consensus_queue.cc:1059] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.687894  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.688697  9689 raft_consensus.cc:3055] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:32.689044  9689 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:32.689127  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.689936  9689 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.660825  9762 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.690866  9762 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.692281  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.692806  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.693660  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:32.681166  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.694235  8392 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
W20260709 12:26:32.694391  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.683844  9869 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.690280  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.693027  8394 raft_consensus.cc:2410] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:32.662442  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.698536  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:32.668290  9761 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:32.695477  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.704654  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.705312  8396 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:32.654016  9724 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.656355  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:32.706125  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.709000  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.712373  8393 raft_consensus.cc:2410] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:32.658677  9502 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:32.710279  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.664760  9897 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.713917  8394 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:32.681620  8294 rpcz_store.cc:276] 0709 12:26:24.092513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.092652 (+   139us) service_pool.cc:224] Handling call
0709 12:26:32.656725 (+8564073us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:29.704063 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:29.738572 (+ 34509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:29.738608 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:26:29.738627 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:29.811794 (+ 73167us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:29.869482 (+ 57688us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:29.873593 (+  4111us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:26:29.885465 (+ 11872us) tablet.cc:701] Row locks acquired
0709 12:26:29.885485 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:26:29.885631 (+   146us) write_op.cc:270] Start()
0709 12:26:29.885751 (+   120us) write_op.cc:276] Timestamp: P: 1783599989885590 usec, L: 0
0709 12:26:29.885775 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:26:29.886410 (+   635us) log.cc:844] Serialized 1681 byte log entry
0709 12:26:30.602010 (+715600us) op_driver.cc:464] REPLICATION: finished
0709 12:26:30.883926 (+281916us) write_op.cc:301] APPLY: starting
0709 12:26:30.902998 (+ 19072us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:30.904723 (+  1725us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:30.904846 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:31.070968 (+166122us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:31.116523 (+ 45555us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:26:31.122045 (+  5522us) write_op.cc:312] APPLY: finished
0709 12:26:31.156797 (+ 34752us) log.cc:844] Serialized 40 byte log entry
0709 12:26:31.156983 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:31.157074 (+    91us) write_op.cc:454] Released schema lock
0709 12:26:31.157119 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:31.157446 (+   327us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:31.157474 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1708333,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":245776,"apply.run_cpu_time_us":2864,"apply.run_wall_time_us":301552,"num_ops":4,"prepare.queue_time_us":673246,"prepare.run_cpu_time_us":10992,"prepare.run_wall_time_us":289690,"raft.queue_time_us":399374,"raft.run_cpu_time_us":19954,"raft.run_wall_time_us":183461,"replication_time_us":713290,"thread_start_us":1035043,"threads_started":4,"wal-append.queue_time_us":267351,"wal-append.run_cpu_time_us":26941,"wal-append.run_wall_time_us":2007899}]]}
I20260709 12:26:32.714365  9594 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:32.723925  9594 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:32.724861  9594 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.728586  9854 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.729156  9897 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.729755  9897 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.731568  9856 raft_consensus.cc:1064] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:32.731683  9870 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:32.732172  9870 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.734072  9870 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.694235  9580 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.677462  9769 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.705857  9761 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:32.702521  9824 raft_consensus.cc:697] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:32.743664  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:32.753598  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.714083  9689 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.740589  9724 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.694774  9494 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.752315  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:32.753876  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.710744  9871 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.755860  8465 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:32.748664  8436 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:32.751709  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:32.761286  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:32.710048  9800 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:32.765695  8436 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:32.739389  9758 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:32.740638  9580 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:32.755985  9856 raft_consensus.cc:1068] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Unable to promote non-voter e3660d999c0a41658a1f1dbe7cc90746: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:32.747354  9769 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:32.779152  8438 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:32.779457  8537 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:32.776507  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.780640  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:32.772980  8512 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:32.777242  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.781702  8543 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.766903  9927 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:32.787344  8436 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:32.787916  9769 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:32.763622  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:32.789566  9502 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.790031  9730 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.823269  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:32.810155  9580 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.791661  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:32.795785  9550 consensus_queue.cc:1059] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:32.796931  9875 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:32.769471  9574 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:32.787701  9874 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:32.769551  9724 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:32.776400  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.778116  9762 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.759281  9685 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:32.875946  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.813788  8543 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:32.788501  9639 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:32.766592  9800 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.766356  9871 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.773607  8464 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:39218
I20260709 12:26:32.818677  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.821568  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:32.876861  9910 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:26:32.873286  9724 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.824910  8393 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:32.824980  8467 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:32.888931  8464 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:32.889420  8464 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.885833  8397 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:32.890926  8467 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1068) took 1958 ms (client timeout 1807 ms). Trace:
I20260709 12:26:32.891458  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.892098  8397 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:32.826050  9048 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:32.892933  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:32.891294  8467 rpcz_store.cc:269] 0709 12:26:30.932066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.057745 (+125679us) service_pool.cc:224] Handling call
0709 12:26:32.446741 (+1388996us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b58001c7198. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:32.890772 (+444031us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54003967d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:32.890869 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":819385984}
I20260709 12:26:32.862703  9883 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:26:32.785743  9890 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:26:32.859249  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:26:32.925822  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 66652.7us
I20260709 12:26:32.814170  9758 raft_consensus.cc:2764] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:26:32.931473  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 55484.8us
I20260709 12:26:32.932296  8436 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:32.821488  9795 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:32.816051  9870 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.823388  8390 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:32.876922  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 170661us
W20260709 12:26:32.933638  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 161349us
I20260709 12:26:32.823817  9494 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:32.824358  9769 raft_consensus.cc:697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:32.859349  9875 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.824298  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.941596  9875 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.942009  8391 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:32.942611  8436 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:32.821839  9841 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:32.865906  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 109061us
I20260709 12:26:32.869688  9866 consensus_queue.cc:1059] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:26:32.888223  9800 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:32.873441  9874 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.876124  9707 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:32.895301  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:32.890733  9790 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:26:32.893478  8397 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:32.928267  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:32.930188  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:32.856678  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:32.936705  9686 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:32.937914  8512 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:32.985317  9938 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:32.933912  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 226138us
I20260709 12:26:32.988903  8511 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:32.990571  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:32.857040  9824 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:32.888957  9724 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:32.880048  9771 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:26:32.978050  8393 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:32.827272  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.002060  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.932233  9701 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:32.943545  9859 raft_consensus.cc:993] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:32.862973  9574 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.984273  8396 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:32.972177  9639 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:32.997609  9843 consensus_queue.cc:1059] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:26:32.824229  9580 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:32.991233  9759 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.979760  9707 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.938776  9501 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:26:32.985787  9891 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:32.944955  9795 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.032856  8395 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.034765  9594 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.008358  9639 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.039314  9639 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.008212  9574 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.032104  9883 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:26:33.036612  9925 log.cc:927] Time spent T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:26:32.944844  9870 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.987905  9938 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:33.055969  9938 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.057210  9870 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:33.058416  9931 log.cc:927] Time spent T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:26:33.025238  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:33.060076  9836 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:26:33.027388  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 170790us
I20260709 12:26:32.941540  9769 consensus_queue.cc:237] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.005997  9932 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:33.063097  9574 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.062646  9639 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.066483  9938 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:33.016136  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.068991  8388 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.063364  9932 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.072288  9932 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.027073  9588 raft_consensus.cc:1081] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Signalling peer 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:33.035714  9841 raft_consensus.cc:697] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:33.061821  9761 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.085088  9761 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.067718  9927 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:33.086089  8392 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:33.086849  9841 consensus_queue.cc:237] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:33.087616  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.089072  9874 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.067708  9639 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:33.067842  9574 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.068291  8438 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:33.005378  9701 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.098771  9795 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.011426  9762 consensus_queue.cc:1059] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:26:33.091660  9883 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:33.105038  9762 raft_consensus.cc:3055] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.105430  9762 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:33.105532  9883 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.106199  9762 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.030587  9759 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:32.997098  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.007553  9777 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:33.080660  9580 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.024572  9897 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:33.117326  9897 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.028781  9707 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.029838  9550 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:33.101141  9701 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.060338  8436 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:33.059234  9849 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:33.142388  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 82119.2us
I20260709 12:26:33.110047  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:33.047729  8395 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:33.107280  9762 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.113163  9777 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.151111  9777 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.112365  9891 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:33.151929  9891 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:33.152340  9891 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.132860  9550 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.112535  9801 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:26:33.121551  9695 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.119271  9897 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:33.129904  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 132882us
W20260709 12:26:33.132220  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.124089  8389 raft_consensus.cc:2410] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:33.149250  9552 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:33.094786  8393 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
W20260709 12:26:33.161165  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51206.6us
I20260709 12:26:33.164150  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.164481  8438 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:33.165647  9784 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.168111  9784 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:33.168898  9784 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.166836  8464 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.171540  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.172602  9784 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:33.173382  9695 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.176694  9550 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.159842  9849 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.121243  9759 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:33.119139  9875 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.205047  9758 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:33.205672  9758 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.208154  9927 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:33.208657  9927 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.210636  9927 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:33.211937  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.212626  8541 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:33.188436  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.177305  9552 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:33.170585  9777 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:33.218611  8543 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.242304  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:33.242899  8543 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.195634  9479 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:33.246104  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 57760.2us
I20260709 12:26:33.247886  9479 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.248306  9479 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.249045  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.249676  8541 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:33.249979  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.251017  8541 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.243785  9890 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.251624  9890 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.252180  8464 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:33.247502  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.192400  9746 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:33.192416  9711 raft_consensus.cc:3055] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.253592  9890 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.256541  9927 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.257066  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.257175  9771 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:33.201761  9897 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:26:33.244838  9777 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.278887  8544 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:33.245834  9759 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:33.284915  9866 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.264309  9711 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:33.286974  8545 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.256318  9552 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:33.271863  9771 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.272918  9758 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:33.213754  9934 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 12:26:33.300801  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.281126  9777 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.305495  8543 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:33.307761  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.309404  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.312497  9897 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:33.313374  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:33.313827  9932 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.318967  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:33.343642  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 351238us
W20260709 12:26:33.347143  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 90142.8us
I20260709 12:26:33.353410  8436 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:33.319239  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:33.353848  8511 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.354364  8544 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.355332  8511 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:33.285470  9866 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.313653  9479 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.291852  9711 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.358543  9574 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:33.330809  9724 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.369829  8537 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:26:33.375641  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.385026  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:33.386426  9724 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:33.388646  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.390733  9800 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.391247  9800 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.360937  9550 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:26:33.377444  9574 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.396756  9574 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.396922  9701 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.399089  9701 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.362782  9711 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.402894  8544 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:33.405315  9932 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:33.361874  9488 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:33.412325  9837 raft_consensus.cc:3055] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:33.413987  9891 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.415889  9866 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.358927  9890 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:26:33.467581  9837 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:33.486651  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:33.363569  9758 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:26:33.417366  9849 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:33.508049  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 150578us
W20260709 12:26:33.509467  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 154191us
I20260709 12:26:33.487300  8541 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.510327  9730 raft_consensus.cc:3055] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.510741  9730 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:33.512316  9689 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:33.512804  9689 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:33.513226  9891 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.513676  9689 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.514699  9707 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.515743  8390 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:33.515975  9758 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:33.516330  9758 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:33.519677  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.520438  8472 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:33.516489  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.521857  8464 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:33.523685  9730 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.524667  9730 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.524787  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:33.527098  8464 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:33.527575  9758 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.528687  9758 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.529518  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.530198  8472 raft_consensus.cc:2393] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:33.532354  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.532699  9777 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.534260  8472 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:33.534719  9777 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:33.509079  9488 raft_consensus.cc:697] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:33.536016  9488 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.537104  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.537853  9048 raft_consensus.cc:2368] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4.
W20260709 12:26:33.538720  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.539852  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:33.541838  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:33.542361  8467 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.528838  9707 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.549404  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.549980  8544 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:33.551080  8467 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:33.552203  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:33.560583  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:33.561105  8544 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.562288  8511 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:33.541637  9746 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.553077  8464 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:33.556716  9707 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:33.575546  8541 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:33.575799  8467 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:33.577808  9875 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.559885  9594 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:33.578552  9044 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:33.559737  9932 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:33.591358  8544 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:33.587476  9934 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:33.586457  9574 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.591570  9594 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.605859  9934 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:33.609051  9934 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:33.587582  9746 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.605989  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.589058  9758 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:26:33.592298  9854 consensus_queue.cc:1059] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:26:33.613999  9843 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.008s	sys 0.020s
W20260709 12:26:33.614367  9843 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.008s	sys 0.020s
I20260709 12:26:33.614518  9854 raft_consensus.cc:3055] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:33.607421  8511 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:33.614884  9854 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:26:33.605768  9841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.015s	sys 0.017s
W20260709 12:26:33.613240  8512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.042s
I20260709 12:26:33.609136  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:33.605548  9707 raft_consensus.cc:697] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:33.609596  9574 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.619150  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:33.624894  8512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.004s	sys 0.042s
I20260709 12:26:33.609679  9594 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:33.596127  9932 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:33.634290  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 696373us
I20260709 12:26:33.637998  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:33.629876  9494 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:33.613095  9942 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:26:33.634873  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:33.631027  9841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.015s	sys 0.017s
W20260709 12:26:33.735086  9016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.052s	sys 0.086s
W20260709 12:26:33.744819  9016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.052s	sys 0.086s
I20260709 12:26:33.747133  8395 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:33.644697  9494 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:33.748683  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.730028  8464 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 12:26:33.754376  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.755100  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.757824  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:33.759183  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.758510  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:33.760280  8471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:39218
I20260709 12:26:33.764591  8471 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.764954  8471 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.759712  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.763507  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:33.767777  8470 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.759158  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:33.771631  8466 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
W20260709 12:26:33.772332  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.777554  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.761775  8541 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 2: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:33.762132  8464 pending_rounds.cc:85] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 2
I20260709 12:26:33.753602  9494 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.753382  9758 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:33.770215  9762 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.774519  9701 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.838428  8469 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:33.789007  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:33.815297  8464 pending_rounds.cc:107] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 12:26:33.850325  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.854657  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 809) took 1092 ms. Trace:
I20260709 12:26:33.855034  8539 rpcz_store.cc:276] 0709 12:26:32.762022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.767702 (+  5680us) service_pool.cc:224] Handling call
0709 12:26:32.768037 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.768345 (+   308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.768373 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:32.768784 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 12:26:33.411208 (+642424us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b1800104e60. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6463f314bc 00007f646127f48b 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6463f2320b 00007f6463f28d23 00007f6463f290d1
0709 12:26:33.411338 (+   130us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:33.815696 (+404358us) log.cc:844] Serialized 14 byte log entry
0709 12:26:33.816698 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.816775 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:33.816814 (+    39us) raft_consensus.cc:1685] finished
0709 12:26:33.854483 (+ 37669us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.854606 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1582,"raft.queue_time_us":204286,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":16394,"spinlock_wait_cycles":5876096,"thread_start_us":627320,"threads_started":2,"wal-append.queue_time_us":389440}
I20260709 12:26:33.735337  9854 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:33.866253  8361 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.007s	sys 0.025s
I20260709 12:26:33.868558  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:33.868777  8361 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.007s	sys 0.025s
W20260709 12:26:33.869148  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 513954us
I20260709 12:26:33.870323  8471 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.857321  9758 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:33.857345  8464 raft_consensus.cc:2889] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:33.872067  8395 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:33.874015  8471 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:33.774945  9707 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:33.876461  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.876916  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:33.881007  8361 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.888s (SENT) [suppressed 4 similar messages]
I20260709 12:26:33.841427  9762 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:33.897982  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.871325  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:26:33.879971  9949 log.cc:927] Time spent T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 12:26:33.862035  9701 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:33.864513  9950 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:26:33.879048  9746 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:33.900015  9954 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:26:33.906203  8361 leader_election.cc:400] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:33.909088  8361 leader_election.cc:403] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:33.904399  9043 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.922474  9934 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.904608  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.925092  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.926222  8539 raft_consensus.cc:2368] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3.
I20260709 12:26:33.926465  8472 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:33.926246  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.925058  9043 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:33.927979  9042 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:33.929088  9701 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:33.929585  9701 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.929989  9701 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.930763  8470 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:33.931700  8541 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:33.880898  9948 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:26:33.877067  9758 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:33.900684  9871 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:33.938079  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 298889us
I20260709 12:26:33.933537  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:33.939167  9932 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:33.942354  9871 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:33.946775  8510 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:33.954986  9953 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.974673  9932 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:34.012591  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 241363us
I20260709 12:26:34.017445  8392 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:34.020859  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.021534  8538 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:34.023252  8393 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.027356  8393 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.011503  9927 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.029557  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.028692  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.012151  9746 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.037676  8396 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:33.985515  9970 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:34.039188  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.042032  8393 raft_consensus.cc:3055] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:34.043448  8393 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:34.029026  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.044723  8388 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.018186  9932 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.049533  9932 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.049959  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.051157  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.051740  8391 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:34.052124  8388 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:34.052580  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.055038  9758 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.017752  9953 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.056708  9970 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.058262  9934 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.059449  9762 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:34.059865  8397 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.012s	sys 0.020s
W20260709 12:26:34.062093  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.022624  9701 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.040839  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.065547  8393 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:34.068259  8397 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.012s	sys 0.021s
I20260709 12:26:34.070463  8393 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:34.068930  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 86924.4us
I20260709 12:26:34.076762  8512 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:34.077324  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 171248us
W20260709 12:26:34.078117  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.083809  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.086313  8393 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:34.107036  8396 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:34.120458  8361 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.066149  9758 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.060257  9494 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.121784  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:34.126171  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 49477.2us
I20260709 12:26:34.132316  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.133410  8542 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:34.132150  9934 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.136433  9800 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.068431  9759 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.079257  8541 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
W20260709 12:26:34.154407  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.144785  9960 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:26:34.132951  9758 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.162286  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.158560  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.193001  9948 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:34.193616  9948 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.174015  9746 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:34.175452  9824 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:34.176378  8541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:26:34.209714  9982 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:34.209939  9494 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.179114  8391 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 1.
I20260709 12:26:34.218520  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.218969  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.211695  9758 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.196528  9938 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.217273  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 790) took 1396 ms. Trace:
I20260709 12:26:34.219137  8389 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:34.241030  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.228261  8397 rpcz_store.cc:276] 0709 12:26:32.824566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.516275 (+691709us) service_pool.cc:224] Handling call
0709 12:26:33.516532 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:33.516721 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:34.070992 (+554271us) log.cc:844] Serialized 14 byte log entry
0709 12:26:34.216774 (+145782us) log.cc:844] Serialized 14 byte log entry
0709 12:26:34.216951 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:34.217000 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:34.217041 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.217110 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.217218 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10231,"prepare.queue_time_us":648125,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":727,"raft.queue_time_us":4210,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":187,"thread_start_us":688962,"threads_started":2,"wal-append.queue_time_us":148181}
I20260709 12:26:34.249581  8542 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:26:34.225160  8541 raft_consensus.cc:606] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:34.244232  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 122519us
I20260709 12:26:34.221271  9844 raft_consensus.cc:3055] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:34.248147  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.263778  9837 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.264441  8542 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:34.262862  8545 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:34.266471  9970 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.271591  8397 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.268986  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.272256  8391 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:34.272933  8545 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:34.273170  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.273792  8391 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.274042  8545 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:34.275068  8545 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:34.235172  9762 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:34.271173  9844 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:34.276973  9844 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.277954  9844 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.279548  8397 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:34.280381  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.280901  8397 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:34.281632  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.269436  8361 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.216066  9824 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.242240  9953 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.269897  9971 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:34.243592  9948 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.271638  8541 raft_consensus.cc:614] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:34.299391  9979 log.cc:927] Time spent T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:26:34.270978  9871 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:34.217612  9973 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.283766  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.283685  9837 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.287811  9711 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:34.307647  9711 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:34.308109  9711 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.222714  9982 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.296484  9771 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.297749  9971 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.321484  9971 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.325822  8397 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:34.327045  8361 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.328933  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.330067  8394 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:34.325253  9991 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:34.332357  8397 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:34.305567  8538 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:34.334132  9991 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:34.334331  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.330145  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.334739  9982 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.323221  9824 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.332587  9871 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:34.347208  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.347823  8396 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:34.343730  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.329274  9479 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.344506  9948 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:34.341082  9977 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:34.342406  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.352746  8392 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:34.345155  9988 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.359439  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.347295  9871 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.360206  8361 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.361763  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 815) took 1155 ms. Trace:
I20260709 12:26:34.367673  8537 rpcz_store.cc:276] 0709 12:26:33.205973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.206095 (+   122us) service_pool.cc:224] Handling call
0709 12:26:33.206413 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:33.376618 (+170205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.361526 (+984908us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b540006c7d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:34.361706 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375284480}
I20260709 12:26:34.359344  8389 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:34.369567  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.371706  8537 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:34.370440  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.372996  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:34.369031  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.374143  8542 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:34.371120  9981 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.376268  9043 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:34.377496  9988 raft_consensus.cc:2764] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:34.365530  9871 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:34.380900  8361 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.384399  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.390358  8537 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.385772  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47416 (request call id 150) took 1020 ms. Trace:
I20260709 12:26:34.390457  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.391256  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.392135  9988 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:34.392436  8361 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.393484  8361 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.358990  9948 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.393859  8389 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.394181  8395 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.397207  8537 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:34.390816  9048 rpcz_store.cc:276] 0709 12:26:33.365359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.365521 (+   162us) service_pool.cc:224] Handling call
0709 12:26:34.385587 (+1020066us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540059ea54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:34.385712 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349734784}
W20260709 12:26:34.387943  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.361413  9989 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.386220  9981 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:34.401927  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.393131  9988 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:34.402637  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.401727  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.409238  8544 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:34.409798  8537 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.393657  9801 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.405146  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:34.415591  9769 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.415741  9771 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:34.417055  9800 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.417590  8537 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:34.417881  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:34.389892  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.424072  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.426102  9574 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:34.426790  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:34.429508  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.432101  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.432255  8436 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.432171  8545 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.436359  8537 raft_consensus.cc:2393] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:34.437124  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.437665  8537 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:34.438375  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.439286  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.434752  8541 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:34.421025  9989 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.440442  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.443540  8544 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:34.450505  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.445641  8545 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:34.452247  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.453091  8545 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.455349  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.455854  9574 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:34.456522  9574 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:34.457842  9948 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.458348  9043 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:34.444057  9695 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 12:26:34.461431  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.457355  9574 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.432964  9953 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:26:34.473446  8361 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:34.389379  9991 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.428263  9801 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.499224  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.500422  8545 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:34.501319  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.501873  8545 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:34.502828  8545 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:34.463016  9982 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.431627  9769 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.511808  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.513425  8544 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:34.474057  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:34.515648  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 83433.1us
I20260709 12:26:34.516440  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.515148  9759 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.518368 10011 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.492415 10005 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:34.503602  9988 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:34.525660  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.528692  8361 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.530140  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.521209 10003 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:34.531157  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.527799  9479 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:34.528406  9988 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:34.530369  9981 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:34.529299 10009 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.535778  9989 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:34.533130 10003 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.532423 10007 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:34.539608  9043 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Advancing to term 5
I20260709 12:26:34.526790  9759 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.529409 10011 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.559134  9769 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:34.560981  9958 log.cc:927] Time spent T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.581s	user 0.003s	sys 0.000s
I20260709 12:26:34.561635  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:34.562566  9871 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.557178 10007 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:34.563877  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 822) took 1343 ms. Trace:
I20260709 12:26:34.564258  8540 rpcz_store.cc:276] 0709 12:26:33.220839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.239881 (+ 19042us) service_pool.cc:224] Handling call
0709 12:26:33.276383 (+ 36502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:33.276788 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:33.276821 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:33.277472 (+   651us) log.cc:844] Serialized 52 byte log entry
0709 12:26:33.825061 (+547589us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:33.829514 (+  4453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.839306 (+  9792us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:34.560446 (+721140us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:34.563592 (+  3146us) raft_consensus.cc:1685] finished
0709 12:26:34.563620 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.563823 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1272,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3462,"spinlock_wait_cycles":4393856,"thread_start_us":499125,"threads_started":1,"wal-append.queue_time_us":665096}
I20260709 12:26:34.566190  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:34.566751  8540 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:34.546322  9981 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:34.567605  9981 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.553966 10003 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.574385  8543 raft_consensus.cc:1275] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:34.576116  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:34.576545  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1210) took 1015 ms. Trace:
I20260709 12:26:34.576922  8539 rpcz_store.cc:276] 0709 12:26:33.560884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.856740 (+295856us) service_pool.cc:224] Handling call
0709 12:26:34.576373 (+719633us) spinlock_profiling.cc:243] Waited 56.9 ms on lock 0x7b54000384d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:34.576490 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130945280}
I20260709 12:26:34.579090  8539 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:34.552331  9989 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.579627  9989 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:34.581314  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 816) took 1375 ms. Trace:
I20260709 12:26:34.581666  8546 rpcz_store.cc:276] 0709 12:26:33.206241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.212902 (+  6661us) service_pool.cc:224] Handling call
0709 12:26:33.213195 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:33.537288 (+324093us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:33.943966 (+406678us) log.cc:844] Serialized 14 byte log entry
0709 12:26:34.130621 (+186655us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:34.130674 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:34.130715 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.581115 (+450400us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54004493d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:34.581157 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.581264 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5684,"prepare.queue_time_us":341478,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":83,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":15833,"spinlock_wait_cycles":744883584,"thread_start_us":592695,"threads_started":2,"wal-append.queue_time_us":231926}
I20260709 12:26:34.584273  9801 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.589617  8391 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:34.564281 10007 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.594677  8543 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:26:34.594985  8543 pending_rounds.cc:85] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 2
I20260709 12:26:34.595163  8543 pending_rounds.cc:107] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:34.595364  8543 raft_consensus.cc:2889] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:34.596050  8546 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:34.528251 10005 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.609581  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.589526  9927 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.556842 10009 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:34.557215  9479 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:34.610255  9837 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:26:34.622174  9479 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.622571  9837 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:34.623447  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:34.626317  8391 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:34.627671 10009 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:34.628137 10009 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.628636 10005 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:34.629431  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.629309  8388 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:34.631968  8510 leader_election.cc:400] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4.
I20260709 12:26:34.632292  8510 leader_election.cc:403] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:34.625996  9711 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.579233 10003 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:34.642517  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.630030 10011 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.649216  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.650615  8469 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:34.655378  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.657166  9050 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:34.657688  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.660097  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:34.660625  8469 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.661214  8393 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.658600  8466 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:34.663009  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.663676  8463 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:34.669589  8469 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:34.671289  8393 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:34.647480  9880 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:34.673418  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 94160.1us
I20260709 12:26:34.678238  9050 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.682010  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:34.682654  8469 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.630869  9927 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:34.707469  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:34.711050  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 179959us
I20260709 12:26:34.717941  8469 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:34.718825  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:34.719651  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 110145us
I20260709 12:26:34.720408  8438 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.722170  8469 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:26:34.721316  9837 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:34.725716  9043 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:34.715768  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:34.726438  9837 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:34.727090  8463 raft_consensus.cc:2368] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5.
I20260709 12:26:34.727705  9871 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.723125 10005 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.664691 10011 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:26:34.730098  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.748806  8438 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:34.750582  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.752705  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.753472  8466 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:34.754896  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.755897  8464 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:34.754289  8438 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:26:34.765028  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 83158.2us
I20260709 12:26:34.787009  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.683656  9880 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:34.797348  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.809504  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.809913  8465 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:34.761405 10022 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:34.751957 10005 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:34.821970  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 67765.6us
I20260709 12:26:34.796052  9574 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.847939  8466 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:34.848567  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:34.862777  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.866494  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.867228  8395 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:34.869105  8470 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:34.861102  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.872212  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.817580  9989 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.876009  8469 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:34.874261  8392 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:34.871402  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.873898  8389 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:34.878332  8395 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:34.878743  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.878909  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.863535 10022 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:34.879352  8389 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 1.
I20260709 12:26:34.872618  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.880573  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.879961  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.863281 10014 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.894306  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.876515  9759 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.883270  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.895581  8395 raft_consensus.cc:2393] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:34.866325  9574 raft_consensus.cc:697] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:34.883364  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.870184 10016 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.882752 10022 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.884557  8470 raft_consensus.cc:2393] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:34.896917  8389 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.889858  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:34.894905  8469 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:34.916240  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.896423  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.892942 10003 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:34.898173  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:34.921118  8389 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:34.923655  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:34.924153  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.912657  9871 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.924860  9871 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.925201  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.901158  9854 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.925779  8389 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:34.926527  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.927029  8389 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:34.872036  9711 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.864549 10011 consensus_queue.cc:1059] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:26:34.901696  8512 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:34.932735 10011 raft_consensus.cc:3055] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:34.933081 10011 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:34.921759  9988 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.933805 10011 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.934973 10011 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.914822 10009 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.936728  9989 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.923146  9769 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:34.937678  9769 raft_consensus.cc:697] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:34.938547  9769 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.939638  8391 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:26:34.940022  8391 pending_rounds.cc:85] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 5
I20260709 12:26:34.940243  8391 pending_rounds.cc:107] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:26:34.940490  8391 raft_consensus.cc:2889] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:34.901995  8463 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 2: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:34.915314 10022 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:34.940619  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:34.941542  9927 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:34.942818  9880 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.914547 10016 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.883023 10024 raft_consensus.cc:2764] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:34.927770  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.943975 10005 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.918916  8392 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:34.945976 10016 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:34.918169 10026 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.919435  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:34.930124  9871 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:34.962841  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 96136.5us
I20260709 12:26:34.919692  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:34.945665  9981 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.980415  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.981766  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:34.981869  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.944473  8389 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:34.984810  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:34.985495  8471 raft_consensus.cc:2368] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
W20260709 12:26:34.986781  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.988960  8392 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:34.989312  9015 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:34.983919  8436 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:34.982694 10024 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:34.987480 10030 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:34.995344  9948 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:34.994428 10007 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.996869  9883 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:35.011307  8392 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:35.009585  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 161913us
I20260709 12:26:34.946727 10026 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:34.993449  9843 consensus_queue.cc:1059] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:26:34.993618  9953 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:26:35.019769  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.020641  8362 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.017072  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.012818  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:35.027653  8395 raft_consensus.cc:2410] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:34.943989  9574 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:35.034493  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 139704us
I20260709 12:26:35.037472  8361 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.042763  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.050742  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:35.025722  9843 raft_consensus.cc:3055] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:35.012745 10007 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.053238  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.023072 10019 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.016839 10032 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:26:35.052351 10016 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:35.053349 10005 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.059370  9989 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:35.053109 10003 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:35.058233  9982 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:35.073508  9982 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:35.058745  9843 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:35.074468  9982 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.038035  8362 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:35.068192 10031 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:26:35.088392 10022 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.072073 10003 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.089567 10003 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:35.090514 10022 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.086714  9762 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.087944  9843 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.071835  9989 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.092262  9762 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:35.093772  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 55817.4us
I20260709 12:26:35.094910  9991 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:35.097342  8362 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:35.100431  9843 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:35.095732  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 99598.8us
I20260709 12:26:35.096549  9989 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:35.103595  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 113164us
I20260709 12:26:35.076663  9981 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.108609  8362 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.103735 10042 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:35.111577  8362 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.109943 10030 raft_consensus.cc:697] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.113667 10046 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:35.114815 10026 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.114306 10030 consensus_queue.cc:237] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.116175 10045 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:35.111392 10042 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.118011 10042 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:35.104771  9701 raft_consensus.cc:2764] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
W20260709 12:26:35.120074  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.106396 10024 raft_consensus.cc:697] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.129365 10024 consensus_queue.cc:237] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:35.132362  9951 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.198s	user 0.001s	sys 0.001s
W20260709 12:26:35.134044  9957 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.262s	user 0.002s	sys 0.001s
I20260709 12:26:35.136585  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:35.107178 10016 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:26:35.137495  9044 raft_consensus.cc:2410] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:35.137964  9880 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.138438  9880 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.140424  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.111114  9981 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:35.141014  9880 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.140972  8394 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:35.143941  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:35.141618  9955 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.267s	user 0.004s	sys 0.000s
I20260709 12:26:35.117503 10045 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:26:35.141929  9701 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.143565  9883 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:26:35.154014  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 51411.7us
I20260709 12:26:35.158941  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:35.159809  8540 raft_consensus.cc:2410] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:35.159948 10003 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.161207 10048 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:35.155792  9883 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.163125 10007 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:35.143141  9989 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.165351  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:35.166066 10042 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.167101  9989 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.172857  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:35.174911  8394 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:35.175242  8541 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.178013  8466 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:35.167047  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:35.178891  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.183589  8541 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:35.184543  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 167531us
I20260709 12:26:35.185483  8438 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.186816  9759 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4.
W20260709 12:26:35.186980  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 555117us
W20260709 12:26:35.187587  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 285942us
I20260709 12:26:35.166064  8540 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:35.189565  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:35.191602  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:35.190594  9689 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.193744  9712 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:26:35.196622 10042 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.188897 10032 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:35.198251  9963 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.264s	user 0.004s	sys 0.000s
I20260709 12:26:35.196540 10011 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:35.193831  9746 consensus_queue.cc:1059] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:26:35.194315 10047 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:35.189932 10034 raft_consensus.cc:2764] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:35.199368 10032 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.195948 10049 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:35.189409 10050 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.212530  9944 raft_consensus.cc:3055] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:35.213037  9944 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:35.213923  9944 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.190634  9695 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.215183  9944 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.219527 10050 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.241715 10050 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.224846  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:35.252744  8391 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:35.254258  8391 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:35.256395 10032 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:35.219240  9695 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.261093  9695 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.261775  8292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46076 (request call id 88) took 6451 ms. Trace:
I20260709 12:26:34.900393  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:35.242429  9988 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.269305  9762 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.271988  9762 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.273083  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:35.273747  8545 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:35.262152  8292 rpcz_store.cc:276] 0709 12:26:28.822862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.832419 (+  9557us) service_pool.cc:224] Handling call
0709 12:26:35.261689 (+6429270us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:32.937087 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:32.937613 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:32.937647 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:26:32.937664 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:32.941327 (+  3663us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:32.941390 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:32.941430 (+    40us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:26:32.941849 (+   419us) tablet.cc:701] Row locks acquired
0709 12:26:32.941862 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:26:32.941992 (+   130us) write_op.cc:270] Start()
0709 12:26:32.942100 (+   108us) write_op.cc:276] Timestamp: P: 1783599992941951 usec, L: 0
0709 12:26:32.942117 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:26:32.942733 (+   616us) log.cc:844] Serialized 1722 byte log entry
0709 12:26:34.022411 (+1079678us) op_driver.cc:464] REPLICATION: finished
0709 12:26:34.269981 (+247570us) write_op.cc:301] APPLY: starting
0709 12:26:34.270061 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:34.270206 (+   145us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:34.270309 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:34.270836 (+   527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:34.271013 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:26:34.271057 (+    44us) write_op.cc:312] APPLY: finished
0709 12:26:34.279904 (+  8847us) log.cc:844] Serialized 40 byte log entry
0709 12:26:34.280065 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:34.280162 (+    97us) write_op.cc:454] Released schema lock
0709 12:26:34.280207 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:34.280561 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:34.280589 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":341805,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":242621,"apply.run_cpu_time_us":2106,"apply.run_wall_time_us":10564,"num_ops":4,"prepare.queue_time_us":288696,"prepare.run_cpu_time_us":37694,"prepare.run_wall_time_us":365462,"raft.queue_time_us":542917,"raft.run_cpu_time_us":15992,"raft.run_wall_time_us":205231,"replication_time_us":1044050,"thread_start_us":1046243,"threads_started":4,"wal-append.queue_time_us":445612}]]}
W20260709 12:26:35.286965  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 98487.7us
I20260709 12:26:35.289000  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:35.289264  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.295292  8512 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.277184 10048 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:26:35.306135  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62728.8us
I20260709 12:26:35.306782  8438 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:35.310151  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.288290  8391 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:35.305713  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.313710  8436 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.311033  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:35.314148  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.299170  9944 raft_consensus.cc:2764] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:35.318948  8438 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:35.352702  8467 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:35.411500  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1275) took 1657 ms. Trace:
I20260709 12:26:35.411963  8467 rpcz_store.cc:276] 0709 12:26:33.754428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.757072 (+  2644us) service_pool.cc:224] Handling call
0709 12:26:33.757379 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.352467 (+1595088us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b540011db20. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464300dc0 00007f646438b1c0 00007f646438c231 00007f6464388d8f 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c
0709 12:26:35.411208 (+ 58741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.411443 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30787968}
W20260709 12:26:35.413028  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 94158.9us
W20260709 12:26:35.416096  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 102450us
I20260709 12:26:35.319599  9841 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:35.322538 10052 raft_consensus.cc:1064] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:35.319823 10049 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:35.320711  9800 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.099s
W20260709 12:26:35.418445  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 107496us
W20260709 12:26:35.418883  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 104903us
I20260709 12:26:35.424507  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:35.320860 10058 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.314625  9695 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:35.312027 10048 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.320933 10050 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.100s
I20260709 12:26:35.420763  9980 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.442097 10019 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:35.450706  8469 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:26:35.449977  8362 leader_election.cc:400] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:35.456187 10019 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.445547  9800 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:26:35.419983 10022 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.446653  8436 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.453902  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 825) took 1329 ms. Trace:
I20260709 12:26:35.455811  8362 leader_election.cc:403] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:26:35.458714  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:35.458045  8396 rpcz_store.cc:276] 0709 12:26:34.124841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.392841 (+268000us) service_pool.cc:224] Handling call
0709 12:26:34.393131 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:34.463190 (+ 70059us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.463218 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:34.463664 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:26:34.500964 (+ 37300us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:34.501003 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.453156 (+952153us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b54003dd6d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:35.453201 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:35.453248 (+    47us) raft_consensus.cc:1685] finished
0709 12:26:35.453262 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.453829 (+   567us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3145,"raft.queue_time_us":31991,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":15797,"spinlock_wait_cycles":34588416,"thread_start_us":89588,"threads_started":2,"wal-append.queue_time_us":53495}
I20260709 12:26:35.461711  8511 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:35.427366  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 238712us
I20260709 12:26:35.489058  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:35.489799  8467 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:35.434166  9841 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.455528  9771 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:26:35.433470 10067 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.492012  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:35.494689  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48097.2us
W20260709 12:26:35.492676  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 68249.1us
W20260709 12:26:35.505414 10040 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.411s	user 0.000s	sys 0.003s
I20260709 12:26:35.508559  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:35.509853  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:35.496704  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:35.495184  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:35.511343  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:35.511444  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:35.511639  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:35.511967  8396 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:35.499466  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:35.497262 10061 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.455197  9980 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.426400 10062 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:35.460119 10022 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.489205  9989 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:35.461370  9701 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:35.489147  9695 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:35.507351  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:35.507392  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:35.559037  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51715us
W20260709 12:26:35.507002  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.514330  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:35.514559  8295 catalog_manager.cc:5697] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.561462  8295 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:35.504904 10068 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:35.500348 10065 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.502118 10042 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:35.505906 10067 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.501480 10063 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.565546  8395 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:26:35.510191  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 841) took 1142 ms. Trace:
I20260709 12:26:35.552452 10022 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.568668  8396 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:35.563215  8295 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:35.551038  9944 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:35.429656 10058 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.580744  8295 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.505916  9927 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:26:35.564015  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:35.572249 10061 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:35.570710 10042 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.595904  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.555841  9769 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:26:35.574479 10063 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.587602  9701 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.577401  9771 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.590811  8295 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.618018  8295 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:35.619371  8295 catalog_manager.cc:5697] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 2 to 3, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.620097  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 828) took 1494 ms. Trace:
I20260709 12:26:35.620514  8397 rpcz_store.cc:276] 0709 12:26:34.125509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.281437 (+155928us) service_pool.cc:224] Handling call
0709 12:26:35.619911 (+1338474us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b5400103e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:35.620019 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100532608}
I20260709 12:26:35.621104  8295 catalog_manager.cc:5697] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.574570 10067 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.503472  9841 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.613405 10063 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.623243  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.624377  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:35.624837  8392 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.575263 10065 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.626832 10065 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.628626 10058 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.589763 10066 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:26:35.630435  8394 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:35.632323  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:35.632848  8470 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:35.632961 10067 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:35.633572  8472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1089) took 2096 ms (client timeout 1786 ms). Trace:
I20260709 12:26:35.627349  8295 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 2, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:35.634999  8295 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:35.635917 10071 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:26:35.579553  9746 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:26:35.587142  9944 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.591921  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.637594  9944 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:35.638242  9952 log.cc:927] Time spent T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 1.773s	user 0.001s	sys 0.003s
I20260709 12:26:35.636497  8295 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 2 to 3, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.643612  9695 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.646574 10048 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:35.646967  9016 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:35.633963  8472 rpcz_store.cc:269] 0709 12:26:33.536754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.536893 (+   139us) service_pool.cc:224] Handling call
0709 12:26:35.633274 (+2096381us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54000267d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:35.633506 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893950208}
I20260709 12:26:35.641535  8295 catalog_manager.cc:5697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.650178  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.650848  8394 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
W20260709 12:26:35.654369  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 78386us
I20260709 12:26:35.621618  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.600409 10042 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.636440  8389 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:35.688015  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.605419 10061 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:35.685534  9947 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.693962  9947 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:35.694288  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:35.694901  9043 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:35.696125  9947 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.576745  8538 rpcz_store.cc:276] 0709 12:26:34.367782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.369972 (+  2190us) service_pool.cc:224] Handling call
0709 12:26:34.945149 (+575177us) spinlock_profiling.cc:243] Waited 3.75 ms on lock 0x7b5800144098. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:34.945337 (+   188us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:34.945728 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.945758 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:34.946375 (+   617us) log.cc:844] Serialized 52 byte log entry
0709 12:26:35.104341 (+157966us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:35.135801 (+ 31460us) log.cc:844] Serialized 14 byte log entry
0709 12:26:35.199627 (+ 63826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.199706 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:35.504939 (+305233us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:35.509947 (+  5008us) raft_consensus.cc:1685] finished
0709 12:26:35.509978 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.510128 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60574,"prepare.queue_time_us":16215,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":72125,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"spinlock_wait_cycles":13183104,"thread_start_us":132725,"threads_started":1,"wal-append.queue_time_us":147832}
I20260709 12:26:35.686406  9689 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:35.699368  8470 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:35.704247 10022 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:35.705353  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 113525us
I20260709 12:26:35.706250 10022 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.706820 10022 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:26:35.708163 10020 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.842s	user 0.001s	sys 0.003s
I20260709 12:26:35.686616 10065 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:35.708374  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:35.654598  9771 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.648319  9701 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.701486  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.684638  8392 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:35.714887  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.715651  8392 raft_consensus.cc:2393] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:35.697705  9689 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.724560  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.726032  8392 raft_consensus.cc:2410] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:35.727228  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 862) took 1189 ms. Trace:
I20260709 12:26:35.727876  8389 raft_consensus.cc:1275] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:35.728252  8389 pending_rounds.cc:85] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 1
I20260709 12:26:35.732064  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:35.734547  8389 pending_rounds.cc:107] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:35.735023  8389 raft_consensus.cc:2889] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:35.742563  8396 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:35.743856  8392 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:35.745110  8392 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:35.727615  8543 rpcz_store.cc:276] 0709 12:26:34.537363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.596262 (+ 58899us) service_pool.cc:224] Handling call
0709 12:26:34.596552 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:34.604632 (+  8080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:34.604661 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:34.605280 (+   619us) log.cc:844] Serialized 52 byte log entry
0709 12:26:34.719165 (+113885us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:34.748210 (+ 29045us) log.cc:844] Serialized 14 byte log entry
0709 12:26:34.991751 (+243541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.991820 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:35.316078 (+324258us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b480015c3d8. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64692b2aa1 00007f64692a9b37 00007f64692a99ca 00007f64693a126f 00007f64693a0f37 00007f64693b555c 00007f64693b5508 00007f64693b5488 00007f64693b5443 00007f64693b46ec 00007f64682dea96
0709 12:26:35.707135 (+391057us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:35.727033 (+ 19898us) raft_consensus.cc:1685] finished
0709 12:26:35.727052 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:35.727170 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":465720,"prepare.queue_time_us":33612,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2016,"raft.queue_time_us":251189,"raft.run_cpu_time_us":5264,"raft.run_wall_time_us":713291,"spinlock_wait_cycles":12997248,"thread_start_us":113543,"threads_started":1,"wal-append.queue_time_us":155451}
I20260709 12:26:35.749836  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.750514  8389 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:35.752758  9771 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:35.753324 10050 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:35.754738  9944 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.754895  9488 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:35.755962  9488 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:35.756283  9488 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.717278 10065 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.757036  9488 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.758240  9488 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.758693 10065 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.716924  9800 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:35.749614 10014 consensus_queue.cc:1059] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:26:35.759915 10072 raft_consensus.cc:3055] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:35.760260 10072 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.761018 10072 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.762074 10072 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:35.763067 10078 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.732621  9977 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:35.763690 10078 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.763803  9977 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:35.765793 10070 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:35.709892 10022 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.781778  8512 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:35.787712  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.797411 10078 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.781625 10075 consensus_queue.cc:1059] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:26:35.798949 10075 raft_consensus.cc:3055] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:35.780097  9771 consensus_queue.cc:1059] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:35.794440 10065 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:35.760076 10061 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:35.804113  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.763149 10019 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.799846  9771 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:35.799292  9944 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.799269 10075 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.799865 10065 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.826066  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:35.832016  8394 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:35.834569  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:35.812433  9771 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:35.836779  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.825275 10065 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:35.826865 10075 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.840081 10075 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:35.835242  9977 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:35.841797 10003 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.842139 10019 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.849457  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 826) took 1724 ms. Trace:
I20260709 12:26:35.849860  8393 rpcz_store.cc:276] 0709 12:26:34.125056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.343500 (+218444us) service_pool.cc:224] Handling call
0709 12:26:35.849271 (+1505771us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b540029ccd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:35.849386 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718211328}
W20260709 12:26:35.842710 10043 log.cc:927] Time spent T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.748s	user 0.002s	sys 0.000s
I20260709 12:26:35.854669  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:35.856980  8393 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:35.857318  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:35.859827  9980 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:35.861348  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 214444us
I20260709 12:26:35.842839 10067 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.862865  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:35.863670  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 188828us
I20260709 12:26:35.824354 10022 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.869370  8393 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:35.882016  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:35.882784  8393 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:35.860837 10003 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.899150  8546 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:35.900315  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:35.902221  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:35.902901  8543 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:35.907593  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:35.908159  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.952354  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:35.954857  8544 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:35.959440  8543 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:35.963930 10084 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.910405 10047 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.906199  9762 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.955781  9843 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:35.969357  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 57557.7us
I20260709 12:26:35.864295  9771 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.902166 10063 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.905079 10003 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.964568  9689 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.971225 10083 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:35.985893  8545 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:35.971560  9843 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:35.969434 10047 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.971218  9762 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:35.990980  9843 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:35.997445 10063 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:35.987898 10083 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:35.969247 10084 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:35.993038 10047 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:35.998024  9762 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:36.007037  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 144241us
I20260709 12:26:36.004349 10083 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.016785  9016 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:36.018085 10093 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.018501 10093 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:36.018865 10093 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.019979  9016 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:26:36.096730  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 115818us
W20260709 12:26:36.043401  9982 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.023s	sys 0.012s
W20260709 12:26:36.101277  9982 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.023s	sys 0.012s
W20260709 12:26:36.108359  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.107440  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 78677.6us
I20260709 12:26:36.114606 10007 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.114933 10100 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:36.115638 10100 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:36.116163 10100 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.115805 10007 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.069032 10084 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.128679  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:36.130326 10061 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.131848 10061 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.142529  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:36.143668  9042 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:36.111223  9977 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:36.216341  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.043191 10083 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.230640  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:36.230609 10093 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.256489 10112 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:36.257390 10112 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.259757 10007 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.263168 10083 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.268143 10093 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.273554  9042 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:36.219187  9977 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.252125 10061 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.278921  9980 consensus_queue.cc:1059] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:36.280349  9976 raft_consensus.cc:3055] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:36.276631  9977 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:36.248874  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1066) took 1382 ms. Trace:
I20260709 12:26:36.285143  8390 rpcz_store.cc:276] 0709 12:26:34.864958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.865795 (+   837us) service_pool.cc:224] Handling call
0709 12:26:36.132314 (+1266519us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:36.246409 (+114095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21426432}
I20260709 12:26:36.287489  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.289335  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:36.290345  8390 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:36.274760 10003 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.297439 10007 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.298153 10007 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.299679  9762 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.300437  9762 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:36.301028  9488 consensus_meta.cc:287] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.542s	user 0.016s	sys 0.004s
I20260709 12:26:36.280862  9976 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:36.319196  9976 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.320922  9976 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.325304  9762 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:36.327379 10042 consensus_meta.cc:287] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.634s	user 0.014s	sys 0.000s
I20260709 12:26:36.361009  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:36.353978 10065 consensus_meta.cc:287] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.003s
I20260709 12:26:36.347481  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:36.404834  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 280209us
I20260709 12:26:36.340997 10112 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:36.404484 10003 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:36.362411 10038 log.cc:927] Time spent T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.288s	user 0.005s	sys 0.000s
I20260709 12:26:36.361434 10116 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:36.414474 10022 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:36.350888  9843 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.420974  8389 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:26:36.421563 10116 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:36.421599 10087 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.460s	user 0.002s	sys 0.000s
I20260709 12:26:36.343961 10042 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.429996 10116 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:36.430670  9048 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:36.432250  8467 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.434347 10042 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.436136  9981 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.436609  9843 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.436749  9981 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.437752 10100 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:36.439049  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 913553us
I20260709 12:26:36.440644  8511 leader_election.cc:400] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5.
I20260709 12:26:36.441004  8511 leader_election.cc:403] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:26:36.440322 10061 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:36.442217  9712 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5.
I20260709 12:26:36.442674  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.444370  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.445652  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.446975  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1095) took 2689 ms. Trace:
I20260709 12:26:36.427481 10007 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.442250  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:36.439759 10100 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.427493  9042 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:36.470562  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47416 (request call id 155) took 1838 ms. Trace:
I20260709 12:26:36.416532 10065 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:36.472765  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.442327  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:36.473382  8436 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:36.473963  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:36.474146  9048 rpcz_store.cc:276] 0709 12:26:34.630516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.631034 (+   518us) service_pool.cc:224] Handling call
0709 12:26:35.857149 (+1226115us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:36.211185 (+354036us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264e9c 00007f6461264a5b 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:36.220448 (+  9263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.431091 (+210643us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.468876 (+ 37785us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b540059f454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:36.469078 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512658688}
I20260709 12:26:36.476048  8389 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:36.471293  9712 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.477818  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:36.477674  9712 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.479086  8393 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:36.479660 10050 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.480086 10050 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.480443 10050 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.481096  9712 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.481705  8393 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:36.481767  9712 raft_consensus.cc:2764] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:26:36.447933 10003 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.483668  8511 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:36.484949 10042 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.485559 10042 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:36.487016 10042 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.467597  8468 rpcz_store.cc:276] 0709 12:26:33.756954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.767242 (+ 10288us) service_pool.cc:224] Handling call
0709 12:26:33.773003 (+  5761us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:33.773357 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:33.773385 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:34.902748 (+1129363us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b18003ecec0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646126a2a6 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6462c82a11 00007f6462c92372 00007f64643c4a01 00007f646438943a
0709 12:26:34.903634 (+   886us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b2c00010988. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6462c82a11 00007f6462c92372 00007f64643c4a01 00007f646438943a 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2
0709 12:26:34.919956 (+ 16322us) log.cc:844] Serialized 26 byte log entry
0709 12:26:35.021726 (+101770us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:35.021757 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:35.021818 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.361479 (+1339661us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:36.446438 (+ 84959us) raft_consensus.cc:1685] finished
0709 12:26:36.446480 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.446710 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1571,"raft.queue_time_us":1115,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":24679,"spinlock_wait_cycles":18901632,"thread_start_us":101291,"threads_started":1,"wal-append.queue_time_us":153338}
I20260709 12:26:36.490124  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:36.490537  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:36.491392  8389 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:36.480490  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:36.485109  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 68195us
W20260709 12:26:36.484959 10102 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:26:36.495702  9712 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.503504  8539 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:26:36.510352  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:36.511792  8541 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:36.512578  8389 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:36.527619  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:36.533063  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:36.537670 10007 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.538100 10007 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:36.538522 10007 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.540244 10065 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.542501  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.543318  8543 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:36.544622  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 61116.3us
I20260709 12:26:36.546844  8537 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.548583  8390 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:26:36.550148  8390 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:36.551071  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 72) took 1714 ms. Trace:
I20260709 12:26:36.551365  8465 rpcz_store.cc:276] 0709 12:26:34.836820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:34.847870 (+ 11050us) service_pool.cc:224] Handling call
0709 12:26:36.544280 (+1696410us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b58001c7198. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264eee 000000000036eb39 00007f64692d81e0 00007f64693a10c4 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:36.550435 (+  6155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.550755 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:36.550769 (+    14us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:36.550806 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:36.550821 (+    15us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.550853 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.550933 (+    80us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870656}
I20260709 12:26:36.550091  9981 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:36.564517  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.565783  8389 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:36.559762  8390 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:36.570588  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:36.571208  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:36.573287 10089 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:26:36.573788  9801 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:36.574215  9801 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.574625  9801 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.577644 10065 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:36.581178  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:36.581406  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:36.583257  8463 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:36.583739  8466 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:36.586407  8362 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:36.587683  8544 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:36.588721  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.589324  8544 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.590337 10100 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.590819 10100 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.591182 10100 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.574540  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:36.598582  9048 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:36.562911 10042 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:36.606630  9988 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:36.609282  9988 raft_consensus.cc:697] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:36.610402  9988 consensus_queue.cc:237] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.611107 10122 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.611881 10122 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:36.613430 10121 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:36.614338 10042 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.614725 10119 consensus_queue.cc:1059] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:36.615533 10119 consensus_queue.cc:1243] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:26:36.616074 10119 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.616592 10042 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.616451 10100 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.614274 10121 consensus_queue.cc:1243] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:26:36.619166  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 52752.3us
I20260709 12:26:36.619292  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.619900  8392 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.620422  8436 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:36.620899  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:36.622205  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:36.622884  8390 raft_consensus.cc:2376] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4. Re-sending same reply.
I20260709 12:26:36.623307  9879 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.623931  9879 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.624387  9574 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:36.623838  9769 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:36.616403 10119 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:36.625037 10042 raft_consensus.cc:1064] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
W20260709 12:26:36.626184 10042 raft_consensus.cc:1068] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Unable to promote non-voter e3660d999c0a41658a1f1dbe7cc90746: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:36.605362  9712 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:36.627136  9712 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:36.628295  8388 raft_consensus.cc:3055] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:36.628844  8388 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:36.629772  8388 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.630957  8388 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.626276 10119 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.632858 10119 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.632581 10007 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.633144  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:36.628257  9712 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.634429 10042 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:36.635051 10007 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:36.635349  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 838) took 1158 ms. Trace:
I20260709 12:26:36.635756  8395 rpcz_store.cc:276] 0709 12:26:35.477022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.477187 (+   165us) service_pool.cc:224] Handling call
0709 12:26:35.477554 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.574559 (+ 97005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.634817 (+1060258us) spinlock_profiling.cc:243] Waited 87.8 ms on lock 0x7b5400165b54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:36.635162 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":201861504}
I20260709 12:26:36.636674  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:36.637032 10042 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:36.637519 10042 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.637859 10042 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:36.637984 10088 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.668s	user 0.000s	sys 0.001s
I20260709 12:26:36.638672  9769 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:36.639811  9769 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:36.640226  9769 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:36.641922  8544 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
W20260709 12:26:36.640012  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 65677.7us
I20260709 12:26:36.605646 10050 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.654539  9048 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:36.641631  9712 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.642400 10065 raft_consensus.cc:2764] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:36.664244  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.665308  8546 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:36.666143  9042 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
W20260709 12:26:36.658514  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 82) took 2901 ms (client timeout 1969 ms). Trace:
I20260709 12:26:36.669816  8546 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:36.658607  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:36.659510  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 885) took 1120 ms. Trace:
I20260709 12:26:36.659782 10100 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.659226  8392 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:36.660600 10062 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:36.669358  9044 rpcz_store.cc:269] 0709 12:26:33.747183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.749667 (+  2484us) service_pool.cc:224] Handling call
0709 12:26:36.647001 (+2897334us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400612e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:36.648310 (+  1309us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2943153536}
I20260709 12:26:36.673487 10062 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.662940  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.662654  9801 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.663439 10048 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:26:36.663616  8436 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:36.626271  9879 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.672762  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:36.670554  8545 rpcz_store.cc:276] 0709 12:26:35.527346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.527506 (+   160us) service_pool.cc:224] Handling call
0709 12:26:35.527819 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:35.987593 (+459774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.646936 (+659343us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54001f3954. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:36.647229 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053068032}
I20260709 12:26:36.677827  8541 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:36.678202 10075 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.680886 10075 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:36.678499  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:36.681777  9574 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:36.682197  9574 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.682534  9574 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.683102 10046 consensus_queue.cc:1059] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:36.683921 10046 consensus_queue.cc:1243] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer e3660d999c0a41658a1f1dbe7cc90746 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:36.684388 10046 raft_consensus.cc:3055] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:36.684703 10046 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:36.685649 10046 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.686125 10075 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.675719 10007 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:36.687251 10007 raft_consensus.cc:697] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:36.692152 10007 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.689076 10062 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.681141  9843 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:36.695385  8511 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:36.686846 10046 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.643977  9769 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.700555  9843 raft_consensus.cc:697] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:36.711055 10062 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.729144  9801 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:36.729825  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 52754us
I20260709 12:26:36.732932 10062 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.744504 10032 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:36.744807  9479 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:26:36.746845 10110 log.cc:927] Time spent T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.486s	user 0.003s	sys 0.000s
W20260709 12:26:36.748270 10099 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.571s	user 0.002s	sys 0.000s
I20260709 12:26:36.749712  9980 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.751341  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.751508  9801 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:26:36.751976  8545 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:36.752074  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.750272  9980 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.752776  8541 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:36.753381  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.754112  8544 raft_consensus.cc:2368] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:36.754189  9980 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.742385 10062 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.756276 10042 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.758225  8388 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
W20260709 12:26:36.758955 10016 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:26:36.758236 10042 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:36.759560  8388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 830) took 1633 ms (client timeout 1582 ms). Trace:
W20260709 12:26:36.760377  8388 rpcz_store.cc:269] 0709 12:26:35.125770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.136280 (+ 10510us) service_pool.cc:224] Handling call
0709 12:26:36.627971 (+1491691us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b540027c020. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464300dc0 00007f646438ce18 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6
0709 12:26:36.759446 (+131475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13463296}
I20260709 12:26:36.761211 10050 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:36.762068  9843 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:36.762847 10134 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:26:36.746872  9976 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:36.750397  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 886) took 1222 ms. Trace:
I20260709 12:26:36.753634  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.761965  9771 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.739032  9769 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.780469  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.765797  8542 rpcz_store.cc:276] 0709 12:26:35.527681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.528469 (+   788us) service_pool.cc:224] Handling call
0709 12:26:35.528722 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:35.617906 (+ 89184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:35.617942 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:35.655109 (+ 37167us) log.cc:844] Serialized 26 byte log entry
0709 12:26:35.888109 (+233000us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:36.496728 (+608619us) log.cc:844] Serialized 14 byte log entry
0709 12:26:36.507139 (+ 10411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.749882 (+242743us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54000398d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:36.749925 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:36.749990 (+    65us) raft_consensus.cc:1685] finished
0709 12:26:36.750089 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:36.750228 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":558910,"prepare.queue_time_us":559224,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":25669,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":6411,"spinlock_wait_cycles":178395904,"thread_start_us":240985,"threads_started":2,"wal-append.queue_time_us":288303}
W20260709 12:26:36.796536  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 53002.5us
I20260709 12:26:36.771574  9976 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:36.799124  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.799321  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.804095  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:36.804395 10050 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:36.805557 10108 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.806262 10072 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:36.806108 10108 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:36.804745  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.808305 10042 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:36.808702 10042 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:36.806700 10072 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:36.809139  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.809594 10072 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.810395  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.809513 10042 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:36.812446 10042 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:36.814859  9050 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:36.817900  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1303) took 1324 ms. Trace:
I20260709 12:26:36.818259  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:36.818464  9712 consensus_queue.cc:1059] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:36.792352 10032 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.806556  9976 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:36.819553  9980 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:36.820343  9980 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:36.821254  9980 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:36.822225  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:36.822417  9980 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.822090 10072 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.818282  8467 rpcz_store.cc:276] 0709 12:26:35.493037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:35.634386 (+141349us) service_pool.cc:224] Handling call
0709 12:26:35.634682 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:36.433387 (+798705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:36.817655 (+384268us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54000780d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:36.817833 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833320832}
I20260709 12:26:36.830663  8545 raft_consensus.cc:2410] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:36.831553  9950 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:36.832094  9044 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:36.832667  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.833314  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:36.833751  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.833969 10108 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.834901  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.836414  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.838704  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.839242  8541 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:36.840140  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.801249  9574 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.826864 10032 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.844326  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.847733  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.851998  8544 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:36.854074  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.855171  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.857282  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.841004  9976 consensus_queue.cc:1059] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:26:36.861516  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.865433  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.866163  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:36.867321  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 103540us
W20260709 12:26:36.869441  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:36.870275  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.869988  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.871747  8545 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
W20260709 12:26:36.875649  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.862958  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:36.876415  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.877604  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:36.880976 10003 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:36.883248  8361 leader_election.cc:336] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.765s (SENT)
I20260709 12:26:36.883453  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:36.884006 10034 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.884120  8546 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:36.884624 10034 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.885877 10062 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.886183 10122 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.886637 10034 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.890424 10072 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:36.891428  8544 raft_consensus.cc:2393] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:36.896206  8543 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.896642  8542 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:36.925014  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.932762  8541 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:36.895968  9042 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:36.875788 10065 raft_consensus.cc:3055] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:26:36.964274 10140 log.cc:927] Time spent T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:26:36.985293  8466 raft_consensus.cc:2410] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:36.964355 10144 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:36.967387 10065 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:37.011389 10065 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.009791 10144 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:36.983376  9771 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.018600  8542 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:37.032442  8543 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:37.038148  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.038915  8544 raft_consensus.cc:2368] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:37.039696  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.045658 10046 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:37.046290 10046 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.046686 10144 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.035516  9771 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.050400  9771 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.051102  9043 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.051730 10046 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.051793  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:37.052449  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 45226.6us
I20260709 12:26:37.052654  8466 raft_consensus.cc:2410] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:37.053046 10029 raft_consensus.cc:3055] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:37.053579 10029 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.053830  8538 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.054423 10029 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.055476 10029 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.061440  9701 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:37.056852 10046 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:26:37.054010  9042 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:37.067831 10011 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.068414 10011 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:37.069602 10136 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.265s	user 0.002s	sys 0.000s
I20260709 12:26:37.070513 10011 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.068423 10062 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:37.071866  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:37.073295  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:37.073398  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.074003  8537 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.074769  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.076185  8546 raft_consensus.cc:2410] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:37.076072  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.076700  9479 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.076992  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.077273  9479 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.077456  8545 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:37.078150  9479 raft_consensus.cc:697] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.080054  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.078994  9479 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.081405  8541 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:26:37.081987  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.055099  8538 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.084290  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:37.087304  8546 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:37.089242  8546 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.090242  8545 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.033918 10065 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:37.092514 10049 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.430s	user 0.011s	sys 0.000s
I20260709 12:26:37.095656  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.094336  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:37.096179  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 217556us
I20260709 12:26:37.097704 10075 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:37.098232 10075 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.099119 10075 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.102191  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.102864  8540 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.104733  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.104735  8512 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:37.108199 10062 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.108556 10062 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:37.108865  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.110332  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:37.112298  8537 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:37.113054  8543 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:37.114164  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:37.108490 10146 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.228s	user 0.002s	sys 0.000s
I20260709 12:26:37.115904 10072 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.108974 10062 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:37.109791 10049 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.650s	user 0.012s	sys 0.000s
W20260709 12:26:37.118784  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.119583  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.109432 10148 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:37.116299 10072 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.132073  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.133083  8545 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:37.134481  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:37.133409 10072 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.120936  9574 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.115288 10022 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:26:37.120762 10049 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.133710 10148 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.150100  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.133302 10046 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:37.155221  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.155932  8545 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:37.160019  9712 consensus_queue.cc:1059] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:37.160872  9712 raft_consensus.cc:3055] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:37.161170  9712 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:37.165896 10049 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.172472 10052 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.181795  8540 raft_consensus.cc:2410] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:37.184389  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.198398  8542 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:37.188165  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.203029  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.205076  8512 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:37.216346  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.219853  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.220721  8466 raft_consensus.cc:2410] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:37.200919  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.224057  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.224637  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.225142  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.225234  8538 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:37.226153  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.226702  8541 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:37.218516  9976 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:37.227674  9976 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:37.228058  9976 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.217658  9980 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.231659  9980 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:37.232378  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.233701  9980 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:37.223088  9701 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.236625  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.237484  8466 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:26:37.238070  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.238272  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.238899  8469 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:37.205826 10042 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:37.239709  8465 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.239938  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:37.240696  8467 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:37.239739 10042 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.241497  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:37.242389 10042 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:37.243901  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:37.238703 10048 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:37.245370  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.244225  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.242867 10072 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.248843  8541 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:26:37.247335 10048 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.252837  8544 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.239966 10148 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.226202  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:37.252921  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 100699us
I20260709 12:26:37.234985 10062 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.259987  8472 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:26:37.280882  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:37.259358  8546 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.277458  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.281418  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.273088  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.276530  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.285146  8541 pending_rounds.cc:85] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 2
I20260709 12:26:37.305256  8468 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:37.283972  8545 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:37.276561  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.278110  8542 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:37.313038  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.320801  8544 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.324126  8466 raft_consensus.cc:2393] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:37.324004  8470 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:37.319063  8541 pending_rounds.cc:107] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:26:37.329501  8541 raft_consensus.cc:2889] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:37.330709  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:37.331176  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50392.7us
I20260709 12:26:37.331816  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.331810 10100 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.332773 10100 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:37.333021  8392 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:26:37.333421  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:37.334187  8463 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:26:37.279654  9712 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.335736  9712 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.336699  8393 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:37.338059  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.338595  8539 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.339567  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.340230  8393 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:37.340946  8539 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.334084  8389 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.335986  8361 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.343984  8544 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:37.312077  9701 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.342455  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:37.359586  8543 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:26:37.265041  9980 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:26:37.361989  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:37.370167  8396 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.329046 10065 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.372247  8463 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:37.374081  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:37.374384  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:37.375057  8436 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:37.376765  8397 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.369740 10016 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.378487 10100 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.376714  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.383190  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:37.326895  9976 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.385005  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.386262  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.386905  8393 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:37.381841  8470 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:37.367219  9988 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:37.388665  8537 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.371670 10075 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.398541  9014 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.406837  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.407474  8393 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:37.413372  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:37.396098  9950 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:37.380936  9843 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:26:37.401278  9574 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.402231 10072 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:37.432693  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 96795.7us
I20260709 12:26:37.379514 10065 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.371901  9701 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.441864  8392 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.442268  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.444653  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.445286  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.439633  9479 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:26:37.432626 10016 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:37.447625  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.450107 10145 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 12:26:37.451143 10145 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:37.451478 10145 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.452297 10145 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.453336 10145 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:37.454056  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.444334 10011 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:26:37.455124 10122 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.455706 10122 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.456298  8389 raft_consensus.cc:3055] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:37.456640  8389 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:37.457715 10122 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.437520  9988 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.457422  8389 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.459900  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:37.465538  8389 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:37.447543 10157 log.cc:927] Time spent T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.223s	user 0.003s	sys 0.000s
I20260709 12:26:37.435098  9574 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.478825  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.431181 10075 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.467584 10042 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:37.467764 10073 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:26:37.490878 10065 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:37.468032  9988 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.469074  8438 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.469573 10029 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:37.472064  8397 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:37.472916  8395 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.481026  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:37.494441  8543 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.483983  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.484310  8396 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
W20260709 12:26:37.438575  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 173203us
I20260709 12:26:37.495144  8392 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:37.487447  9701 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.438699  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.498201  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.498720  8438 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.493280  8397 pending_rounds.cc:85] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 1
I20260709 12:26:37.502338  8397 pending_rounds.cc:107] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:37.502592  8397 raft_consensus.cc:2889] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:37.497171  9479 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:26:37.482426  9574 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.506327  8466 raft_consensus.cc:2368] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5.
I20260709 12:26:37.503476  9988 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.414808 10048 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.447456 10016 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.494565 10122 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:26:37.524160  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.583616  8543 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:37.510461 10062 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:37.593258  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.594146  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.594759  8463 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:37.510147  9771 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:26:37.511904 10144 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.084s
I20260709 12:26:37.609963  8470 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:37.522364 10073 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:26:37.589795 10011 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:37.619788  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.622774  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:37.622000  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 222394us
I20260709 12:26:37.627303  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.620906  9883 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:37.605183 10122 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.612092  9950 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:37.619112  9843 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.611363 10029 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:26:37.628304 10024 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.655030  9883 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:37.634169  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 174330us
I20260709 12:26:37.633140 10011 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.660977  9988 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.669866  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.667315  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:37.615458 10075 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.676965  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.634922  8391 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:37.689433  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.700030  8396 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:37.704102  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.704375  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:37.707194  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:37.703732  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.707916  8468 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:37.677860  9883 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:37.710145  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:37.711138  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:37.713176  8470 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:37.714229  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:37.714829  8391 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:37.716068 10011 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:37.716851  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:37.706753 10167 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:37.717846  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.718962 10170 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:37.719780  8392 raft_consensus.cc:2393] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:37.720002  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.722119  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.722502  8511 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:37.722994  8397 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.721392  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.723985  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:37.724658 10170 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.725548  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:37.726076  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:26:37.726507  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.727151  9980 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.728406  9980 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.717804 10167 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:37.729584 10170 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:37.730065 10170 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:37.730490 10170 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:37.732378  8468 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:37.734215  9976 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:37.735338  9843 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:37.716919  8391 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:37.729482  9980 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.739475  9988 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.741183  8393 raft_consensus.cc:2368] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5.
W20260709 12:26:37.745990  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.761713  8389 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:26:37.762264  8389 pending_rounds.cc:85] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 1
I20260709 12:26:37.762593  8389 pending_rounds.cc:107] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:26:37.763392  8389 raft_consensus.cc:2889] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:37.796744  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.797596  8397 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:26:37.798084  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.730579 10167 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.798650 10122 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.796710 10016 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:37.799685 10165 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:26:37.737915 10170 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.800349  9701 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:37.814020  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 232825us
W20260709 12:26:37.799214  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 73257.1us
I20260709 12:26:37.795974  8362 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:37.881079  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:37.884202  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:37.888531  8472 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:37.890666  8392 raft_consensus.cc:1240] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:37.890880  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 94973.4us
I20260709 12:26:37.892333  8362 leader_election.cc:400] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5.
I20260709 12:26:37.892658  8362 leader_election.cc:403] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:37.894253  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:37.804193  9950 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.896512  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:37.902320  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:37.911870  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:37.897145 10016 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:37.897845  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:37.899899 10174 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:37.902045 10011 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:37.924841  8466 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:37.896775  9701 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.931125 10011 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.932678 10073 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:37.931833  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:37.520169 10049 consensus_queue.cc:1175] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aef8c9f023564378a04e3e1e6171930d" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:37.935747  9701 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:37.936462  9701 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:37.936834  9048 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:37.937278  9701 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:37.938484  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:37.940659  9574 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.942605  9574 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.943543 10170 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:37.945128  8539 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:37.942559  8542 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:37.943743  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:37.921157 10182 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.926149 10122 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:26:37.947778 10176 log.cc:927] Time spent T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:26:37.948479 10052 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.951328  8538 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:26:37.951685 10172 log.cc:927] Time spent T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:26:37.952658  9988 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:37.947607  9479 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:26:37.956879 10175 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 12:26:37.954905 10122 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:37.971805 10122 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:37.972141 10180 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:26:37.974946 10184 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:26:37.958153 10182 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:37.977087 10182 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:37.966877 10052 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.968097  9479 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:37.978154  9479 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:37.979001 10052 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:37.983246  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 86809us
W20260709 12:26:37.925544  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 200060us
W20260709 12:26:38.043790  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 59190.1us
I20260709 12:26:38.056317  8512 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:38.071424  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 75070us
I20260709 12:26:38.072304  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.077560  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.086166  8512 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:38.088636  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.089433  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.089499  8438 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.090520  8469 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:38.083670  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.092622  8512 leader_election.cc:400] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5.
I20260709 12:26:38.092942  8512 leader_election.cc:403] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:26:38.094230  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.093843  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.107836  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.114933  8469 raft_consensus.cc:2410] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:38.090816  9976 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.125219  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:38.093727 10042 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.129266  8542 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:38.126202  8396 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.082866 10191 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:38.095669  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:38.088420 10016 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:26:38.133723  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 138688us
I20260709 12:26:37.962873 10011 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.141819  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:38.115521  9988 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:38.125204 10144 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:38.128238  9701 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.111685 10145 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:26:38.124910  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:38.154795  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 257609us
I20260709 12:26:38.160477  8361 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.112056  9879 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:26:38.099809 10061 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:26:38.128336 10170 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.133476 10191 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.125068 10195 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.137903 10182 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.101094 10194 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:26:38.168102 10046 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:38.146216 10062 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:38.172746  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.155395 10144 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:38.180512  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:38.185111  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 97112.7us
I20260709 12:26:38.139920 10075 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:26:38.186519  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62539.8us
I20260709 12:26:38.163239  9988 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.193171  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.193820 10016 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:38.195144 10016 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.195521 10016 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.195755  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.195917  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.156836  9883 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.182857  9950 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:38.200431  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 105124us
I20260709 12:26:38.201611  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.188328 10144 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.196446  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:38.207499  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.181847 10191 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.186230 10046 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:26:38.215503  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 66726.9us
I20260709 12:26:38.215873  8396 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:38.219834  8465 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:38.221509  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:38.163775  9701 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:38.225263  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.196485  8390 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:38.208101 10174 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5.
I20260709 12:26:38.186208 10170 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.259876 10046 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:38.264127  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 47259.4us
I20260709 12:26:38.277940  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:38.260079  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:38.257711 10201 log.cc:927] Time spent T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 12:26:38.223562 10164 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5.
I20260709 12:26:38.196779  9948 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.168s
I20260709 12:26:38.206570  9841 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.162s
W20260709 12:26:38.274592  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.206984 10042 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:26:38.216951  9950 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.196853 10195 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.316238 10045 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:38.314674 10198 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:26:38.223105 10122 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:38.334547  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 138697us
I20260709 12:26:38.276100 10189 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:26:38.337517  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 59668.5us
I20260709 12:26:38.304633  9948 consensus_queue.cc:1243] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:26:38.359109  8361 leader_election.cc:400] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4.
I20260709 12:26:38.257848 10196 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:38.361150  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.332324 10046 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.332295 10174 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.331924 10061 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:38.349776 10189 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:38.333026 10145 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 12:26:38.448606  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 108509us
I20260709 12:26:38.449519  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.361816 10164 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:26:38.374581 10061 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:38.386970 10189 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:38.471262  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 120830us
I20260709 12:26:38.478060  9701 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.492015  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:38.492764  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.445807 10210 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.466779  9843 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.468101 10061 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:38.473220 10192 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:26:38.499691  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 199051us
W20260709 12:26:38.498288  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48869.1us
I20260709 12:26:38.496479  9988 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:38.502007 10192 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:38.523391  8511 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:38.528821 10161 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.008s	user 0.008s	sys 0.002s
I20260709 12:26:38.529862  8361 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.531481 10194 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:26:38.532249 10213 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:26:38.532809  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.533188 10016 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.533587 10209 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:38.509002 10207 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:26:38.520298 10186 log.cc:927] Time spent T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.570s	user 0.007s	sys 0.017s
I20260709 12:26:38.535435 10210 consensus_queue.cc:1059] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:38.536293 10207 raft_consensus.cc:3055] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:38.536614 10207 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:38.537441 10207 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.536804 10061 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.538986  8511 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:38.545908  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.501366  9843 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.558912  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.566711 10225 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:38.566987 10220 log.cc:927] Time spent T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:26:38.567337 10225 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.568193 10048 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.568619  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.569581 10225 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:38.511183 10173 consensus_queue.cc:1059] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:26:38.570528 10164 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:26:38.572960 10218 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:38.560062 10207 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:38.581000 10197 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:26:38.562423 10122 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:38.583968 10193 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:38.560201 10209 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:38.545075 10194 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:26:38.588621 10016 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.590583 10065 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.591084 10065 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.576843 10166 raft_consensus.cc:3055] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:38.592020 10166 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:38.592759 10062 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.593281 10062 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.592841 10166 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.594116 10166 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:38.594835  9843 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:38.573575 10216 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:26:38.599759  9950 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:38.601756  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1315) took 1091 ms. Trace:
I20260709 12:26:38.602114  8466 rpcz_store.cc:276] 0709 12:26:37.510601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.510847 (+   246us) service_pool.cc:224] Handling call
0709 12:26:37.511148 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:37.925222 (+414074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.601548 (+676326us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000258d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:38.601705 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":951025920}
I20260709 12:26:38.575444 10195 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.593295 10065 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:38.610019 10061 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:38.610687  9976 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:38.611270 10211 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.611363  8538 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.611829 10211 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:38.580538  8511 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:38.573550 10144 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.617515  8392 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:38.617336 10042 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.617928 10144 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.618489  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.619119  8392 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:38.587929 10209 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:38.560181 10170 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.628882  8393 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:38.563023  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:38.629653  8391 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.640024  8511 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.656527 10075 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.657066 10075 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.659955  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.661182  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:38.661728  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.662353  8471 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:38.662552 10170 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.663038  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.663687  8464 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:38.665117  8391 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:38.661868 10016 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.662246  8361 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.667847 10193 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:38.668208 10193 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.668531 10193 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.670375 10194 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:38.671653 10122 raft_consensus.cc:3055] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:38.672808  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:38.673394  8545 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:38.671986  8392 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:38.674810  9015 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:38.676609  8538 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:38.617349  9976 raft_consensus.cc:2764] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:38.683996  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.689407  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:38.706554  8470 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:26:38.705969  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.708848  8463 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:38.672019 10122 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:38.711361  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.712658  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:38.717154  9048 raft_consensus.cc:2410] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:38.679334  8511 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:38.714507  8438 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:38.715874  8392 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:38.718281  8438 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.734910  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:38.659034 10075 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:38.679668 10061 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:38.658941 10191 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:38.746013  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 66760.7us
I20260709 12:26:38.693454  8436 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:38.747764  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:38.755124  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:38.689579 10167 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:38.688488 10042 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.692126  9988 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:38.705901 10196 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.760581  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:38.745328 10100 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:38.767302  8543 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:38.755160  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.752882 10052 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.751684  9976 raft_consensus.cc:2764] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:26:38.749699  9574 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:38.711104 10174 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 12:26:38.772579  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.759073 10167 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:38.775338  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 81976.1us
I20260709 12:26:38.776510  8361 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.778287  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:38.781664  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:38.750566  9701 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:26:38.783886  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:38.787201  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.787984  8391 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:38.795920  8361 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.798189  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.770962 10224 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.810730  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.773559 10210 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.764214 10042 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.779533  9980 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.820585  8391 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:38.831312  8391 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.783512  9769 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:38.781718 10167 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:38.768858  9988 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.786583  9574 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:38.805506 10173 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:26:38.838348  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 93046.8us
I20260709 12:26:38.839344  8362 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:38.779598 10222 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:26:38.827463 10211 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.836367  9769 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:38.847577 10219 log.cc:927] Time spent T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.328s	user 0.001s	sys 0.004s
I20260709 12:26:38.847510 10062 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.848443 10174 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:38.832053 10210 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.872548 10210 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:38.849659 10227 log.cc:927] Time spent T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:26:38.850324  9988 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.850168 10245 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:38.850688  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:38.851456  9574 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.827116  9701 consensus_queue.cc:1243] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:26:38.826720 10065 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.880465 10241 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:38.896922 10241 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.897289 10241 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:38.902555  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:38.903172  8395 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.905380  8390 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:38.906659  8390 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:38.868769 10222 consensus_queue.cc:1243] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:26:38.859664 10228 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.860909  8468 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:38.841871 10173 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.862756 10189 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.863138  8394 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:38.835348  9976 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:38.868033  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 72229.5us
I20260709 12:26:38.866330  9769 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:38.870031  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.870195 10191 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:38.866446  9980 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.870746 10244 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.769248 10209 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.875180  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:38.865177 10164 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:38.879902  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.882254  8391 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:38.926450 10022 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.931305 10022 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.933396 10022 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.935285 10164 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:38.937327 10164 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:38.939584 10189 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:38.927556  9980 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:38.941068 10234 log.cc:927] Time spent T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:26:38.941821  9980 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:38.930877 10244 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.926559 10228 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:38.944380 10244 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:38.949298  9883 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:38.950011 10235 log.cc:927] Time spent T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:26:38.924052 10065 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:38.952740  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:38.950048 10221 log.cc:927] Time spent T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.430s	user 0.001s	sys 0.002s
I20260709 12:26:38.855324  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:26:38.910147  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 190649us
I20260709 12:26:38.873395 10224 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:38.917549  8471 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:38.918485  8361 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.926983  9050 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:38.955399  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:38.954313  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:38.959693  8395 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:38.960247  8362 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:38.960707  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:38.961409  8395 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:38.945677 10228 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:39.000980  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 82573.5us
I20260709 12:26:39.000183  8512 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:38.951071 10065 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.019490  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:39.020442  8395 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:38.939783  8388 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:38.947167 10164 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.021986  8438 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:38.939500  9976 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
I20260709 12:26:39.023756  8546 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:38.959203 10100 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.026587  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:38.987239  9883 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.018263  9701 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.128374  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:39.024118 10210 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:39.032094 10144 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.116s
I20260709 12:26:39.083120 10048 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:39.150394 10224 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.029289  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:39.148177 10246 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:26:39.031919 10100 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.182816  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.131516  9976 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:39.187743 10046 consensus_meta.cc:287] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.812s	user 0.007s	sys 0.003s
I20260709 12:26:39.192111 10167 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:39.193023 10062 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:39.195530 10065 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:39.032229 10164 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:39.241124  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 432337us
I20260709 12:26:39.336856  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:39.185436 10248 log.cc:927] Time spent T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:26:39.237370 10166 consensus_meta.cc:287] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.643s	user 0.005s	sys 0.005s
I20260709 12:26:39.314107 10210 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:26:39.296625 10193 consensus_meta.cc:287] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.628s	user 0.008s	sys 0.001s
I20260709 12:26:39.339653 10193 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:39.339845 10210 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.341883 10193 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.015861 10244 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:39.343771 10244 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:39.344201 10244 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:39.345705  9769 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.347007 10207 raft_consensus.cc:3055] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:39.347362 10207 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:39.347671  9769 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.347990 10217 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.348449 10217 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.350478 10217 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.350997 10048 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:39.347582  8389 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.351908 10048 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.357336 10164 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:39.243381 10241 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:39.360280 10241 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:39.312867  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 280676us
I20260709 12:26:39.315582 10148 consensus_queue.cc:1059] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:26:39.316530  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.320545 10042 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:39.337821  8546 raft_consensus.cc:2410] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:39.363747  8546 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:39.365960 10167 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:39.366607  9044 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.367600  9883 raft_consensus.cc:3055] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:39.367971  9883 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:39.326340  9976 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:39.368737  9883 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.369849  9883 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.370153  9976 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:39.371987 10180 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:39.372514  8390 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:39.374943  9048 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:39.379297  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.382273  8471 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:39.365908  8541 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:39.384697  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.374186  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:39.386140  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.389073  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.393508  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.394040  8541 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.394405  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:39.395430  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.396098  8469 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:39.396917  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.397598  8469 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:39.386293 10244 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.400255 10244 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.400830 10180 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:39.404901  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.411913  8541 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:39.415117  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.422888  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.386487  9976 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:39.315866 10224 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.406559 10241 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:39.401216 10180 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.426277  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.430426  8542 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:26:39.433266 10254 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:26:39.433554  8510 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:39.434443 10065 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:39.436594  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:39.437428  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.439903  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.434757 10192 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.415176  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:39.444170  8511 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:39.406991 10217 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:26:39.446782 10261 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:39.446949  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.448014  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:39.449257  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.449489  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.430265 10180 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.451545  8544 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:39.451563  8542 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:39.452266  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:39.443523 10196 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:39.456387  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.445431 10244 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.455850 10065 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:39.453074 10100 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:39.449188 10167 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.447772  9712 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.463169  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.432199 10241 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.455096  9980 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:39.507217 10167 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:39.508041 10244 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.507427  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.511927 10171 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:26:39.439033  9976 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.454878 10192 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.563644  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.564416  8544 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:39.436134 10207 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.570696  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.572054  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:39.571257  8539 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.579815  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.581243  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.533924 10196 raft_consensus.cc:697] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:39.535349  9980 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:39.584707  8542 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:39.588174  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.584359  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.588843  8544 raft_consensus.cc:2376] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3. Re-sending same reply.
I20260709 12:26:39.584616  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.562291 10224 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.592535  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.593250  8541 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:39.591773  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.557734  9843 consensus_queue.cc:1059] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:26:39.589990  9980 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.609082  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.611130  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:39.607434  8438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.777s (SENT) [suppressed 17 similar messages]
I20260709 12:26:39.614696  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.583767  9712 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:39.565928  9950 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:26:39.569927 10244 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.637775  8541 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:39.645742  8546 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:39.659654  8541 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:39.630079  9712 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:39.672328  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.673507 10215 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:39.674081 10215 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.676110 10215 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:39.678960  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 220718us
I20260709 12:26:39.682065  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 985) took 1044 ms. Trace:
I20260709 12:26:39.682451  8543 rpcz_store.cc:276] 0709 12:26:38.637341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.637444 (+   103us) service_pool.cc:224] Handling call
0709 12:26:38.637743 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.767748 (+130005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.681829 (+914081us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400388454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:39.682008 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297416960}
I20260709 12:26:39.684073  8543 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:39.685204  8543 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:26:39.686080  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.686201  8543 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.688222  8543 raft_consensus.cc:1240] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:39.689312  8543 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:39.690569  8543 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:26:39.692767  8543 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:26:39.694133  8468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 1331) took 1600 ms (client timeout 2078 ms). Trace:
W20260709 12:26:39.694514  8468 rpcz_store.cc:269] 0709 12:26:38.059202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.059314 (+   112us) service_pool.cc:224] Handling call
0709 12:26:39.659704 (+1600390us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b5400025dd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:39.659804 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1772640128}
W20260709 12:26:39.696208  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 126863us
I20260709 12:26:39.699059  8546 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:39.692710 10173 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:39.695745 10259 log.cc:927] Time spent T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:26:39.698706 10223 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 1.142s	user 0.013s	sys 0.011s
W20260709 12:26:39.706718  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 99323.3us
W20260709 12:26:39.709856  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 246178us
W20260709 12:26:39.706386 10214 log.cc:927] Time spent T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 1.038s	user 0.010s	sys 0.007s
I20260709 12:26:39.716980  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:39.720079  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.722673 10272 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.660030 10196 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:39.744211  8436 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:39.717545 10271 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:39.725608  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 907) took 1607 ms. Trace:
W20260709 12:26:39.727384 10262 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:26:39.712474 10167 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.729864 10269 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:39.735538 10215 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:39.760254 10122 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.760728 10215 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.761360 10122 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.762859 10215 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.735971 10224 consensus_queue.cc:1059] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:26:39.737324  8393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 904) took 1620 ms (client timeout 1777 ms). Trace:
I20260709 12:26:39.739818  8395 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:26:39.763681  8393 rpcz_store.cc:269] 0709 12:26:38.117232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.124743 (+  7511us) service_pool.cc:224] Handling call
0709 12:26:39.737163 (+1612420us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400288554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:39.737270 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365043584}
I20260709 12:26:39.714023 10241 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.742595 10042 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:39.743006  9976 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:39.741065  9712 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:39.741336  9047 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:39.747831  8396 rpcz_store.cc:276] 0709 12:26:38.118022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.255522 (+137500us) service_pool.cc:224] Handling call
0709 12:26:38.256049 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.256499 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.256535 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:38.270916 (+ 14381us) log.cc:844] Serialized 26 byte log entry
0709 12:26:38.360283 (+ 89367us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:38.705076 (+344793us) log.cc:844] Serialized 14 byte log entry
0709 12:26:38.705362 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:38.705427 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.658485 (+953058us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:39.669022 (+ 10537us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b48002a0258. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64692b2aa1 00007f64692a9b37 00007f64692a99ca 00007f64693a126f 00007f64693a0f37 00007f64693b555c 00007f64693b5508 00007f64693b5488 00007f64693b5443 00007f64693b46ec 00007f64682dea96
0709 12:26:39.725418 (+ 56396us) raft_consensus.cc:1685] finished
0709 12:26:39.725439 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.725556 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11838,"prepare.queue_time_us":128282,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":8528,"raft.queue_time_us":115369,"raft.run_cpu_time_us":9566,"raft.run_wall_time_us":1335450,"spinlock_wait_cycles":56680064,"thread_start_us":374786,"threads_started":2,"wal-append.queue_time_us":213959}
I20260709 12:26:39.789983  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.729984 10244 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.746757 10271 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:39.792622  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.794442  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.776372  9950 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.795770  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:39.775949 10029 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:39.797612  8472 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:39.799352  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.810323  8465 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:39.800632  8468 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:26:39.779196  8470 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:39.802959  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:39.811692  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.811908  8471 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 3: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:26:39.812285  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:39.812495  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.812917  8362 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:39.813035  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.813061  8537 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:39.816246  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.817359  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.819962  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.820513  8537 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.821147  8471 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:39.801244 10241 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.827286 10241 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.829432 10241 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.804121 10029 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.749842 10180 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:39.829949 10029 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:39.829361  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:39.831562 10180 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:39.822654  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:39.832507  9048 raft_consensus.cc:2410] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:26:39.822242 10244 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:39.834980 10244 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:39.835333 10244 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.836787  9044 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:39.839486  9980 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.841413  9980 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:39.842818  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:39.843652  9043 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:39.844063  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 109) took 1028 ms. Trace:
I20260709 12:26:39.844362  9043 rpcz_store.cc:276] 0709 12:26:38.815712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.819466 (+  3754us) service_pool.cc:224] Handling call
0709 12:26:39.842675 (+1023209us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:26:39.844012 (+  1337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39017216}
I20260709 12:26:39.842654 10244 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:39.829262  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 934) took 1109 ms. Trace:
I20260709 12:26:39.851775  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:39.851953  8537 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:39.856353  8395 rpcz_store.cc:276] 0709 12:26:38.720022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.299497 (+579475us) service_pool.cc:224] Handling call
0709 12:26:39.739488 (+439991us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.763874 (+ 24386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.829087 (+ 65213us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b5400288550. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:39.829207 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":979803520}
I20260709 12:26:39.859153  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:39.862432  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:39.862627  8397 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:39.863164  8395 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:39.801074 10148 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 12:26:39.849637 10251 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.552s	user 0.009s	sys 0.000s
I20260709 12:26:39.870261  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:39.874900 10277 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:39.874774  8537 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:26:39.862896 10224 consensus_queue.cc:1059] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
W20260709 12:26:39.821650  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 369623us
I20260709 12:26:39.877923  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:39.878686 10278 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.880203  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:39.881042 10046 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.881400  8436 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:39.882764  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.889038  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.880363 10211 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:39.883394  8397 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:39.885771  8539 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:39.891964  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:39.875936 10207 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.895274 10241 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.897029  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.892643  9841 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:39.898069 10173 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:39.898633 10241 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.899874  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.900612 10241 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.901000  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1343) took 1036 ms. Trace:
I20260709 12:26:39.901804  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:39.907084  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.907435  8397 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:39.910626  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:39.846828 10029 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:39.891677 10016 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.914849  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.916949  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.948457  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.951846  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.951150  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.908820 10245 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.953224  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.954427  8537 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:39.956557  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.957101  8541 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:39.959115  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:39.959740  8539 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:39.910082 10215 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.961309  8467 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:39.895293  9950 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:26:39.964555  8463 pending_rounds.cc:85] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 4
I20260709 12:26:39.966492  8463 pending_rounds.cc:107] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:26:39.906687  9843 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 12:26:39.965732  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 55175.1us
I20260709 12:26:39.913585 10193 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.912380  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:39.966758  8463 raft_consensus.cc:2889] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:39.966928  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:39.970574  9014 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.971874  8361 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:39.952373 10196 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:39.975057  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:39.977566  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:39.964670 10224 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:39.978137  8392 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:39.982956  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:39.983991  8391 raft_consensus.cc:2376] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5. Re-sending same reply.
I20260709 12:26:39.983178  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:39.985046  8392 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:39.980916 10167 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:39.989050  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 111) took 1149 ms. Trace:
I20260709 12:26:39.989462 10029 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.990141  8292 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 2, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:26:39.991793  8538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 974) took 2006 ms (client timeout 1614 ms). Trace:
W20260709 12:26:39.992156  8538 rpcz_store.cc:269] 0709 12:26:37.985869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.016592 (+ 30723us) service_pool.cc:224] Handling call
0709 12:26:39.991624 (+1975032us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54000398d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:39.991717 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083089152}
I20260709 12:26:39.994336 10072 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:39.994688 10072 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:39.995599  9044 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:39.972824 10244 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:39.999788 10244 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:26:39.901396  8464 rpcz_store.cc:276] 0709 12:26:38.864172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.865323 (+  1151us) service_pool.cc:224] Handling call
0709 12:26:38.869900 (+  4577us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:38.879548 (+  9648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.879581 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:38.880226 (+   645us) log.cc:844] Serialized 52 byte log entry
0709 12:26:39.170719 (+290493us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:26:39.297697 (+126978us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.403814 (+106117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.407255 (+  3441us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:39.849026 (+441771us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:39.900714 (+ 51688us) raft_consensus.cc:1685] finished
0709 12:26:39.900813 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.900943 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71762,"prepare.queue_time_us":63582,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":100640,"raft.run_cpu_time_us":544,"raft.run_wall_time_us":9291,"spinlock_wait_cycles":4638464,"thread_start_us":200234,"threads_started":1,"wal-append.queue_time_us":356342}
I20260709 12:26:40.010871 10280 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:40.027432 10280 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:40.027812 10280 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.029439  9841 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.042732  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:40.043670  8538 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:39.965296 10245 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:40.065150  8392 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:26:40.066505  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:40.067179  8392 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
W20260709 12:26:40.067615  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 95813.4us
I20260709 12:26:40.068562  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.071463  8543 raft_consensus.cc:2410] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:26:40.010869 10224 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:40.072722  8395 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:26:40.075829  8395 pending_rounds.cc:85] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 2
I20260709 12:26:40.076118  8395 pending_rounds.cc:107] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:26:40.076342  8395 raft_consensus.cc:2889] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:40.078226  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:40.082296  8361 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.074108  8388 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.084096  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:40.084836  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 107357us
I20260709 12:26:40.085516 10073 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.091976  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.092548  8392 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:40.093343  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.094281  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.095044 10122 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.095564 10122 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:40.096455 10122 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.099696  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.100837  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.101612  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:40.102599  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:40.103343 10291 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.103901 10291 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.106153 10224 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:40.111514  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.112150  8392 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:40.114887  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.113831  8438 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:40.123795  8361 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.125041  8361 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.126159  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.128293  8361 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.130609  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:40.106074 10291 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.134653  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:39.989430  9045 rpcz_store.cc:276] 0709 12:26:38.839183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.848970 (+  9787us) service_pool.cc:224] Handling call
0709 12:26:39.988265 (+1139295us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:26:39.988461 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.988631 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.988658 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.988701 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:39.988729 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:39.988781 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:39.988907 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15406976}
I20260709 12:26:40.123116  9976 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.121503  9712 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.129451 10290 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.122692 10207 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.120990  9980 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.129072 10164 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:40.129297 10052 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:40.127514 10193 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.131867 10241 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.030442 10072 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:40.121429  9769 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:26:40.121160 10073 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.155508 10180 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.157362  9976 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.166388  8361 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.162947 10174 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:40.154991  9883 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:26:40.164247 10052 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.162278 10164 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.177920 10164 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.178270 10073 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.179561  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:26:40.173765 10292 log.cc:927] Time spent T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:40.171280  9841 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:26:40.174697 10245 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:40.165372 10244 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:26:40.169394  9976 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.165441 10293 raft_consensus.cc:3055] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:40.177122  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.176137 10052 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.168548 10211 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.167894 10180 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.168051 10048 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:26:40.189569 10293 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:40.192387  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 931) took 1473 ms. Trace:
I20260709 12:26:40.188483  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:40.202231  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.203483  9980 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:40.207337 10164 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.197451 10180 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.208588  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 927) took 1686 ms. Trace:
I20260709 12:26:40.208966  8394 rpcz_store.cc:276] 0709 12:26:38.522625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.917292 (+394667us) service_pool.cc:224] Handling call
0709 12:26:38.917570 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:38.945095 (+ 27525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:38.945123 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:38.945518 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:26:39.074457 (+128939us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:26:39.074501 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.202656 (+1128155us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b54003287d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:40.202705 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:40.202748 (+    43us) raft_consensus.cc:1685] finished
0709 12:26:40.202760 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.208529 (+  5769us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":527,"raft.queue_time_us":11786,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":55564,"spinlock_wait_cycles":62531328,"thread_start_us":128610,"threads_started":1,"wal-append.queue_time_us":242657,"wal-append.run_cpu_time_us":1288,"wal-append.run_wall_time_us":1002477}
I20260709 12:26:40.211151  8394 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:40.208154 10304 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.195194 10245 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.198988 10061 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:40.228647  8396 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.211752 10211 consensus_queue.cc:1059] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:26:40.200181 10280 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:40.218326 10061 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:40.200695  8388 rpcz_store.cc:276] 0709 12:26:38.719315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.183308 (+463993us) service_pool.cc:224] Handling call
0709 12:26:39.196134 (+ 12826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:40.088028 (+891894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.192106 (+104078us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54003de0d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:40.192324 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919408896}
I20260709 12:26:40.240489 10052 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.220253 10293 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:40.246163 10293 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.242481 10164 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:40.238380 10048 raft_consensus.cc:3055] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:40.222237 10245 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:40.255946  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 121353us
W20260709 12:26:40.256758 10294 log.cc:927] Time spent T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:26:40.261639  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1126) took 1417 ms. Trace:
I20260709 12:26:40.263651  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:40.254712 10048 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:40.264920  8393 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:40.267653  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 937) took 1547 ms. Trace:
I20260709 12:26:40.268107  8389 rpcz_store.cc:276] 0709 12:26:38.720702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.354900 (+634198us) service_pool.cc:224] Handling call
0709 12:26:39.355166 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:40.179465 (+824299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:40.179497 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:40.179537 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:40.179568 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.267392 (+ 87824us) spinlock_profiling.cc:243] Waited 824 ms on lock 0x7b5400166554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:40.267471 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.267596 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1895196416}
I20260709 12:26:40.264575  8390 rpcz_store.cc:276] 0709 12:26:38.843914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.435652 (+591738us) service_pool.cc:224] Handling call
0709 12:26:39.435996 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.591314 (+155318us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:39.786960 (+195646us) log.cc:844] Serialized 14 byte log entry
0709 12:26:40.060639 (+273679us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:40.069796 (+  9157us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:40.071768 (+  1972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.261409 (+189641us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400165654. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:40.261459 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.261583 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10913,"prepare.queue_time_us":212829,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":32140,"raft.queue_time_us":27022,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":3128,"spinlock_wait_cycles":326414080,"thread_start_us":414026,"threads_started":3,"wal-append.queue_time_us":195364}
I20260709 12:26:40.269568 10048 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.270691  8389 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.270706  8390 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
W20260709 12:26:40.274626  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.274777  8390 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:40.276249 10052 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.270757 10048 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.279840  8393 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:40.280747  8389 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:40.282773 10245 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:40.283804  8538 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:26:40.284161  8538 pending_rounds.cc:85] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 1
I20260709 12:26:40.284300  8538 pending_rounds.cc:107] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 12:26:40.284485  8538 raft_consensus.cc:2889] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:40.285856 10180 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.287014  8393 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:40.289427  8436 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.290201  9976 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.292557  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 991) took 1345 ms. Trace:
I20260709 12:26:40.292640 10180 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.292973  8540 rpcz_store.cc:276] 0709 12:26:38.947616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.948758 (+  1142us) service_pool.cc:224] Handling call
0709 12:26:38.949031 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.164721 (+215690us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:26:39.425403 (+260682us) log.cc:844] Serialized 14 byte log entry
0709 12:26:39.700866 (+275463us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.703074 (+  2208us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:39.706122 (+  3048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.292310 (+586188us) spinlock_profiling.cc:243] Waited 85.6 ms on lock 0x7b5400099a54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:40.292381 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.292504 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15506,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":37005,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3488,"spinlock_wait_cycles":196859136,"thread_start_us":442035,"threads_started":2,"wal-append.queue_time_us":290876}
I20260709 12:26:40.295047  9976 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:40.283659 10061 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.295939 10061 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.299088 10271 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.294556 10280 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:40.306299  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.307269  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:40.307634 10171 raft_consensus.cc:3055] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:40.308662 10171 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:40.309474 10171 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:40.310480 10171 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.312726 10306 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.313194 10306 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.315100 10306 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.316548 10046 raft_consensus.cc:3055] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:40.316916 10046 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:40.317693 10046 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.318023  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.318248  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.318761 10046 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.319494  8511 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:40.319729  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:40.321707  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.322551  8464 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:40.322844  8471 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:26:40.323019  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1008) took 1029 ms. Trace:
I20260709 12:26:40.323750  9976 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:40.319574 10061 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:40.324211  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.324672  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.325719  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:40.326395  8465 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:40.323354  8542 rpcz_store.cc:276] 0709 12:26:39.293203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.634720 (+341517us) service_pool.cc:224] Handling call
0709 12:26:39.634984 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:39.709645 (+ 74661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.709677 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:39.709718 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:26:39.709746 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.322826 (+613080us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b54003fb6d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:40.322867 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.322970 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159698304}
I20260709 12:26:40.327426  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:40.335789  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 46269.4us
I20260709 12:26:40.337956  8467 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:40.346297  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 90) took 1399 ms. Trace:
I20260709 12:26:40.346779  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:40.348176  8292 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:40.326129 10100 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:40.351070  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 55765.7us
I20260709 12:26:40.350575  8292 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 4 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.352650 10029 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:40.353145 10029 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:40.352557  8292 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.354000 10029 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.354700  8292 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.356238  8292 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:40.326215  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.348840  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:26:40.377072  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.365531  8470 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:40.375656  8471 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:26:40.377833  8471 pending_rounds.cc:85] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 2
I20260709 12:26:40.378077  8471 pending_rounds.cc:107] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:26:40.378283  8471 raft_consensus.cc:2889] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:40.379027  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.324280  9976 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:40.380237 10290 consensus_queue.cc:1059] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.379899  8470 raft_consensus.cc:2410] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:26:40.346691  8463 rpcz_store.cc:276] 0709 12:26:38.946499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:38.946674 (+   175us) service_pool.cc:224] Handling call
0709 12:26:38.946982 (+   308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:39.978567 (+1031585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:39.978599 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:39.980476 (+  1877us) log.cc:844] Serialized 52 byte log entry
0709 12:26:40.113807 (+133331us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:40.132051 (+ 18244us) log.cc:844] Serialized 14 byte log entry
0709 12:26:40.304706 (+172655us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18003eda60. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6461216c0a 00007f646a956219 00007f646129ea40 00007f64612994e4 00007f6461299455 00007f6467d813c7 00007f64643939a7 00007f64643a30bf 00007f64643a3038
0709 12:26:40.304906 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 12:26:40.311696 (+  6790us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b18003eda60. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:26:40.328297 (+ 16601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:40.346024 (+ 17727us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54003cc3d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:40.346067 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:40.346106 (+    39us) raft_consensus.cc:1685] finished
0709 12:26:40.346117 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:40.346248 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181899,"prepare.queue_time_us":192051,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2406,"raft.queue_time_us":30300,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":29064,"spinlock_wait_cycles":2418996736,"thread_start_us":123093,"threads_started":1,"wal-append.queue_time_us":185908}
W20260709 12:26:40.384660  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48058.4us
I20260709 12:26:40.386425  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:40.390895  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.384104 10241 raft_consensus.cc:3055] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:40.394871  8436 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.402796  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:40.403681  8467 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:40.403777  9015 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:40.407977  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 241674us
I20260709 12:26:40.384871 10173 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:40.403111 10241 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:40.424058 10072 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.424243 10241 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.425515 10241 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:40.385843 10193 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.428081 10193 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.408190 10280 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.430020 10193 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.402513 10122 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:40.430804 10122 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:40.382378 10061 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.408730  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.414548 10245 consensus_queue.cc:1059] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:40.418361 10164 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.419050  9980 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:40.419916  8362 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:40.450522  8362 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.421834 10304 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:40.454272  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:40.454874  8541 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.380642  9976 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.434942  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:40.459049  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.435038  8545 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:26:40.431711 10122 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:40.435747  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.439014  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.459614  8537 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:40.462005 10318 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.473433  8545 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:40.439779 10193 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.407987  9769 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:26:40.475231  8541 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:40.476337  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.432350 10052 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:26:40.486078  8545 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:40.489832  8392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "016be601898642f5bfd00376e81080bd"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:40.490476  8392 raft_consensus.cc:606] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.490810  8392 raft_consensus.cc:614] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:40.498672 10224 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.499181 10224 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.501255 10224 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:40.501814  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 69069.4us
I20260709 12:26:40.455971 10173 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:40.456861 10244 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:40.456568 10192 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:40.507170  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.459800 10196 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:40.440688 10061 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.455740 10278 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:26:40.483584 10170 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:40.483856 10291 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.482045 10293 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.509171 10244 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.534099  8546 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:26:40.544976  8392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:40.545617  8392 raft_consensus.cc:606] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.545953  8392 raft_consensus.cc:614] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:40.530444 10170 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.533475 10244 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.482023 10318 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.574092 10170 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.543140  9047 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:26:40.596364  8465 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
W20260709 12:26:40.602037  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 69524.3us
I20260709 12:26:40.547930 10304 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:40.551287  8540 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:26:40.573467 10245 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.540011 10293 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.545325 10011 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:26:40.673115  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 219499us
W20260709 12:26:40.667147  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 153492us
W20260709 12:26:40.670001 10319 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:26:40.674032  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 234611us
I20260709 12:26:40.680186  8436 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:40.681187  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 78496.3us
I20260709 12:26:40.665851 10290 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.684125  8362 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:40.697904  8362 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:26:40.678375 10317 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:26:40.682456 10324 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:26:40.592309 10173 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:40.715498  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:40.718156  8396 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.715724  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:40.716503 10314 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:40.693293 10325 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.720153 10325 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.721450 10330 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.721922 10330 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.719053  8391 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.725999 10318 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.717514  8394 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:26:40.679385 10245 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.732777 10011 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:26:40.704897  9980 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:40.729750 10314 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:40.672116 10304 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.730057 10321 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:40.705104 10313 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:40.713624  8390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:40.722397 10325 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:40.857677  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 126213us
I20260709 12:26:40.877210  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:40.699045 10290 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.775961 10335 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.880038 10314 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.880846 10170 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:40.859869  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 142038us
I20260709 12:26:40.861665 10042 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:40.868083  9980 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:40.861542 10318 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.883041 10318 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.883301  9980 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.885048 10318 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.885547 10304 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.858127  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.886327  8392 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:40.887107  9712 raft_consensus.cc:3055] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:40.870223 10334 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.870530 10061 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:40.871937  8391 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:26:40.868492 10245 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:40.857229  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.880702 10335 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.881641 10290 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.868099  9047 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:40.868995 10329 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:26:40.889000  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 194225us
I20260709 12:26:40.894215  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.891664  9712 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:40.904523  9712 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.905684  9712 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:40.874249  8396 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:40.885812 10291 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:40.872704 10321 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.912209 10321 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:40.912422 10170 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.916309 10335 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:40.919327 10170 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:40.921041  9980 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:40.898519  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.923801  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:40.897512 10330 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:40.900158 10337 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:40.928391  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:40.937347  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.939188  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.939752  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.939792  8467 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:40.934443 10046 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:40.942358  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.944347  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.945752  8465 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:40.948818  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.949440  8542 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:40.949846  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.942451  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.950325  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.950843  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.951340  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.934247 10304 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:26:40.952369  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:40.953737  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.950867  8542 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:40.955788  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:40.951503 10295 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:40.958729 10295 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:40.959028  8511 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.959607 10295 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:40.963610  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:40.964370  8540 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:40.965135 10170 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:40.965528 10170 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:40.965850 10170 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:40.942469 10207 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:40.969035 10244 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.971042 10244 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.972378 10321 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.898500 10334 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.974217  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.974409 10321 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.976243  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.976666  8392 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 1. Current term is 2. Ops: []
I20260709 12:26:40.977254  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.979699  8541 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:26:40.980167  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 49042.3us
I20260709 12:26:40.980679  8397 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:26:40.981299  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.984719  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.985108  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.983201  8361 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:40.987579  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.989339  8472 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:40.985004  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.936882 10211 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:26:40.989403  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:40.992647  8393 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
W20260709 12:26:40.988773 10331 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.003s
I20260709 12:26:40.952306 10293 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:40.994483  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:40.979063  8390 raft_consensus.cc:606] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.007594  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.008260  8472 raft_consensus.cc:2368] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6.
I20260709 12:26:41.009814  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:41.010231  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.011471  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.013376 10290 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.013888 10290 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.014606  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:41.015131  8468 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.015978 10290 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:41.026721  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 45495us
I20260709 12:26:41.028750  8392 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:41.029424  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:41.030049  8541 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:41.033174  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:41.034066  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:41.037866  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.041373  8468 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:40.986081 10329 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:40.936298 10337 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:40.993556 10244 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:40.989588 10335 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.051023  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.055117  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:41.057921  8394 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:26:41.063356  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 78319.7us
I20260709 12:26:41.064477  8512 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:40.994144 10207 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:41.065330  8362 leader_election.cc:400] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6.
I20260709 12:26:40.994098 10046 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:26:41.069619  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 82721.3us
I20260709 12:26:41.070858  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:41.024703  8390 raft_consensus.cc:614] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:41.006464  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:41.056234 10224 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:41.049721 10329 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.061358 10244 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.066032  9712 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:41.086247  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:41.087392  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:41.064205 10314 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:41.066453 10164 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.068202  8362 leader_election.cc:403] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:41.049930 10290 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:26:41.109579  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.110991  8512 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:41.081948 10224 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.099246  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:41.100232 10325 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:41.101030  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.109849 10046 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.101289 10337 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:41.094961 10052 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:41.118866 10052 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.119242 10052 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:41.106276  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 78809.9us
I20260709 12:26:41.092022 10244 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:41.091491 10329 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.113926  8539 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.090893  9712 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.069202 10318 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:26:41.128634  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.099069  8362 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.075814 10335 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:41.139618  8542 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:41.133991  8544 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:41.143177  8539 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:41.115965 10224 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:41.145453  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 46470.1us
I20260709 12:26:41.122305 10320 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:41.147055  8362 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.149432  8362 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.151717  8362 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.135197  9712 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.159116  8512 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:41.141573 10193 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:26:41.186573 10341 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:26:41.121160 10170 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.147300 10215 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:26:41.187077  8464 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:26:41.198747  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:41.199229  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48442.6us
W20260709 12:26:41.186955 10343 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:26:41.155579 10320 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:41.154488 10333 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:41.154796 10314 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.154430 10241 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.222820  8545 raft_consensus.cc:2368] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6.
I20260709 12:26:41.146250 10322 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 12:26:41.311733  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.204056  9043 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Advancing to term 7
I20260709 12:26:41.344334  8361 leader_election.cc:400] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6.
W20260709 12:26:41.311184  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 83210.1us
I20260709 12:26:41.193527 10192 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:41.225845 10330 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:41.203549 10325 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:41.202651 10291 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.245028 10320 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.332738 10016 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:41.245819  8397 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:41.222436  8464 pending_rounds.cc:85] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 4
I20260709 12:26:41.159763 10207 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.322319  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:41.349936  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.224495  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:41.348421 10314 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:41.365671  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 209796us
I20260709 12:26:41.345971 10334 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:41.357398  8540 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:41.371973  8394 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:41.358201 10192 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:41.356732 10333 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:41.364207  8464 pending_rounds.cc:107] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
W20260709 12:26:41.381259 10344 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 12:26:41.381047  8464 raft_consensus.cc:2917] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:26:41.395145  8464 raft_consensus.cc:2889] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:41.396059 10148 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.396530 10148 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:41.398420 10345 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:26:41.401096 10280 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:41.401638 10280 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:41.402006 10148 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:41.402999 10332 consensus_queue.cc:1059] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:41.383724 10346 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 12:26:41.373919 10313 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6.
I20260709 12:26:41.406826  9047 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.410719 10048 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:41.411137 10048 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:41.412271 10170 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:41.373230 10314 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:41.416855 10314 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:41.417618  9043 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:41.418483  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:41.419137  9044 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:41.362859 10016 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.420049 10224 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.421003 10280 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:41.421527  8393 raft_consensus.cc:2393] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:41.420089 10192 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.424638 10329 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.425668  8537 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:41.427726  8361 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:41.428143 10329 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:41.428535 10122 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.430009 10122 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:41.430364 10122 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.431033 10122 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.433203  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.433789  8463 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:26:41.411919 10048 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.436751  8467 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:41.436134  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:41.448596  8467 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:26:41.430009 10339 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:26:41.452785  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:41.456411  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:41.479588  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:41.459446 10048 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:41.449779 10171 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:26:41.493930  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 117918us
I20260709 12:26:41.503882 10278 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:41.504484 10354 log.cc:927] Time spent T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:26:41.504442 10278 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.506654 10278 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:41.458161 10164 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:26:41.508585  8540 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:41.485842 10061 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.461095 10052 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.514443  8436 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:41.526219  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:41.532299  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 200607us
I20260709 12:26:41.533440  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:41.550689  8468 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:26:41.551530  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 108526us
I20260709 12:26:41.552666  8394 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:41.553679  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:41.554795  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:41.527662 10042 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:41.556048  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:41.556136  8512 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:41.559790  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:41.561741  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:41.560063  8471 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:41.560606  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:41.563354  8392 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:41.461055 10333 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.562371  8544 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:41.519052 10073 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:26:41.565050  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:41.528439 10016 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:41.548652 10224 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:41.573457  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:41.564884 10278 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:41.574527 10192 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:41.575062 10314 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:41.575966 10353 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:41.560233 10329 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:41.523062 10061 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.582259 10170 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.579830 10320 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.604085  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.588982  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:41.579777  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:41.586230  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 209930us
I20260709 12:26:41.709648 10291 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:41.714885 10224 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:41.563988 10148 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:26:41.581838 10334 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.168s
W20260709 12:26:41.782950 10355 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:26:41.605715 10164 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:26:41.786064  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 197146us
W20260709 12:26:41.785476  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 181462us
I20260709 12:26:41.825825  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:41.615583  9712 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.788759 10245 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:41.761117 10244 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.762068 10170 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:41.883920 10368 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:26:41.906351  8542 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:41.842836 10371 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:41.864387 10293 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:26:41.911019  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:41.913287  8391 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:41.873502 10245 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.917963  8463 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:41.920584  8471 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:41.853304 10291 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.917343 10245 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:41.912875 10049 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.916549  9574 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.873145 10224 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:41.915607 10052 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:41.954566  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 128827us
I20260709 12:26:41.921383 10293 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.962126  9574 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.953506 10073 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:41.943379 10371 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:26:41.967700  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49398 (request call id 7) took 1259 ms. Trace:
I20260709 12:26:41.957074 10049 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:41.962960 10042 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:41.971889 10384 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:41.997380 10241 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:42.005741 10374 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:26:42.013844  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.014523  8463 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:42.016706  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.017060 10061 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.018680 10244 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.010385 10384 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:42.018918 10042 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.019697 10196 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.020478  9712 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:42.024206  9047 consensus_meta.cc:287] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.617s	user 0.004s	sys 0.005s
I20260709 12:26:42.020246 10196 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.030412  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.032261 10049 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.029830 10320 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.015959 10241 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.035001 10241 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.035938  9047 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:26:42.036372  9047 pending_rounds.cc:85] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Aborting all ops after (but not including) 4
I20260709 12:26:42.036667  9047 pending_rounds.cc:107] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:26:42.042171  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.042821  8465 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
I20260709 12:26:42.003001  8390 rpcz_store.cc:276] 0709 12:26:40.702800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.704878 (+  2078us) service_pool.cc:224] Handling call
0709 12:26:41.944918 (+1240040us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54003dd6d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464383853 00007f646935160a 00007f64628d77d4 00007f64628d7762 00007f64628d7691 00007f64628d760c 00007f64628d68c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:41.957407 (+ 12489us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":238901504}
I20260709 12:26:42.049257 10196 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:42.051424 10122 consensus_meta.cc:287] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.620s	user 0.005s	sys 0.003s
I20260709 12:26:42.051816 10122 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:42.053690  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.054375 10291 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.055027 10335 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:42.060003  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.045610  9047 raft_consensus.cc:2917] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
W20260709 12:26:42.056113  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 99291.9us
I20260709 12:26:42.055923  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.056891  8467 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:42.061291  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.062004  8472 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.044476 10170 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:42.055374 10293 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:42.059645 10048 consensus_meta.cc:287] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.003s
I20260709 12:26:42.055615 10122 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:26:42.062608 10305 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.017s	sys 0.020s
I20260709 12:26:42.068264 10224 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:42.083832 10384 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:42.070672 10073 consensus_queue.cc:1059] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:42.066532  9047 raft_consensus.cc:2889] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:42.070735  8390 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:42.073232  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.074456  8396 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:26:42.077777  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.078054  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.095857  8397 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:42.096753  8394 raft_consensus.cc:2410] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:26:42.097277  8389 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:26:42.078902  8472 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:42.080439  8393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e001ede544f519292071c2eeb41fb"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:42.081256 10278 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.081470  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1304) took 1052 ms. Trace:
I20260709 12:26:42.098258  8393 raft_consensus.cc:606] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.088207  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.098805  8393 raft_consensus.cc:614] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:42.096016  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1150) took 1120 ms. Trace:
W20260709 12:26:42.079401 10305 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.017s	sys 0.020s
I20260709 12:26:42.098321  8537 rpcz_store.cc:276] 0709 12:26:41.028669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.031431 (+  2762us) service_pool.cc:224] Handling call
0709 12:26:41.031688 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:41.426004 (+394316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.081274 (+655270us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b5400466c54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:26:42.081416 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905674624}
I20260709 12:26:42.099529  8391 rpcz_store.cc:276] 0709 12:26:40.975543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:40.985548 (+ 10005us) service_pool.cc:224] Handling call
0709 12:26:42.095810 (+1110262us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b54002b4b54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:42.095951 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2119734016}
I20260709 12:26:42.105269 10245 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.100369  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.112390 10388 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:42.113566 10388 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:42.113927 10388 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.167505 10382 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:42.169562 10382 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:42.182526  8438 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:42.115456 10245 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:42.208869  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 92623.9us
I20260709 12:26:42.162720 10388 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:42.218325  8391 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:42.215014 10398 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:42.225390 10323 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:26:42.234974  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 986) took 1203 ms. Trace:
I20260709 12:26:42.235361  8389 rpcz_store.cc:276] 0709 12:26:41.031986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.033323 (+  1337us) service_pool.cc:224] Handling call
0709 12:26:42.097065 (+1063742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:42.097660 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.234789 (+137129us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002b4b50. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:26:42.234916 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2386553088}
I20260709 12:26:42.236085  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:42.236677 10372 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.237082  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:42.242429  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:42.237160 10372 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:42.243606  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:42.239316 10100 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:26:42.244496 10372 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.245455  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.246199  8472 raft_consensus.cc:2410] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:26:42.246526 10337 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.246809 10164 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.247275 10164 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.248840  8512 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.249161 10164 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.249575 10340 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.249837  9047 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:42.241671  9044 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.250061 10340 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.252099 10340 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.253522  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:42.254397  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:42.254866  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.255465  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.255961  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.242321 10318 raft_consensus.cc:1064] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:42.258764  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:42.259164  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.259747  8472 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:42.260676  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.261456  8391 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:42.246981 10337 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.266723  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.238351 10398 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.269156  8512 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.267335  8396 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.272358  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.273859  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.276598  8544 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:42.276960  8544 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:42.249604 10164 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.280226  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.280550  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.272998  8397 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:42.281908  8539 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:42.283310  8542 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:42.260848 10122 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.279541  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:42.284464  8512 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.286460  8361 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.278882 10329 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:42.263285 10313 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.277652  8544 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.260659 10100 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:42.271303 10318 raft_consensus.cc:1068] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Unable to promote non-voter e3660d999c0a41658a1f1dbe7cc90746: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:42.290205  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.290868  8544 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.236721 10192 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:26:42.292969 10338 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:42.293123  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.296291  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.267297 10340 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.273615 10398 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.275481 10325 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:42.278729 10207 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.304561  8361 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:42.322172  8544 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:26:42.289965 10329 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.325168  8393 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 12:26:42.322517  8544 pending_rounds.cc:85] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 3
I20260709 12:26:42.327235  8544 pending_rounds.cc:107] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:26:42.327565  8544 raft_consensus.cc:2889] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:42.275247 10393 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:26:42.293392 10224 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:42.278463 10170 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:26:42.338524  8396 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:42.281494 10293 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:26:42.296352 10338 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.341925  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.288691 10164 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.323101 10337 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.298745 10291 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:26:42.339309 10329 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.338793 10196 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.396644  9574 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:42.387862 10411 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.003s
I20260709 12:26:42.338141  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.400880  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.398850  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.341292 10224 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.384056 10338 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.306417 10340 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.381191 10306 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:42.402119  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.387550 10278 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:42.403744  8464 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 2.
I20260709 12:26:42.332038 10207 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.342880 10371 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 12:26:42.343385 10361 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:26:42.404659 10306 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:42.412235 10278 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:42.467778 10278 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.469285 10398 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.451223  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.470469  8463 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
W20260709 12:26:42.470626 10375 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.552s	user 0.002s	sys 0.002s
I20260709 12:26:42.470888 10325 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:42.471962  8472 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:26:42.472441 10211 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:42.409336  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.464599  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.472857 10211 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:42.412408  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.475133  8471 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.477412  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.404968 10224 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:26:42.437064 10401 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 12:26:42.436628 10403 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:26:42.472561 10398 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.484201  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.488070  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.436445  8540 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:42.440152 10305 raft_consensus.cc:3055] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:42.413625  9883 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:42.436932  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.437458 10207 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.423127  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:42.498314  8391 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:42.444777 10388 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.504953  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.512814  8543 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:26:42.513841  8388 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:42.515187  9044 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:42.516486  8361 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:42.517314 10052 raft_consensus.cc:3055] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:42.517694 10052 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:42.518769 10371 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:42.518481 10052 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.519245 10371 raft_consensus.cc:697] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:42.508185  9883 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:42.520208 10371 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:42.520303  9883 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.521287  9883 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.522831 10290 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.523321 10290 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.523643  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:42.513877  8295 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 225) took 14389 ms (client timeout 15000 ms). Trace:
I20260709 12:26:42.530561  8512 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.509795 10340 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.504693 10305 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:42.550348  8510 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:42.541388 10337 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:42.551349 10337 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.551725 10337 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.513103 10164 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.523562 10211 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.533095 10052 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.528023 10170 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.561879 10335 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:42.563722 10290 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.569726 10329 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.570914  8541 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:42.575141 10305 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.525179 10306 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.582875 10314 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:42.583294 10314 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:42.584118 10314 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.585196 10314 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.582752 10241 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:42.587919  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:42.590584 10244 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:42.590970 10244 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.591288 10244 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:42.594012 10366 log.cc:927] Time spent T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.632s	user 0.000s	sys 0.004s
I20260709 12:26:42.571662 10170 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.580613 10305 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.630288  8471 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
W20260709 12:26:42.632215 10378 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.666s	user 0.000s	sys 0.004s
I20260709 12:26:42.625094 10329 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.633102 10329 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.633631 10329 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.634861 10337 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:42.524626  8295 rpcz_store.cc:269] 0709 12:26:28.124425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.124562 (+   137us) service_pool.cc:224] Handling call
0709 12:26:42.513679 (+14389117us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:35.999173 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:36.028805 (+ 29632us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:36.030117 (+  1312us) write_op.cc:435] Acquired schema lock
0709 12:26:36.042199 (+ 12082us) tablet.cc:662] Decoding operations
0709 12:26:36.065330 (+ 23131us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:36.065393 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:36.065413 (+    20us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:26:36.066331 (+   918us) tablet.cc:701] Row locks acquired
0709 12:26:36.066345 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:26:36.631750 (+565405us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b2c00000448. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6462c82a11 00007f6462c91a0a 00007f6462c91693 00007f6462c91631 00007f64643c4902 00007f64643c46dd 00007f6467dbf243 00007f6467dbed58 00007f6467dc39f1 00007f6467dc39a9 00007f6467dc3939
0709 12:26:36.631880 (+   130us) write_op.cc:270] Start()
0709 12:26:36.632134 (+   254us) write_op.cc:276] Timestamp: P: 1783599996110790 usec, L: 0
0709 12:26:36.632187 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:26:36.633210 (+  1023us) log.cc:844] Serialized 4733 byte log entry
0709 12:26:37.214188 (+580978us) op_driver.cc:464] REPLICATION: finished
0709 12:26:37.473539 (+259351us) write_op.cc:301] APPLY: starting
0709 12:26:37.473644 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:37.473932 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:37.473975 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:37.487790 (+ 13815us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:37.488170 (+   380us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:26:37.488231 (+    61us) write_op.cc:312] APPLY: finished
0709 12:26:37.488645 (+   414us) log.cc:844] Serialized 88 byte log entry
0709 12:26:37.488873 (+   228us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.489074 (+   201us) write_op.cc:454] Released schema lock
0709 12:26:37.489137 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:37.729301 (+240164us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b5400417728. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a7459e1 00007f646a74464c 00007f6467dd53fd 00007f6467dc1389 00007f6467dc0b53 00007f6467dc4d61 00007f6467dc4d19 00007f6467dc4ca9 00007f6467dc4c71 00007f6467dc3e9d 0000000000388634
0709 12:26:37.729782 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.729815 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":29092,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":251126,"apply.run_cpu_time_us":6821,"apply.run_wall_time_us":256225,"num_ops":12,"prepare.queue_time_us":281724,"prepare.run_cpu_time_us":24771,"prepare.run_wall_time_us":734167,"raft.queue_time_us":263503,"raft.run_cpu_time_us":38716,"raft.run_wall_time_us":244253,"replication_time_us":556477,"spinlock_wait_cycles":108812928,"thread_start_us":550278,"threads_started":4,"wal-append.queue_time_us":216335,"wal-append.run_cpu_time_us":15068,"wal-append.run_wall_time_us":1639059}]]}
I20260709 12:26:42.638557 10320 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.639052 10320 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.641006 10320 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.642023 10271 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:42.644054 10338 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.644402 10318 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.644925 10318 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.646081 10338 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.611891 10207 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.632457 10170 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.652899  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.654052  8464 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.649477  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.656514  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:42.666566  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 92282.2us
I20260709 12:26:42.647181 10207 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.647912 10337 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.668182  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:42.669667  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1306) took 1481 ms. Trace:
I20260709 12:26:42.646858 10318 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.654273 10329 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.670948  8545 rpcz_store.cc:276] 0709 12:26:41.188197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.340624 (+152427us) service_pool.cc:224] Handling call
0709 12:26:41.340908 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:41.343588 (+  2680us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:26:41.357503 (+ 13915us) log.cc:844] Serialized 14 byte log entry
0709 12:26:41.968876 (+611373us) log.cc:844] Serialized 14 byte log entry
0709 12:26:42.252612 (+283736us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:42.253044 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:26:42.253159 (+   115us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:42.253189 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:42.253244 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:42.593571 (+340327us) spinlock_profiling.cc:243] Waited 7.7 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:26:42.668030 (+ 74459us) raft_consensus.cc:1685] finished
0709 12:26:42.668055 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:42.669606 (+  1551us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":449297,"prepare.queue_time_us":346277,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":78,"raft.queue_time_us":287083,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":17469,"spinlock_wait_cycles":19335808,"thread_start_us":456166,"threads_started":2,"wal-append.queue_time_us":557647}
I20260709 12:26:42.653282  9712 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.655568 10330 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.657435 10170 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.653018 10335 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.671743  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.666631 10338 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.681527  8511 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.676994 10330 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.683619  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:42.684747 10330 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.685299  8362 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:42.672477 10278 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.688638 10422 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.689896  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.690511 10422 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:42.690881 10422 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.692612 10207 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.674758  8391 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:42.655956 10224 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.682626 10170 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.694598 10224 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.695039 10170 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.674198  9712 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.695632 10224 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.692343 10335 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.696892 10373 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:42.681936 10337 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:26:42.715351  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:42.715844  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.691226 10422 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.723186  8471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:42.728400  8471 raft_consensus.cc:606] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:42.701208  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.701957 10424 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.676187 10318 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:42.673007 10244 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:42.705585  9712 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.671840 10371 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.717553  8464 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
W20260709 12:26:42.721598 10379 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.785s	user 0.000s	sys 0.004s
I20260709 12:26:42.688905 10278 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.726306 10330 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:42.725145 10335 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.729568  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.740628  8394 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:42.699877 10338 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:42.745621  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:42.739467 10320 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:42.723189 10224 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.752681 10278 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.756996  9712 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.757428 10245 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.757838 10164 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.761088  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:42.739259 10244 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:42.794545  8543 raft_consensus.cc:2393] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:42.773764  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:26:42.775134  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 45618.6us
I20260709 12:26:42.796801  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.776172  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.777640  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.798278  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.777918  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.778891  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.798990  8392 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:42.786310  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.793123  8539 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:42.799693  8389 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:42.802312  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.804849  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.806280  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.809233  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.809567  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.809746  8472 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.810702  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.812258 10422 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.812564 10320 consensus_queue.cc:1059] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:42.813664  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.814301  8390 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
W20260709 12:26:42.814728 10417 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:26:42.816080 10224 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.744334 10371 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.816649  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.777933 10196 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.817672 10196 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.819569 10196 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.821306  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:42.821856  8391 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.822633  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.779137 10305 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.823479  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.826968  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.824311  8542 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:42.829979  8393 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:42.743757 10424 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.835237  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.816329 10337 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:42.814261 10338 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.814217 10422 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.857185  8543 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:42.857949  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:42.862063 10371 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.842288 10278 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.792654  9712 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.793964 10245 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.865286  8542 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:42.800984 10164 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.871663  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:42.835130 10305 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.887032  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.888015  8539 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:42.887456  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.891007  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.858485 10337 raft_consensus.cc:697] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:42.887212  8543 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:26:42.891080  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.868168 10278 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.899920  8543 pending_rounds.cc:85] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 2
I20260709 12:26:42.895210  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.916762  8543 pending_rounds.cc:107] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:42.917038  8543 raft_consensus.cc:2889] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:42.896171  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.909255  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.891858  8392 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:42.903137  8463 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:42.868527  8391 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:42.892920  8512 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.921164  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.896044  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.921741  8469 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:26:42.900110  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.922564  8512 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.889940  8472 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:42.895807  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.923970  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.922986  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.911996  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.925668  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:42.926018  8471 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:42.926901  8465 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:26:42.908834  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:42.918742 10424 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:42.908048 10337 consensus_queue.cc:237] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:42.928575 10329 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:42.929296 10329 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:42.929610 10329 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.929925 10329 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.927883  8389 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:42.933521 10306 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:42.911995 10340 raft_consensus.cc:3055] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:42.914422 10325 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:42.924923 10330 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:42.937870 10278 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.936204 10245 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.938899  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:42.939459  8467 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:42.947381 10244 raft_consensus.cc:2764] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:26:42.927850  9712 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:42.947135  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 59779.5us
I20260709 12:26:42.949900 10164 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:42.962847  8542 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:42.988015  9048 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:42.990828  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.964612  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:42.990252  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:42.993348  8388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:42.995054  8472 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:42.995572  8388 raft_consensus.cc:606] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:42.995934  8388 raft_consensus.cc:614] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:42.992467  8397 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:26:42.989621 10422 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.998548 10428 raft_consensus.cc:1064] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:43.005254  8543 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:42.936388 10340 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:42.982728  8469 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
W20260709 12:26:43.007481  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 81844.3us
I20260709 12:26:42.992399 10122 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.008349  8388 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:43.008291  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.989621  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:43.004817  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:43.013641  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:43.019060  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:42.962540  9712 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:42.994316 10424 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:26:43.019438  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:43.008805  8512 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.009371 10122 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:43.009791  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:43.028447  8538 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:43.013047  8543 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:26:43.005110 10335 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.008963 10422 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.029106  9712 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.064623 10422 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.065490  9712 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.061733 10335 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.069530 10335 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.070140  8543 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:43.070793  8538 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:43.016749  8511 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.019999  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.016624  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.024266  8467 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:43.013944  8292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46076 (request call id 89) took 5703 ms. Trace:
I20260709 12:26:43.025666  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.027215  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.073074 10428 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:43.079977  8537 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:43.076087  8292 rpcz_store.cc:276] 0709 12:26:37.330340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.331567 (+  1227us) service_pool.cc:224] Handling call
0709 12:26:37.449110 (+117543us) spinlock_profiling.cc:243] Waited 56.1 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f3090 00007f6464391f3a 00007f646a147e9c 00007f646a24604e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc 00007f6468706392 00007f64626c448c 00007f64626c38c6
0709 12:26:43.013866 (+5564756us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:40.726626 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:40.729371 (+  2745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:40.729419 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:26:40.729450 (+    31us) tablet.cc:662] Decoding operations
0709 12:26:40.893938 (+164488us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:40.922437 (+ 28499us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:40.924187 (+  1750us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:26:41.052813 (+128626us) tablet.cc:701] Row locks acquired
0709 12:26:41.052864 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:26:41.053015 (+   151us) write_op.cc:270] Start()
0709 12:26:41.053124 (+   109us) write_op.cc:276] Timestamp: P: 1783600001052970 usec, L: 0
0709 12:26:41.053145 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:26:41.062577 (+  9432us) log.cc:844] Serialized 2537 byte log entry
0709 12:26:41.964611 (+902034us) op_driver.cc:464] REPLICATION: finished
0709 12:26:42.046039 (+ 81428us) write_op.cc:301] APPLY: starting
0709 12:26:42.046118 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:42.046696 (+   578us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:42.046773 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:42.079641 (+ 32868us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:42.079824 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:26:42.079865 (+    41us) write_op.cc:312] APPLY: finished
0709 12:26:42.080083 (+   218us) log.cc:844] Serialized 52 byte log entry
0709 12:26:42.080233 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:42.080330 (+    97us) write_op.cc:454] Released schema lock
0709 12:26:42.080374 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:42.080731 (+   357us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:42.080758 (+    27us) write_op.cc:454] Released schema lock
0709 12:26:42.566097 (+485339us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438632a 00007f646430bf14 00007f646430bec3 00007f646430be38 00007f646430bdf3 00007f646430b0dc 00007f6464334e16 00007f646431ccbb 00007f646430739d 00007f646430ad75
Metrics: {"mutex_wait_us":836266,"reported_tablets":14,"spinlock_wait_cycles":129117056,"child_traces":[["op",{"apply.queue_time_us":79076,"apply.run_cpu_time_us":2654,"apply.run_wall_time_us":34667,"num_ops":6,"prepare.queue_time_us":179443,"prepare.run_cpu_time_us":35660,"prepare.run_wall_time_us":584332,"raft.queue_time_us":403140,"raft.run_cpu_time_us":29204,"raft.run_wall_time_us":653362,"replication_time_us":899433,"spinlock_wait_cycles":39128320,"thread_start_us":350947,"threads_started":4,"wal-append.queue_time_us":303524}]]}
I20260709 12:26:43.025889  9044 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:43.105165  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 88481.2us
I20260709 12:26:43.109846  8388 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:43.111953  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 84806.4us
I20260709 12:26:43.112672  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.113714  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:43.118036  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.118059  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.118774  8537 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:43.122682  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.123663  8361 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.125735  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.125919  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.127506  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.129701  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.130723  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.133955  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.134613  8464 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.136327  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.134433 10321 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.143597 10422 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:26:43.144176 10422 raft_consensus.cc:697] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:43.145102 10422 consensus_queue.cc:237] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.060665 10435 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.147912  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:43.139448 10433 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:26:43.116990 10207 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.155119 10322 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:43.148120 10073 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.177609  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.151988 10164 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:43.147883 10305 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.152585 10435 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:43.171247 10293 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:43.133102 10325 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:43.178809 10439 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:26:43.143896 10427 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:26:43.230639  8512 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.234108  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.157632  8467 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:26:43.116375 10340 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.230660  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.235812  8468 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:26:43.242339  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:43.238484  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.239217  8362 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.218932 10293 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.199102 10327 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:26:43.240818  8466 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:43.244724  8512 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.211905 10435 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.246203  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.212348 10046 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:26:43.231014 10164 raft_consensus.cc:697] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:43.250548  8465 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:26:43.250916  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 130778us
I20260709 12:26:43.252915  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:43.259948  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.260942  8512 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.152916 10329 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.241757 10321 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.243863 10293 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.256992 10278 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.236603 10052 consensus_queue.cc:1059] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:26:43.252043 10333 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:43.250214 10320 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.274712 10278 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:43.259533 10330 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.262661 10338 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.244195 10073 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:26:43.171780 10122 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.262066 10325 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.274219 10207 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.256826 10427 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:43.282639  8362 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:43.287377  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 45109.5us
W20260709 12:26:43.304556  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.307816 10241 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.308188  8362 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.308980 10241 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.309417  8362 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.310135 10241 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.310513  8362 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.281510 10338 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.311685 10241 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.311883 10338 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.311291  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.314043 10338 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.316213  8362 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.317648  8362 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.282749 10371 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.286618 10333 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:43.288940 10207 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:43.288511 10325 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:43.289350 10427 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:43.329790 10196 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:43.334313 10386 raft_consensus.cc:993] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:43.334766  8537 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:43.335709  8362 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.325465 10207 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.338229 10382 consensus_queue.cc:1059] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:43.340000  8362 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.341756 10241 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.342401 10427 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:43.325558 10325 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.343511  8362 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:43.343871 10427 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.346843 10329 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.342413 10241 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:43.334779 10386 raft_consensus.cc:1081] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:43.347865 10333 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:43.350602 10290 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:43.351083 10290 raft_consensus.cc:697] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:43.319383 10164 consensus_queue.cc:237] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.352304 10211 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.351974 10290 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:43.354084 10438 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:26:43.321273 10244 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:43.364892  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.366463  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.368045  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.337494 10196 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.364207  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.370172  8467 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:43.379208  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.380031  8391 raft_consensus.cc:2393] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:43.380832  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.381727  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.383239  8395 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:43.387446  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.365626 10241 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:43.421046 10241 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:26:43.423097  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.390404  8543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49270
I20260709 12:26:43.359594 10278 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.433535  9043 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:43.463366  8545 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:26:43.524909  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 264032us
I20260709 12:26:43.527704  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.527101  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.456866  9044 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:43.528828  8395 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:43.524537 10306 consensus_meta.cc:287] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.591s	user 0.011s	sys 0.000s
I20260709 12:26:43.525067 10329 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.460090 10422 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:26:43.534260  8512 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.530997 10456 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.542230  8512 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.542965 10330 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.542188 10329 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.547508 10329 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.524868 10207 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.555073 10330 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.556200  8469 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.556463  8395 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.565375 10211 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:43.568794  8538 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:43.569478  8543 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:43.569872  8543 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.572098 10211 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.574246 10211 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.575374 10244 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:43.575896 10244 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.577900 10244 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.582011  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.539872 10293 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.585330  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.586459  8396 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:43.590606 10073 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:43.553294 10456 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.563265 10325 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.602818  8543 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.607688 10011 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.608299 10207 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.610173 10456 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.588213 10435 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.610985 10305 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:43.612227 10435 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.613878  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.614670  8467 raft_consensus.cc:2410] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:26:43.614943 10293 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.616730  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.617256  8467 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.627031 10241 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.629513 10384 raft_consensus.cc:3055] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.629901 10384 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:43.630024 10325 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.630681 10384 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:43.633947  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.637517  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.637778  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.638092  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.639559  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.643908  8388 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:43.644264  8470 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.646030  8472 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:43.647143  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:43.647680  8546 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:26:43.648360  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:43.650382  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 108226us
I20260709 12:26:43.650939  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.652369  8465 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:43.653024  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.653573  8464 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:43.657183  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.657927 10384 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.658339  8539 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:43.665462  8512 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.660581  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.682248  8540 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:43.679929 10207 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:26:43.686304  8539 raft_consensus.cc:1275] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:43.691975  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.695197  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.692121 10460 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.662454 10435 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.704344  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.705188  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.705349  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.705958  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.681221 10278 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.661640 10456 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:26:43.706665  8393 raft_consensus.cc:2393] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:43.707877  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.639838 10241 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.667352  8467 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:43.710212  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.712283  8395 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.711310  8471 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:43.712963  8471 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:43.702052  8543 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.711539 10278 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.719436 10278 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.702621 10452 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.753393  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:43.713696  8471 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.753986  8395 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
W20260709 12:26:43.755824  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 145618us
I20260709 12:26:43.754855  8471 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.709259 10460 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:43.755752  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:43.754159  8467 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.761657  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.765621  8393 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.767338  8512 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.770078 10207 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.770253  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.771237 10327 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:43.702430 10244 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:26:43.770578 10207 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.780834 10207 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:43.774982 10455 log.cc:927] Time spent T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.205s	user 0.003s	sys 0.000s
I20260709 12:26:43.784667  8471 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.775308  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:43.775916 10164 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:43.786830 10164 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:43.787732 10164 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.794274 10122 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:43.797866 10333 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:43.798265 10333 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:43.798656 10333 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.779104  8546 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
W20260709 12:26:43.800179 10448 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.260s	user 0.003s	sys 0.000s
I20260709 12:26:43.800298 10207 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.803673 10207 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.804600  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.808511 10241 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:43.809068 10241 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:43.810032 10241 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.811617  8393 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:43.776588  8512 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:43.779541 10460 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:43.814571 10460 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.819610 10278 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:43.819973 10278 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.820287 10278 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.820904  8396 raft_consensus.cc:2410] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:26:43.822031  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 111051us
I20260709 12:26:43.814595  8388 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 5. Ops: []
I20260709 12:26:43.813445 10337 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:43.825443  8391 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:43.828388 10427 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:43.829447  8362 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.829772 10427 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:43.830571 10293 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.832755 10278 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.834789 10278 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:43.813513 10333 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:43.837975  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61476.3us
I20260709 12:26:43.840333 10333 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:43.840837 10340 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.841944  9047 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:43.844440 10363 raft_consensus.cc:3055] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:43.844825 10363 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:43.845605 10363 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.846675 10363 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.847903  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:43.848790  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:43.849165  8362 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.852195  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:43.852711 10244 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:43.866382  8539 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:43.853724 10424 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:43.857183  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.870960  8469 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:43.863152  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:43.872076  8471 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.867182  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:43.880573  8546 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:43.886799  8469 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:43.895010  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:43.872627 10122 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:43.844646  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.927507  8466 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:26:43.930794  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 86228.2us
I20260709 12:26:43.931663  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:43.932938  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:43.938031  9712 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:43.939527  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.940109  8388 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:43.940987  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.916268 10122 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:43.947485  8396 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:43.917479  8471 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:43.953282  8511 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:43.949385  9712 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:43.960641  9712 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:43.961319 10468 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 12:26:43.965067  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:43.934435 10207 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:43.934535 10325 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:43.937003 10306 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.936094 10164 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:26:43.970520  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:44.037469  8395 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:43.976960  8396 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:43.983783  8293 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.989981  8546 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:44.040660  8293 catalog_manager.cc:5697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:44.042450  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 72006us
W20260709 12:26:43.982980  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:26:44.046491  8282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 63565.9us
I20260709 12:26:44.048806 10122 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:43.985459 10466 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:26:44.054167 10389 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:26:43.977542 10335 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:44.042794  8293 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 4 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:44.063735  8512 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:44.064899  8543 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:26:43.983286 10293 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:44.066612  8293 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.067606  8393 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:44.070338  8293 catalog_manager.cc:5697] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.072466  8293 catalog_manager.cc:5697] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.073904  8293 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 4, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.075592  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:43.977895 10046 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:26:44.056579 10325 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:44.077734  8293 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 5, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.064697 10335 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.008536 10306 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.095594  8471 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:44.056430 10320 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:26:44.089092  8293 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.086604 10384 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:44.083204 10466 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:44.090276 10325 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.106572 10335 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.118117  8293 catalog_manager.cc:5697] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 2 to 4, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.120641 10325 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.125950  8293 catalog_manager.cc:5697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.132465  8293 catalog_manager.cc:5697] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 3, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.122149 10384 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:44.115056 10389 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:26:44.116883 10241 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:26:44.132503 10466 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:44.151613  8511 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:44.134086  8293 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:44.156169  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 45340.4us
I20260709 12:26:44.158641  8293 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 5, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.160349  8293 catalog_manager.cc:5697] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.161690  8293 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.172704  8466 raft_consensus.cc:1275] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:26:44.134613 10456 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:26:44.193148  8293 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.196053  8293 catalog_manager.cc:5697] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.197923  8293 catalog_manager.cc:5697] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 5, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.200304  9048 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Advancing to term 6
I20260709 12:26:44.200728  8293 catalog_manager.cc:5697] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.213725  8293 catalog_manager.cc:5697] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.215473  8293 catalog_manager.cc:5697] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.221807  8293 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 3, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.230896  8293 catalog_manager.cc:5697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 2, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 2 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.194744 10435 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:44.243191  8293 catalog_manager.cc:5697] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 2 to 4, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:44.298745 10467 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:26:44.330335  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 111064us
I20260709 12:26:44.236267 10384 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:44.356575 10481 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:26:44.305044 10466 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.366605 10306 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:44.374090 10484 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:26:44.377633  9047 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:44.393626  9048 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:44.347546 10424 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:44.325793 10485 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.095s
W20260709 12:26:44.458837 10464 raft_consensus.cc:670] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:44.464753  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.465539  8544 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:26:44.408993 10424 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.411065 10325 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.472767  8546 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:26:44.474948  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:44.461220 10435 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:44.471289 10325 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:44.495458 10494 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:26:44.496371 10073 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:44.496654 10424 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.497538 10073 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.497921 10073 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:44.497359 10435 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.506058  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.506654  8546 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:44.509572  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:44.477766 10327 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:26:44.511780 10470 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.547s	user 0.003s	sys 0.006s
I20260709 12:26:44.511989 10244 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:44.474411 10293 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:44.512404 10244 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:26:44.522131  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 47258.9us
I20260709 12:26:44.523808 10490 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:26:44.535030  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 60257.7us
I20260709 12:26:44.518311 10327 consensus_queue.cc:1243] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:26:44.514616 10244 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.541635 10494 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:44.542217 10494 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.518332 10293 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.535857 10490 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.549881 10490 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.551551  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.524384 10499 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:26:44.602837  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 44247.1us
I20260709 12:26:44.603159  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.604931  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:44.605499  8391 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.605589  8392 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:44.607007  8395 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:44.608274  8393 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:44.613981 10502 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:44.614977 10333 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:44.615356 10333 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:44.615984 10503 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:44.616135 10333 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.617393 10333 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.618136 10494 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.619756 10503 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:44.616462  8391 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:44.626474  8540 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:44.610486 10335 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.598518 10293 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.604586 10305 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.625823  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:44.633353  8465 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:44.636256  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.640496 10501 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:44.609030 10499 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.642323  8543 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:26:44.642472 10471 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260709 12:26:44.669225  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:44.650949  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:44.669065  8541 raft_consensus.cc:2393] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:44.612421 10490 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:44.670187  8391 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.673133 10490 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.675091 10490 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.675925 10491 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:44.676430 10491 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.678375 10491 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.678826 10491 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:44.646263 10508 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:26:44.682812 10491 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.686177  8391 raft_consensus.cc:2410] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:26:44.671478 10509 log.cc:927] Time spent T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:26:44.667371 10305 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.679445 10073 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.670184 10492 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:44.653527  8469 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:44.686465  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.647503  8544 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:44.689838  8465 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:26:44.700187  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.690054  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.700883  8472 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:44.670306  8467 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.646656 10293 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:44.666783 10335 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:44.706792  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.707993  8466 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:44.711006  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.699008 10325 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.730360  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.730962  8468 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:44.684716 10244 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.704743 10492 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:44.736411  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.736949 10500 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:44.740343 10321 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:44.748224  8468 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:44.758526  8467 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:44.759209  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.761300  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.684783 10501 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.708923 10293 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.768095  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.774273  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:44.742978 10491 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.774822  8469 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.779745 10501 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.781417 10503 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:44.734573 10325 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.795569  8466 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:44.795833  8469 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:44.829061  8511 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:44.831089  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.797866 10466 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:26:44.834177 10504 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:44.816435 10340 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:26:44.816208 10460 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:26:44.851924 10305 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.852471 10325 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:44.853468 10499 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.856956  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:44.857620  8469 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:44.858841  8511 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:44.871860  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.873848 10011 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:44.874320 10011 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:44.836270 10492 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.855254 10504 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:44.890282 10504 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.888324 10244 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.883613 10011 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:44.863111 10293 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.887338 10503 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:44.904018 10011 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:44.900604 10503 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.929306 10503 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:44.932226 10519 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:44.933743 10377 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.958140 10519 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:44.990082 10519 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:44.996340  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:44.959829 10377 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.020913 10377 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.022817 10503 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:45.024112  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 233908us
I20260709 12:26:45.027963 10424 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.028714 10424 consensus_queue.cc:1243] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:26:45.029151 10503 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:45.029664 10424 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:45.030071 10424 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:45.051633 10424 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.052815 10424 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:45.055147  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.049538 10293 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.078912  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:45.089180  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 92237us
I20260709 12:26:45.091763  8540 raft_consensus.cc:2410] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:26:45.084201 10293 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.099694 10293 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.129436 10507 raft_consensus.cc:1064] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:45.132633 10073 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.133798  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:45.134380  8544 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:45.135545 10507 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:45.140733  8544 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:26:45.147208  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 375807us
I20260709 12:26:45.151593 10429 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:45.152073 10429 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.153146 10337 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:45.153911 10429 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.154412 10429 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:45.154831 10429 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.156304 10422 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:45.156788 10422 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.153673 10337 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:45.166343  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:45.166739  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.167974  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.171033  8464 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:26:45.180260  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.172540  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:45.180583  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:45.181046  8471 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.181340  8466 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:26:45.182581  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 87896.3us
I20260709 12:26:45.183578 10499 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:45.184082 10499 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.185913 10499 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.186305 10196 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.172019  8467 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:26:45.186780 10196 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.174435 10490 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.187852 10490 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.175318 10241 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 2 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.189780 10490 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.180653  8464 pending_rounds.cc:85] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 2
I20260709 12:26:45.190565  8464 pending_rounds.cc:107] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:26:45.190798  8464 raft_consensus.cc:2889] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.174685 10491 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:45.191864 10491 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:45.194446 10491 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:45.197032  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:45.177716 10422 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.178315  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.179113  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:45.179577  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.177008 10337 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:45.197125  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.179638 10318 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:45.199872  8464 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:45.200026 10318 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.191874 10196 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.202023 10318 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.202370  8471 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:45.205047 10429 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.207329  9048 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:45.208774  8543 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:45.210845 10337 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.212141 10504 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.214941  8465 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.231165 10429 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.232071 10429 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.234257  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:45.234786 10429 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.237170  8294 catalog_manager.cc:5697] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 3, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 3 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.240669  8294 catalog_manager.cc:5697] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 2 to 4, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 4 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.241792 10519 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:45.247997 10519 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:45.248888 10519 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:45.249991  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.257206  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.257665  8541 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.257571  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.261632 10495 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:45.263877  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.266891  8546 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:45.268642  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.270087  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.270748  8540 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:26:45.271859  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.274643  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.275369  8545 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:45.276069  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.280258  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.280435  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:45.280964  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.281227 10241 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:45.281980 10241 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:45.282893 10241 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.290788 10495 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:45.296073  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:45.296700  8393 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:26:45.296850  8361 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:45.297693 10429 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.304749 10495 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:45.311434  8511 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:45.314950  8294 catalog_manager.cc:5697] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 2 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.323726  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:45.325521  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:45.326117  8393 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:45.328303 10278 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:45.328814 10278 raft_consensus.cc:697] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:45.329769 10278 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.332455  8393 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:26:45.258602 10545 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:45.344563 10338 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:45.344811  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:45.372526 10545 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.348920  8471 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:45.352939  8464 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:45.353300  8469 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:45.358343  8395 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:45.365012 10323 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 2 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.366861  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:45.368072  8541 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 2 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.320405  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35638 (request call id 188) took 5715 ms. Trace:
I20260709 12:26:45.379522 10335 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.379089 10278 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:45.372644 10338 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:45.383152 10338 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:45.384891  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:45.379454 10504 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:45.400799 10545 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.403659  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.376611  8293 rpcz_store.cc:276] 0709 12:26:39.605010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.605197 (+   187us) service_pool.cc:224] Handling call
0709 12:26:45.320327 (+5715130us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:44.448262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:44.448817 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:44.448860 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:26:44.448878 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:44.450641 (+  1763us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:44.450725 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:44.450752 (+    27us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:26:44.452667 (+  1915us) tablet.cc:701] Row locks acquired
0709 12:26:44.452685 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:44.452840 (+   155us) write_op.cc:270] Start()
0709 12:26:44.452959 (+   119us) write_op.cc:276] Timestamp: P: 1783600004452789 usec, L: 0
0709 12:26:44.452981 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:44.482255 (+ 29274us) log.cc:844] Serialized 9754 byte log entry
0709 12:26:44.851230 (+368975us) op_driver.cc:464] REPLICATION: finished
0709 12:26:44.998400 (+147170us) write_op.cc:301] APPLY: starting
0709 12:26:45.000895 (+  2495us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:45.006596 (+  5701us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:45.006716 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:45.008870 (+  2154us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:45.009078 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 12:26:45.009108 (+    30us) write_op.cc:312] APPLY: finished
0709 12:26:45.009392 (+   284us) log.cc:844] Serialized 169 byte log entry
0709 12:26:45.009551 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.009744 (+   193us) write_op.cc:454] Released schema lock
0709 12:26:45.009802 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:45.010127 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.010155 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":175214,"reported_tablets":42,"spinlock_wait_cycles":7040,"child_traces":[["op",{"apply.queue_time_us":136706,"apply.run_cpu_time_us":4171,"apply.run_wall_time_us":16883,"num_ops":25,"prepare.queue_time_us":137908,"prepare.run_cpu_time_us":14839,"prepare.run_wall_time_us":164638,"raft.queue_time_us":151782,"raft.run_cpu_time_us":30864,"raft.run_wall_time_us":81968,"replication_time_us":398086,"thread_start_us":429826,"threads_started":4,"wal-append.queue_time_us":160105}]]}
I20260709 12:26:45.420780  9048 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 2 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.423468  8388 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:45.440019  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:45.440697  8397 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:45.442225  8397 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:26:45.445657 10545 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:45.446290 10545 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.445993  8295 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 5, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 5 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.450471 10545 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.449963  8295 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 3, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 3 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.451792  8295 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 4 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.453409  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:45.454015  8393 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.456754  8294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 189) took 7750 ms. Trace:
I20260709 12:26:45.456961  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:45.457666  8294 rpcz_store.cc:276] 0709 12:26:37.706296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:37.713174 (+  6878us) service_pool.cc:224] Handling call
0709 12:26:45.456693 (+7743519us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:45.371252 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:45.371994 (+   742us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:45.372030 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:26:45.372048 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:45.372595 (+   547us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:45.372671 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:45.372700 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:45.373010 (+   310us) tablet.cc:701] Row locks acquired
0709 12:26:45.373027 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:45.373158 (+   131us) write_op.cc:270] Start()
0709 12:26:45.373253 (+    95us) write_op.cc:276] Timestamp: P: 1783600005373117 usec, L: 0
0709 12:26:45.373271 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:26:45.373812 (+   541us) log.cc:844] Serialized 1298 byte log entry
0709 12:26:45.395965 (+ 22153us) op_driver.cc:464] REPLICATION: finished
0709 12:26:45.407056 (+ 11091us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b18002f9140. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:26:45.407185 (+   129us) write_op.cc:301] APPLY: starting
0709 12:26:45.407261 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:45.407432 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:45.407453 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:45.407840 (+   387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:45.407987 (+   147us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:26:45.408029 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:45.408223 (+   194us) log.cc:844] Serialized 34 byte log entry
0709 12:26:45.408384 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.408474 (+    90us) write_op.cc:454] Released schema lock
0709 12:26:45.408510 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:45.408855 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.408879 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":353813,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":2058,"apply.run_cpu_time_us":1630,"apply.run_wall_time_us":1630,"num_ops":3,"prepare.queue_time_us":44779,"prepare.run_cpu_time_us":2758,"prepare.run_wall_time_us":15727,"replication_time_us":16277,"spinlock_wait_cycles":14143744,"thread_start_us":49321,"threads_started":1}]]}
I20260709 12:26:45.453253  8295 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 4 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.466830  8295 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 3 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 5 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:45.461549  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.468804  8295 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 5 to 6, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.462939  8388 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:26:45.470785  8388 pending_rounds.cc:85] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 2
I20260709 12:26:45.471652  8388 pending_rounds.cc:107] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:26:45.472810  8388 raft_consensus.cc:2889] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.470726  8295 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 5 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65), now has a pending config: VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65), VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66), VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67), VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } } pending_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.474812  8295 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 4, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.476158  8295 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:45.477517  8295 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 4, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 4 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.478824  8295 catalog_manager.cc:5697] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.501222  8388 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:26:45.507395  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:45.508982  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:45.510783 10470 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.075s	user 0.007s	sys 0.009s
W20260709 12:26:45.511199 10559 log.cc:927] Time spent T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.003s
W20260709 12:26:45.510818 10560 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.005s
I20260709 12:26:45.517946 10545 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:45.519304  8388 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:45.520658  8397 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:26:45.521019  8397 pending_rounds.cc:85] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 2
I20260709 12:26:45.521236  8397 pending_rounds.cc:107] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:26:45.521484  8397 raft_consensus.cc:2889] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:45.528493  8362 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.531677 10545 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:45.532080  8362 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.532769 10545 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.533390  8362 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.534735  8362 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.535379 10545 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.535800  8362 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.536454 10545 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:45.536857  8362 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.537529 10545 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.539139  8393 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:45.541692 10241 raft_consensus.cc:2764] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:26:45.544291  8362 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.545297 10429 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.545786  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.546471 10429 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.546859  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.547552 10429 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.547904  8362 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.548604 10429 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:45.548959 10429 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.549271 10429 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:45.564178  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.566258  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.569728  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.571841  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.575205  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.577275  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.577678  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.577852  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.579622  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.580955 10429 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:45.583031 10429 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:45.584486  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:45.603437  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.604523  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:45.609472  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.609900 10504 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.612988  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:45.612460  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.608162 10211 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:45.621719  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:45.622566  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:45.612994  8292 catalog_manager.cc:5697] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 5, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.628072  8362 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.620375  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:45.629954 10447 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:45.630993  8292 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.632784  8362 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.621358  8438 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.633481  8292 catalog_manager.cc:5697] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.619899 10507 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:45.639324  8362 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.641336 10422 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:45.641727 10429 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:45.640053 10386 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:45.642968  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.643632 10422 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:45.644637  8362 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.623131 10508 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:26:45.631877 10164 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:45.646091  8362 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.646924 10422 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:45.647845  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.627882 10335 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:26:45.649317 10318 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.637377 10494 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.628796 10503 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:26:45.636094  8292 catalog_manager.cc:5697] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.653963  8292 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 3 to 6, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.655355  8292 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 3 to 6, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.656757  8292 catalog_manager.cc:5697] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 4, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 4 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.651703  8362 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.659860  8292 catalog_manager.cc:5697] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 3, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 3 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.662961  8362 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.665210 10422 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:45.665882 10422 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:45.667780  8362 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.664378  8292 catalog_manager.cc:5697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.670054  8292 catalog_manager.cc:5697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.671823  8292 catalog_manager.cc:5697] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 4, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 4 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.673756  8292 catalog_manager.cc:5697] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 2 to 5, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.675500  8362 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.676014 10494 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:45.676661 10494 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:45.650946 10495 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:26:45.693872  8292 catalog_manager.cc:5697] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:45.706707  8395 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:26:45.747617  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 118760us
I20260709 12:26:45.756115  8395 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 2 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.759938 10338 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:26:45.766364 10278 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:45.746688 10507 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:26:45.834816 10196 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:45.861411  8541 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:26:45.865010 10500 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:26:45.887176  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51748.6us
I20260709 12:26:45.892922  8295 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65), VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66), VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67), VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.894873  8295 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 2 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:45.852867  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:45.953177  8464 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:45.974956  8464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158edb8122f9489398444d919f25cbce"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:45.975675  8464 raft_consensus.cc:606] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:45.976064  8464 raft_consensus.cc:614] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:45.978910  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:45.979501  8469 raft_consensus.cc:606] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:45.983731  8464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e001ede544f519292071c2eeb41fb"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:45.984257  8464 raft_consensus.cc:606] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:45.984560  8464 raft_consensus.cc:614] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:45.987093  8388 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:26:45.996414  8464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:45.997032  8464 raft_consensus.cc:606] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:46.003613  8464 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:46.004204  8464 raft_consensus.cc:606] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:46.006762  8395 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:46.009292  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:46.010396  8540 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:46.019047 10519 raft_consensus.cc:993] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:46.019618 10323 raft_consensus.cc:1081] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:46.021329  8540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49270
I20260709 12:26:46.021972  8540 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.022349  8540 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:46.029106  8469 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:46.032193 10570 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:46.031683 10207 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:26:46.041298 10447 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:46.041805 10447 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:46.042654 10447 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.043973 10447 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:46.049382  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:46.050207  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.029603  8540 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.055622  8293 catalog_manager.cc:5697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 2 to 5, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:26:46.057345  8540 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:46.057526  8293 catalog_manager.cc:5697] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.064877 10545 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:46.066778 10207 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:46.075964  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:46.076838  8469 raft_consensus.cc:3055] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:46.077174  8469 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:46.077989  8469 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.080050  8469 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:46.088312 10500 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.088943 10500 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.090907 10500 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:46.092474  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:46.093093  8540 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:46.094194  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:46.094995 10500 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:46.095620 10500 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.097492 10500 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:46.098696 10207 raft_consensus.cc:476] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:26:46.090834  8293 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.106604  8293 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.108349  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:46.108179  8293 catalog_manager.cc:5697] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 5, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.108920  8395 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:46.109737  8293 catalog_manager.cc:5697] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.111866  8293 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.118345 10545 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:46.118984  8292 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 226) took 1068 ms. Trace:
I20260709 12:26:46.121791  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:46.122928  8469 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:46.123831  8293 catalog_manager.cc:5697] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 2 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.125362  8511 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:46.129719 10569 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:46.130182 10569 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:46.130959 10569 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.137929 10211 raft_consensus.cc:993] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:46.138964 10211 raft_consensus.cc:1081] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:46.143817  8392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:46.144390  8392 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.144732  8392 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.125325  8293 catalog_manager.cc:5697] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.138137  8395 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:46.150300  8293 catalog_manager.cc:5697] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 2 to 4, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 4 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.119364  8292 rpcz_store.cc:276] 0709 12:26:45.050547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.050693 (+   146us) service_pool.cc:224] Handling call
0709 12:26:46.118901 (+1068208us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:45.763931 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:45.764529 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:45.764572 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:26:45.764596 (+    24us) tablet.cc:662] Decoding operations
0709 12:26:45.765722 (+  1126us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:45.765795 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:45.765820 (+    25us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:26:45.766843 (+  1023us) tablet.cc:701] Row locks acquired
0709 12:26:45.766862 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:45.766997 (+   135us) write_op.cc:270] Start()
0709 12:26:45.767102 (+   105us) write_op.cc:276] Timestamp: P: 1783600005766954 usec, L: 0
0709 12:26:45.767118 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:26:45.804772 (+ 37654us) log.cc:844] Serialized 5115 byte log entry
0709 12:26:45.807293 (+  2521us) op_driver.cc:464] REPLICATION: finished
0709 12:26:45.807864 (+   571us) write_op.cc:301] APPLY: starting
0709 12:26:45.807959 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:45.808230 (+   271us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:45.808326 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:45.809383 (+  1057us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:45.809629 (+   246us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 12:26:45.809676 (+    47us) write_op.cc:312] APPLY: finished
0709 12:26:45.810008 (+   332us) log.cc:844] Serialized 94 byte log entry
0709 12:26:45.810169 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.810323 (+   154us) write_op.cc:454] Released schema lock
0709 12:26:45.810374 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:45.886672 (+ 76298us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464384e28 00007f6467dbf581 00007f6467dbed58 00007f6467dc39f1 00007f6467dc39a9 00007f6467dc3939 00007f6467dc3901 00007f6467dc2b2d 0000000000388634 0000000000388479
0709 12:26:45.886908 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.886937 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":122613,"reported_tablets":51,"spinlock_wait_cycles":2944,"child_traces":[["op",{"apply.queue_time_us":347,"apply.run_cpu_time_us":2809,"apply.run_wall_time_us":2809,"num_ops":13,"prepare.queue_time_us":2048,"prepare.run_cpu_time_us":7092,"prepare.run_wall_time_us":122908,"replication_time_us":40006,"spinlock_wait_cycles":9712896}]]}
I20260709 12:26:46.158793  8392 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.165518  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:46.165824  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:46.166064  8469 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:46.166373  8540 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.165655  8392 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:46.166422  8469 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:46.173739  8469 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.174885  8469 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.180024  8540 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:46.181125  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:46.183274  8469 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:46.199577 10196 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:46.200116 10196 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:46.200981 10196 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.196386 10500 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.244345 10500 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:46.340606  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:46.371225  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:46.372025  8540 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:46.394310 10323 raft_consensus.cc:993] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:46.395102 10323 raft_consensus.cc:1081] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:46.397505  8540 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:46.397547  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49270
I20260709 12:26:46.398947  8541 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.399420  8541 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.402580  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:46.407651  8294 catalog_manager.cc:5697] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.421908 10382 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:46.422662 10382 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:46.424062 10382 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.436748  8541 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.439072  8541 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:46.439872  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:46.440641  8397 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.441340  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:46.441906  8471 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:46.442193  8471 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:46.443187  8471 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.444710  8471 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:46.448916  8397 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:46.450455  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:46.451900 10335 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:46.452499 10335 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:46.453747 10335 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.464234  8471 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:46.584826  8292 catalog_manager.cc:5697] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.604223  8294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35638 (request call id 189) took 1060 ms. Trace:
I20260709 12:26:46.607353  8469 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:46.604781  8294 rpcz_store.cc:276] 0709 12:26:45.544260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:45.544415 (+   155us) service_pool.cc:224] Handling call
0709 12:26:46.604147 (+1059732us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:46.482291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:46.483129 (+   838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:46.483194 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:26:46.483246 (+    52us) tablet.cc:662] Decoding operations
0709 12:26:46.483841 (+   595us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:46.483948 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:46.483986 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:46.484330 (+   344us) tablet.cc:701] Row locks acquired
0709 12:26:46.484381 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:26:46.484612 (+   231us) write_op.cc:270] Start()
0709 12:26:46.484782 (+   170us) write_op.cc:276] Timestamp: P: 1783600006484541 usec, L: 0
0709 12:26:46.484824 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:26:46.485606 (+   782us) log.cc:844] Serialized 534 byte log entry
0709 12:26:46.490220 (+  4614us) op_driver.cc:464] REPLICATION: finished
0709 12:26:46.490765 (+   545us) write_op.cc:301] APPLY: starting
0709 12:26:46.490896 (+   131us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:46.491033 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:46.491161 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:46.491432 (+   271us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:46.491717 (+   285us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:26:46.491789 (+    72us) write_op.cc:312] APPLY: finished
0709 12:26:46.492109 (+   320us) log.cc:844] Serialized 22 byte log entry
0709 12:26:46.492312 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:46.492400 (+    88us) write_op.cc:454] Released schema lock
0709 12:26:46.493035 (+   635us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:46.493427 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:46.493456 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116032,"reported_tablets":44,"spinlock_wait_cycles":11776,"child_traces":[["op",{"apply.queue_time_us":190,"apply.run_cpu_time_us":2112,"apply.run_wall_time_us":2659,"num_ops":1,"prepare.queue_time_us":34744,"prepare.run_cpu_time_us":3904,"prepare.run_wall_time_us":8611,"replication_time_us":5187,"spinlock_wait_cycles":621824}]]}
I20260709 12:26:46.625515  8293 catalog_manager.cc:5697] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 5 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.635388  8471 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:46.638055  8391 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:46.638715  9048 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:46.640625 10335 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:46.641983 10508 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:46.644320  8293 catalog_manager.cc:5697] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.646287  8541 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:46.647962 10424 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:46.656673 10382 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:46.658335  8541 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:46.660781 10494 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:46.648231  8391 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:46.672900 10507 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:26:46.688128  8281 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 2d99fb7f1afb4c958cdc302eb8ef165f from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:46.691608  9048 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:46.704983  8281 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fea9eaca8b50473cb6788b0928b3f8c4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:46.720713  9048 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:26:46.722110 10424 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:46.724319  8471 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:26:46.727758 10424 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:46.742355  8464 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:46.744222 10335 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:46.746574 10494 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:46.778360  9044 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:46.779819  8464 raft_consensus.cc:2955] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:46.787840  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7de1dd05702461da4c0319fda01a7ca with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:46.812644  8294 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.846521 10494 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:46.870386  8544 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:46.872346 10508 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:46.875578 10494 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:46.877844 10494 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:46.892272 10589 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 12:26:46.908812  8292 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.906733  8295 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 7 to 8, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:26:46.954952  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 54021.8us
I20260709 12:26:46.956872  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:46.958679  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 60987.7us
I20260709 12:26:46.960222  8395 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:46.967057  8541 raft_consensus.cc:2955] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 7 to 8, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:46.987890 10569 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:46.994753  8385 tablet_service.cc:1558] Processing DeleteTablet for tablet fea9eaca8b50473cb6788b0928b3f8c4 with delete_type TABLET_DATA_TOMBSTONED (TS 21c151c99bcf4cbeb819de06e68d95bf not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:60370
I20260709 12:26:46.995258  8294 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 6 to 7, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:47.031776 10606 tablet_replica.cc:333] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:26:47.033674 10606 raft_consensus.cc:2243] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.034989 10606 raft_consensus.cc:2272] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.045945 10606 ts_tablet_manager.cc:1916] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:47.053722  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet f7de1dd05702461da4c0319fda01a7ca with delete_type TABLET_DATA_TOMBSTONED (TS aef8c9f023564378a04e3e1e6171930d not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:47.071641  8469 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:47.077039 10606 ts_tablet_manager.cc:1929] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 12:26:47.079233  8391 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:26:47.099125  8391 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:47.102641 10606 log.cc:1199] T fea9eaca8b50473cb6788b0928b3f8c4 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/wals/fea9eaca8b50473cb6788b0928b3f8c4
I20260709 12:26:47.084753  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:47.105861 10382 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:47.107614  8282 catalog_manager.cc:5028] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): tablet fea9eaca8b50473cb6788b0928b3f8c4 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:47.128660 10612 tablet_replica.cc:333] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:26:47.134282 10612 raft_consensus.cc:2243] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:47.134749 10602 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:47.135133 10612 raft_consensus.cc:2272] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:47.138224 10612 ts_tablet_manager.cc:1916] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:47.146389  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:47.174088 10599 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:47.188329 10612 ts_tablet_manager.cc:1929] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 12:26:47.188763 10612 log.cc:1199] T f7de1dd05702461da4c0319fda01a7ca P aef8c9f023564378a04e3e1e6171930d: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/wals/f7de1dd05702461da4c0319fda01a7ca
I20260709 12:26:47.190320  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet f7de1dd05702461da4c0319fda01a7ca (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:47.226217 10424 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.226743 10424 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.228610 10424 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:47.229152  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:47.230428  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:47.231082  8541 raft_consensus.cc:2410] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:26:47.232002  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:47.232537 10424 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:47.539352 10322 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:47.543066 10322 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.545099 10322 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:47.546792  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:47.547528  8397 raft_consensus.cc:2393] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:47.547569  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:47.548242  8539 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:47.549181  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:47.549968 10382 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:47.550333 10382 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:47.550704 10382 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:47.557715 10382 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.559727 10382 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:47.560604  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:47.562323  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:47.563017  8397 raft_consensus.cc:2393] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:47.569763  8539 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:47.571452  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:47.572114 10382 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:47.572598 10382 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:47.573608 10382 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.584836  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:47.589236  8293 catalog_manager.cc:5697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.647013  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:47.647706  8469 raft_consensus.cc:606] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:47.650705  8539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:26:47.651258  8539 raft_consensus.cc:606] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:47.654115  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:47.654716  8469 raft_consensus.cc:606] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:47.659571  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:47.660156  8469 raft_consensus.cc:606] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:47.663100 10322 raft_consensus.cc:993] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.663969 10507 raft_consensus.cc:1081] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.664319  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12c64e413ad46968034a527b5290316"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:47.664901  8469 raft_consensus.cc:606] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:47.665683  8397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:47.666117  8397 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.666373  8397 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.669612  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:47.670171  8469 raft_consensus.cc:606] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:47.671398  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:47.673188  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:47.674125  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:47.676008  8397 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.678328  8397 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:47.679261  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:47.683511  8539 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.695748  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:47.696903  8469 raft_consensus.cc:3055] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:47.697257  8469 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:47.698014  8469 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.699215  8469 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:47.703509  8539 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:47.704515  8361 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:47.705314 10599 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:47.705802 10599 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:47.706660 10599 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.720479  8469 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:47.741137 10382 raft_consensus.cc:993] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.741600 10322 raft_consensus.cc:1081] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.743196  8397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:47.743714  8397 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.744048  8397 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:47.750321  8397 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.752236  8397 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:47.753469  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:47.753989  8541 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:47.752323  8293 catalog_manager.cc:5697] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 3 to 4, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 4 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.762362  8541 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:26:47.763161  8361 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:47.764093 10599 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:47.764545 10599 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:47.765659 10599 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.785862  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:47.788028  8469 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:47.788343  8469 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:47.789072  8469 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.790246  8469 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:47.792476  8293 catalog_manager.cc:5697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 8 to 9, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 9 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.802300  8469 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:26:47.805354 10382 raft_consensus.cc:993] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.805840 10322 raft_consensus.cc:1081] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.807124  8397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d12c64e413ad46968034a527b5290316"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:47.807596  8397 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.807898  8397 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:47.812530  8397 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.813952  8397 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:47.815083  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:47.815665  8541 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:47.816368  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:47.817183  8469 raft_consensus.cc:3055] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:47.817471  8469 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:47.818086  8469 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.819209  8469 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:47.822880  8541 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:47.823908  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:47.824627 10621 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:47.825070 10621 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:47.825503  8469 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:47.825903 10621 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.837705  8293 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.975157 10447 raft_consensus.cc:993] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.975720 10603 raft_consensus.cc:1081] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:47.977145  8397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60394
I20260709 12:26:47.977670  8397 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.978047  8397 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:47.984364  8397 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.986172  8397 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:47.987366  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:47.987957  8469 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:47.988597  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:47.989121  8541 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:47.989408  8541 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:47.990011  8541 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:47.991240  8541 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:48.000200  8469 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:48.002203  8362 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:48.003000 10621 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:48.003306  8541 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:48.003490 10621 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:48.004374 10621 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:48.013990  8293 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.047958 10507 raft_consensus.cc:993] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:48.048418 10507 raft_consensus.cc:1081] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:48.050112  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49270
I20260709 12:26:48.050640  8541 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.051900  8541 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.062476  8541 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:48.066061  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:48.066406  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:48.066633  9044 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.066959  8469 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:48.067790  8541 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:48.067242  8469 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:48.069000  8469 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:48.070148  8469 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.076300  9044 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:26:48.079056  8510 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:48.080508 10447 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:48.080984 10447 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:48.081936 10447 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:48.089061  8469 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:26:48.106383 10382 raft_consensus.cc:993] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:48.106909 10322 raft_consensus.cc:1081] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:48.108521  8397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:48.109073  8397 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:48.109416  8397 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.111992  8293 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 6 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.115626  8392 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:48.117412 10322 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:48.121672  8397 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:48.125622  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:48.126154  8541 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.135049  8541 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:48.136318  8361 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:48.137183 10599 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:48.137645 10599 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:48.137982  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:48.138561  8469 raft_consensus.cc:3055] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:48.138499 10599 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:48.139031  8469 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:48.138451  8397 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:48.146082  8469 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:48.147033  8469 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:48.154018  8541 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:26:48.155534 10599 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:48.156975  8469 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:48.170872  8469 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:26:48.171325  8540 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:48.172791 10382 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:48.173379 10599 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:26:48.211862  8464 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:48.213263 10621 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:48.230113  8293 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.235332  8464 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:48.237996 10599 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:48.250429  8544 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:48.251685 10621 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:48.247400  8541 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:48.284464  8397 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:48.281881 10621 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:26:48.337121  8469 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:48.338613 10424 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:26:48.367990  8361 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 15e2fa2b1330485fb8fbc9b08f54955b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:48.372136  8539 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:26:48.382663 10641 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:48.375994 10643 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.400813  8543 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:48.406862  8464 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.410960  8293 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:48.428471  8510 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a26f17e57344b8bba537d4b071c49be. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:48.429019  8471 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:48.430737 10626 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:48.433787  8392 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:48.435176 10626 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:48.448299  8539 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.451565 10625 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.452873  8397 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.458335  8471 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.479027  8471 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:48.489090  8294 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.501145  8464 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:48.510176  8539 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:26:48.510538  8436 consensus_peers.cc:597] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88ee35c47e0d403393cb03f68a432b98. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:48.511674 10322 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:48.514274  8392 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:48.518157 10382 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:48.512259 10643 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:26:48.531070  8540 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:48.532677 10599 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:48.542469 10507 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.559602  8392 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.586639  8469 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:48.612529  8471 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:48.620545  8397 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:48.628297 10626 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:48.628865 10657 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:48.630666  8539 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:48.636838  8469 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:48.647393 10599 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:26:48.652595 10643 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:48.662014  8294 catalog_manager.cc:5697] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:26:48.666353  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 102340us
I20260709 12:26:48.681411  8544 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:26:48.723430  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:48.768190  8539 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.777781 10662 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.784199  8397 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:26:48.787649  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49981.4us
I20260709 12:26:48.789531  9044 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:26:48.795369 10654 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:48.796821 10664 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:26:48.819305  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 51328.5us
I20260709 12:26:48.832748  8294 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:48.835704  8436 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 23e95bddd5b14e1b8e7f5bfe7a8f8392. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:48.839797  8281 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 2d99fb7f1afb4c958cdc302eb8ef165f from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:48.866770  8539 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:48.946735 10672 ts_tablet_manager.cc:933] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:48.967825 10674 ts_tablet_manager.cc:933] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:48.969283 10672 tablet_copy_client.cc:323] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:26:48.971292  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet 2a26f17e57344b8bba537d4b071c49be from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:26:48.971860  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet 2a26f17e57344b8bba537d4b071c49be from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-2a26f17e57344b8bba537d4b071c49be
I20260709 12:26:48.982728 10675 ts_tablet_manager.cc:933] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:48.983461 10674 tablet_copy_client.cc:323] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:48.983886  8471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:48.986071  8471 raft_consensus.cc:606] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:48.986341  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet 15e2fa2b1330485fb8fbc9b08f54955b from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:48.986876  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet 15e2fa2b1330485fb8fbc9b08f54955b from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-15e2fa2b1330485fb8fbc9b08f54955b
I20260709 12:26:48.989791  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "145eb7997c78480db629215c6acac8ef"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:48.990362  8469 raft_consensus.cc:606] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:48.992779  8556 tablet_copy_source_session.cc:215] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:48.994831  8539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabecae7023948069d48a04cefe25522"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:26:48.995373  8539 raft_consensus.cc:606] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:48.996603 10672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a26f17e57344b8bba537d4b071c49be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:48.998867  8407 tablet_copy_source_session.cc:215] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:49.002388 10674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e2fa2b1330485fb8fbc9b08f54955b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:49.009559  8471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:49.010210  8471 raft_consensus.cc:606] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:49.011474  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:49.013087  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:49.013840  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:49.014163 10675 tablet_copy_client.cc:323] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.66:41641
I20260709 12:26:49.016044  8482 tablet_copy_service.cc:140] P 2d99fb7f1afb4c958cdc302eb8ef165f: Received BeginTabletCopySession request for tablet 88ee35c47e0d403393cb03f68a432b98 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:59088)
I20260709 12:26:49.016551  8482 tablet_copy_service.cc:161] P 2d99fb7f1afb4c958cdc302eb8ef165f: Beginning new tablet copy session on tablet 88ee35c47e0d403393cb03f68a432b98 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:59088: session id = e3660d999c0a41658a1f1dbe7cc90746-88ee35c47e0d403393cb03f68a432b98
I20260709 12:26:49.025987 10657 raft_consensus.cc:993] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:49.026497 10507 raft_consensus.cc:1081] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:49.027051  8482 tablet_copy_source_session.cc:215] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:49.028254  8397 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "145eb7997c78480db629215c6acac8ef"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:49.028764  8397 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.029094  8397 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.039263 10675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ee35c47e0d403393cb03f68a432b98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:49.041348 10674 tablet_copy_client.cc:806] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:49.041932 10674 tablet_copy_client.cc:670] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:49.050283 10672 tablet_copy_client.cc:806] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:49.050834 10672 tablet_copy_client.cc:670] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:49.051170 10674 tablet_copy_client.cc:538] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:49.057575 10674 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:49.067260  8397 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.068058 10672 tablet_copy_client.cc:538] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:49.070240  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:49.070818  8471 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:49.071136  8471 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:49.071861  8471 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.072785  8397 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:49.073750  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:49.074265  8539 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.075806  8471 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:49.079211 10678 ts_tablet_manager.cc:933] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:49.086874 10663 raft_consensus.cc:993] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: : Instructing follower 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:49.087379 10663 raft_consensus.cc:1081] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Signalling peer 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:49.092643  8469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dabecae7023948069d48a04cefe25522"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:39226
I20260709 12:26:49.093169  8469 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.093530  8469 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.113063  8539 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:49.114321  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:49.114511  8471 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:49.115156 10621 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:49.117748 10621 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:49.118621 10621 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.117255 10672 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:49.126207  8469 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.133603 10675 tablet_copy_client.cc:806] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:49.134193 10675 tablet_copy_client.cc:670] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:49.148901  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:49.153278  8397 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.155508 10675 tablet_copy_client.cc:538] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:49.157793  8293 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.159368  8469 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:49.160389  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:49.160955  8539 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:49.161247  8539 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:49.162156  8397 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:49.163290  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:49.164104 10507 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:49.164780 10507 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:49.165611 10507 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.162082  8539 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.164973 10678 tablet_copy_client.cc:323] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.66:41641
I20260709 12:26:49.171602  8482 tablet_copy_service.cc:140] P 2d99fb7f1afb4c958cdc302eb8ef165f: Received BeginTabletCopySession request for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:59088)
I20260709 12:26:49.172107  8482 tablet_copy_service.cc:161] P 2d99fb7f1afb4c958cdc302eb8ef165f: Beginning new tablet copy session on tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:59088: session id = e3660d999c0a41658a1f1dbe7cc90746-23e95bddd5b14e1b8e7f5bfe7a8f8392
I20260709 12:26:49.178705 10675 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:49.167618  8539 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:49.190939  8539 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:49.198123  8293 catalog_manager.cc:5697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.191155  8482 tablet_copy_source_session.cc:215] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:49.210165 10678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:49.217681 10674 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:49.218747 10674 tablet_bootstrap.cc:492] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:49.219838 10674 ts_tablet_manager.cc:1403] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.162s	user 0.020s	sys 0.015s
I20260709 12:26:49.225142 10672 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:49.235606 10672 tablet_bootstrap.cc:492] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:49.236384 10672 ts_tablet_manager.cc:1403] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.126s	user 0.031s	sys 0.004s
I20260709 12:26:49.245729 10678 tablet_copy_client.cc:806] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:49.246295 10678 tablet_copy_client.cc:670] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:49.254215 10678 tablet_copy_client.cc:538] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:49.256681 10674 raft_consensus.cc:359] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.258600 10674 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:49.259298 10674 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.261169 10672 raft_consensus.cc:359] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.262172 10672 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:49.269111 10672 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.272063 10674 ts_tablet_manager.cc:1434] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:26:49.273897  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-15e2fa2b1330485fb8fbc9b08f54955b received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:49.274358  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-15e2fa2b1330485fb8fbc9b08f54955b on tablet 15e2fa2b1330485fb8fbc9b08f54955b with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:49.284819 10672 ts_tablet_manager.cc:1434] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:26:49.286521  8556 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-2a26f17e57344b8bba537d4b071c49be received from {username='slave'} at 127.0.0.1:58406
I20260709 12:26:49.286962  8556 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-2a26f17e57344b8bba537d4b071c49be on tablet 2a26f17e57344b8bba537d4b071c49be with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:49.290571 10678 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:49.299197 10675 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:49.300181 10675 tablet_bootstrap.cc:492] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:49.300925 10675 ts_tablet_manager.cc:1403] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.122s	user 0.034s	sys 0.020s
I20260709 12:26:49.303980 10675 raft_consensus.cc:359] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.304839 10675 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:49.305720 10675 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.310737 10675 ts_tablet_manager.cc:1434] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:26:49.312414  8482 tablet_copy_service.cc:342] P 2d99fb7f1afb4c958cdc302eb8ef165f: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-88ee35c47e0d403393cb03f68a432b98 received from {username='slave'} at 127.0.0.1:59088
I20260709 12:26:49.312841  8482 tablet_copy_service.cc:434] P 2d99fb7f1afb4c958cdc302eb8ef165f: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-88ee35c47e0d403393cb03f68a432b98 on tablet 88ee35c47e0d403393cb03f68a432b98 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:49.335398 10678 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:49.336365 10678 tablet_bootstrap.cc:492] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:49.337080 10678 ts_tablet_manager.cc:1403] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.055s	user 0.027s	sys 0.000s
I20260709 12:26:49.340054 10678 raft_consensus.cc:359] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.340876 10678 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:49.341497 10678 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:49.343875 10678 ts_tablet_manager.cc:1434] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:26:49.345798  8482 tablet_copy_service.cc:342] P 2d99fb7f1afb4c958cdc302eb8ef165f: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-23e95bddd5b14e1b8e7f5bfe7a8f8392 received from {username='slave'} at 127.0.0.1:59088
I20260709 12:26:49.346210  8482 tablet_copy_service.cc:434] P 2d99fb7f1afb4c958cdc302eb8ef165f: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-23e95bddd5b14e1b8e7f5bfe7a8f8392 on tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:49.395363 10662 raft_consensus.cc:993] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:49.395905 10662 raft_consensus.cc:1081] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:49.401081  8544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49270
I20260709 12:26:49.401623  8544 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.402004  8544 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.409179 10662 raft_consensus.cc:993] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:49.409705 10662 raft_consensus.cc:1081] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:49.414902  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:49.415376  8393 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.415707  8393 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:49.417339  8544 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.420054  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:49.420574  8397 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.429486  9044 raft_consensus.cc:1217] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:26:49.437286  9044 raft_consensus.cc:1217] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:26:49.457573  8544 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:49.462675  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:49.463282  8469 raft_consensus.cc:3055] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:49.463599  8469 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:49.464304  8469 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.476281  8469 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:49.433665  8397 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:49.477053  8393 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.480490  8512 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:49.490804 10626 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:26:49.487021  8469 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:49.492168  8393 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:49.492905  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:49.493468  8544 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:49.492864 10626 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:49.492578  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:49.495733  8469 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:49.496101  8469 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:49.495652 10626 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.496865  8469 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.499876  8544 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:49.501063  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:49.502139 10621 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:49.502619 10621 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:49.503494 10621 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:49.506227  9044 raft_consensus.cc:1217] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 12:26:49.500177  8469 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:49.516458  8469 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:49.523346  8295 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 3 to 4, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 4 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:49.530638  8293 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.599520  9044 raft_consensus.cc:1217] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 12:26:49.602191  8469 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:49.606576 10689 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:49.613051  8539 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:49.616256 10689 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:49.741406  8539 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:49.742882 10507 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:49.761132  8393 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:49.764580 10655 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:49.893206  8469 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:49.895112  8392 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:26:49.895579 10664 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:49.899171 10625 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:26:49.921761 10662 raft_consensus.cc:1064] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:49.924417 10662 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:49.932703 10507 raft_consensus.cc:1064] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:49.944242 10507 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:49.993633  8469 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:49.995003 10693 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:50.031920  8539 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:50.033511 10693 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:50.094064 10625 raft_consensus.cc:1064] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:50.096587 10625 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:50.107725  9044 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:50.110502  8539 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:50.112794 10705 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:50.114858 10705 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:50.124547  9048 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:50.126786  8544 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:50.129165 10704 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:50.131302 10704 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:50.138816  8392 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:50.139546  9048 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:50.140981 10663 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:50.149204  8392 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:26:50.151768  8392 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:50.153120 10625 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:50.167693 10700 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:50.171130 10657 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:26:50.179347 10664 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.185747  8393 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.189077  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:50.206982  8469 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:26:50.213176 10641 raft_consensus.cc:1064] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:50.216570 10641 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:50.228799 10625 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:50.254266  8469 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.269742 10705 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.271076  8543 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.288502  9048 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:50.289772 10689 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:50.290434  8544 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:50.291908 10718 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:50.301141  9048 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.305371  8471 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:26:50.312021  8293 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.317778 10693 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:50.339322  8295 catalog_manager.cc:5697] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.351040 10705 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.352566  8543 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.357283  9043 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.385823  9048 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.396144  8391 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.407044  8392 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.418365 10641 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.424635  8543 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.528777  8294 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 3 to 4, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } attrs { replace: true } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.532302  9048 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.535691  8471 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:50.429188  8467 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.548163  9043 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:50.551549  8543 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:50.552747 10700 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:50.557592 10662 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:50.574368  8541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "158edb8122f9489398444d919f25cbce"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:26:50.574999  8541 raft_consensus.cc:606] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:50.582302  8467 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "225b79a42b074c48a583a96802a0f532"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:50.582856  8467 raft_consensus.cc:606] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:50.588619  8294 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.593444 10707 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.595183 10708 raft_consensus.cc:993] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:50.595677 10708 raft_consensus.cc:1081] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:50.600831  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "225b79a42b074c48a583a96802a0f532"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:50.601336  8393 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:50.601655  8393 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.609230  8392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:50.609845  8392 raft_consensus.cc:606] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:50.611194  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:50.611481  8393 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:50.613631  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:50.614379  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:50.610039  9048 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.619181  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:50.619745  8464 raft_consensus.cc:3055] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:50.620030  8464 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:50.620738  8464 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:50.621743  8464 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.626108  8393 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:50.632604  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:50.633173  8543 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:50.640452  8464 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:50.645424  8393 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:50.651577  9043 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:50.654943 10718 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:50.657311  8541 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:50.660843 10599 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:50.664536 10718 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.665692  9043 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.677778  8544 raft_consensus.cc:2955] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.693625  8540 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:50.705149  9047 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:50.706578  8281 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88ee35c47e0d403393cb03f68a432b98 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:50.713640 10625 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:50.716841  8471 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:50.724184 10626 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.731894  9047 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:50.732265  9044 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.705224  8295 catalog_manager.cc:5697] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 4 to 5, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:50.735901 10657 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:50.747529  8282 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 15e2fa2b1330485fb8fbc9b08f54955b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:50.750885  8397 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:26:50.750993  8362 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:50.752112 10689 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:50.752591 10689 raft_consensus.cc:697] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:50.753405 10689 consensus_queue.cc:237] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:50.760669 10657 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:50.639302  8543 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:50.742226  8293 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:50.775547  8541 raft_consensus.cc:2955] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.795149 10700 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.797580  8393 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.837421  8458 tablet_service.cc:1558] Processing DeleteTablet for tablet 15e2fa2b1330485fb8fbc9b08f54955b with delete_type TABLET_DATA_TOMBSTONED (TS 2d99fb7f1afb4c958cdc302eb8ef165f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:50.838483  8385 tablet_service.cc:1558] Processing DeleteTablet for tablet 88ee35c47e0d403393cb03f68a432b98 with delete_type TABLET_DATA_TOMBSTONED (TS 21c151c99bcf4cbeb819de06e68d95bf not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:60370
I20260709 12:26:50.841499  8280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2a26f17e57344b8bba537d4b071c49be with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:50.843655  8392 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:50.844594  8281 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:26:50.849689  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 63838.1us
I20260709 12:26:50.856194  9043 raft_consensus.cc:2955] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.857415  8294 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.864714 10626 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:50.853219  8293 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 4 to 5, VOTER aef8c9f023564378a04e3e1e6171930d (127.7.23.67) evicted. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:50.876760  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 96696.4us
I20260709 12:26:50.877393  8391 raft_consensus.cc:2955] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:50.883648 10734 tablet_replica.cc:333] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:26:50.884521 10735 tablet_replica.cc:333] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:26:50.885914  8458 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a26f17e57344b8bba537d4b071c49be with delete_type TABLET_DATA_TOMBSTONED (TS 2d99fb7f1afb4c958cdc302eb8ef165f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:39212
I20260709 12:26:50.889833  8292 catalog_manager.cc:5697] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.887341 10734 raft_consensus.cc:2243] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.903832 10734 raft_consensus.cc:2272] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.905773 10730 raft_consensus.cc:993] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: : Instructing follower 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:50.906266 10730 raft_consensus.cc:1081] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Signalling peer 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:50.908649 10734 ts_tablet_manager.cc:1916] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:50.921444  8528 tablet_service.cc:1558] Processing DeleteTablet for tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 with delete_type TABLET_DATA_TOMBSTONED (TS aef8c9f023564378a04e3e1e6171930d not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49264
I20260709 12:26:50.927876 10735 raft_consensus.cc:2243] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.928829 10735 raft_consensus.cc:2272] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.932104 10735 ts_tablet_manager.cc:1916] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:50.939078  8471 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "158edb8122f9489398444d919f25cbce"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:39226
I20260709 12:26:50.939680  8471 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:50.940039  8471 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.949195  8471 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:50.951587  8471 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:50.952484  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:50.953109  8543 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:50.953424  8543 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:50.954864  8543 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:50.956103  8543 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.957564  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:50.958134  8391 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:50.973196  8391 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:26:50.978078 10736 tablet_replica.cc:333] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:26:50.978701  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:50.979389 10736 raft_consensus.cc:2243] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:50.979601 10655 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:50.980144 10655 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:50.973114  8543 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:26:50.980919 10655 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:50.982666 10736 raft_consensus.cc:2272] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:50.995622 10736 ts_tablet_manager.cc:1916] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:50.998481 10734 ts_tablet_manager.cc:1929] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:26:50.999002 10734 log.cc:1199] T 15e2fa2b1330485fb8fbc9b08f54955b P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/wals/15e2fa2b1330485fb8fbc9b08f54955b
I20260709 12:26:51.002326 10734 tablet_replica.cc:333] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:26:51.002758  8281 catalog_manager.cc:5028] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): tablet 15e2fa2b1330485fb8fbc9b08f54955b (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:51.003269 10734 raft_consensus.cc:2243] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:51.004096 10734 raft_consensus.cc:2272] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:51.004047 10689 raft_consensus.cc:993] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:51.005417 10735 ts_tablet_manager.cc:1929] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:26:51.005836 10735 log.cc:1199] T 88ee35c47e0d403393cb03f68a432b98 P 21c151c99bcf4cbeb819de06e68d95bf: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/wals/88ee35c47e0d403393cb03f68a432b98
I20260709 12:26:51.005965 10641 raft_consensus.cc:1081] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:51.007956 10734 ts_tablet_manager.cc:1916] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:51.008263  8541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49268
I20260709 12:26:51.008785  8541 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:51.009112  8541 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.015275  8541 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:51.020033  8541 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:51.021703  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:51.022117  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:51.022553  8464 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.022675  8391 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:51.023056  8391 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:51.023757  8391 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:51.024730  8391 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:51.027742  8282 catalog_manager.cc:5028] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): tablet 88ee35c47e0d403393cb03f68a432b98 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:51.037539  8464 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:26:51.038738  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:51.039562 10730 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:51.040024 10730 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:51.041003  8391 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:26:51.040791 10730 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:51.043642 10734 ts_tablet_manager.cc:1929] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 12:26:51.043205  8293 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 7 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:51.044018 10734 log.cc:1199] T 2a26f17e57344b8bba537d4b071c49be P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/wals/2a26f17e57344b8bba537d4b071c49be
I20260709 12:26:51.046121  8281 catalog_manager.cc:5028] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): tablet 2a26f17e57344b8bba537d4b071c49be (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:51.053912 10736 ts_tablet_manager.cc:1929] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:26:51.054476 10736 log.cc:1199] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P aef8c9f023564378a04e3e1e6171930d: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/wals/23e95bddd5b14e1b8e7f5bfe7a8f8392
I20260709 12:26:51.056675  8280 catalog_manager.cc:5028] TS aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): tablet 23e95bddd5b14e1b8e7f5bfe7a8f8392 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:26:51.056823  8294 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 6 to 7, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:51.212146  8464 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:51.213318 10689 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:51.229588  8541 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:51.231451 10689 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:51.420147  8545 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:51.421473 10744 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:51.441819  8393 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:51.443693 10655 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:51.570363  8464 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:51.571620 10730 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:51.575654  8393 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:51.577138 10730 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.116072  8545 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:52.121505  8510 consensus_peers.cc:597] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 046c03262b594a9c8af1b19c581fb4b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.121647  8393 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:52.122038  8468 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:26:52.122809 10730 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.123703 10758 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:52.124827  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:52.132598 10756 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.134575  8468 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.146185  8395 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.152755  8293 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index -1 to 4, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 4 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.157251  8393 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:26:52.172428  8361 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9ce4c75067748ad84434b89f28725b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.173575  8468 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:52.173575  8545 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:52.177613 10751 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:52.179075 10750 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:52.200744 10751 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.202340  8468 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.206460  8395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "145eb7997c78480db629215c6acac8ef"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:52.207031  8395 raft_consensus.cc:606] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:52.212162  8545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "605e001ede544f519292071c2eeb41fb"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:26:52.212613  8545 raft_consensus.cc:606] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:52.216653  8545 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.219910  8295 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 6, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.225170  8468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dabecae7023948069d48a04cefe25522"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:52.225672  8468 raft_consensus.cc:606] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:52.224087  8393 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:52.233637  8468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:52.234282  8468 raft_consensus.cc:606] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:52.236272  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:52.237924  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:52.238663  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:52.242854  8361 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c0c82b4eaa64a08af0a1f0c7ddaaef0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.243672  8543 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:52.247690 10751 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.252671  8468 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:52.253927 10751 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.261471 10750 raft_consensus.cc:2955] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.263051  8543 raft_consensus.cc:2955] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.263772  8468 raft_consensus.cc:2955] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:26:52.279932  8293 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 5, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:26:52.285511  8343 auto_rebalancer.cc:629] Failed to schedule move for tablet ea5d246a744e484fa3414c038a792b99: Remote error: Service unavailable: leader transfer in progress
I20260709 12:26:52.337725 10751 raft_consensus.cc:993] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:52.338265 10621 raft_consensus.cc:1081] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:52.339666  8545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "145eb7997c78480db629215c6acac8ef"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49268
I20260709 12:26:52.340117  8545 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.340370  8545 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.344709  8545 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.346086  8545 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:52.346648  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:52.347046  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:52.347208  8393 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:52.347563  8393 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:52.347678  8468 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.348272  8393 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.349391  8393 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.353653  8468 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:52.355239  8393 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:52.356374  8512 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:52.357396 10626 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:52.357831 10626 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:52.358578 10626 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.370223  8293 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 5 to 6, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:52.473171 10744 raft_consensus.cc:993] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:52.473611 10700 raft_consensus.cc:1081] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:52.475164  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dabecae7023948069d48a04cefe25522"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:52.475745  8393 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.476110  8393 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:52.480903  8393 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.482200  8393 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:52.482959  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:52.483193  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:52.484200  8468 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:52.484233  8545 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:52.484704  8468 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:52.486459  8468 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.487654  8468 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:52.491465  8545 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:52.495142  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:52.496125 10751 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:52.496582 10751 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:52.497413 10751 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.509618  8468 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:52.512615  8293 catalog_manager.cc:5697] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.559840 10775 ts_tablet_manager.cc:933] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:52.563596 10775 tablet_copy_client.cc:323] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:52.564854  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet b9ce4c75067748ad84434b89f28725b0 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:52.565410  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet b9ce4c75067748ad84434b89f28725b0 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-b9ce4c75067748ad84434b89f28725b0
I20260709 12:26:52.573050  8407 tablet_copy_source_session.cc:215] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:52.575991 10775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9ce4c75067748ad84434b89f28725b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.582044 10730 raft_consensus.cc:993] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: : Instructing follower 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:52.582535 10730 raft_consensus.cc:1081] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Signalling peer 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:52.585035  8468 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "605e001ede544f519292071c2eeb41fb"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:39226
I20260709 12:26:52.585551  8468 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.585892  8468 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.590234  8468 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.592729  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:52.593259  8393 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.595160  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:52.595737  8543 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:52.595861 10775 tablet_copy_client.cc:806] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:52.596171  8543 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:52.596623 10775 tablet_copy_client.cc:670] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:52.596967  8543 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.599905  8393 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:52.601012  8438 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:52.601799 10744 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:52.602257 10744 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:52.603314 10775 tablet_copy_client.cc:538] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:52.603039 10744 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.607247  8543 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:52.615665 10775 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:52.627883  8293 catalog_manager.cc:5697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 6 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:52.641849  8543 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:52.648388  8468 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:52.666531 10778 ts_tablet_manager.cc:933] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:52.670393 10778 tablet_copy_client.cc:323] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:26:52.671950  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet 046c03262b594a9c8af1b19c581fb4b6 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:26:52.672482  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet 046c03262b594a9c8af1b19c581fb4b6 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-046c03262b594a9c8af1b19c581fb4b6
I20260709 12:26:52.679637  8556 tablet_copy_source_session.cc:215] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:52.679893 10775 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.680832 10775 tablet_bootstrap.cc:492] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:52.682482 10778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 046c03262b594a9c8af1b19c581fb4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.682554 10775 ts_tablet_manager.cc:1403] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.067s	user 0.033s	sys 0.018s
I20260709 12:26:52.685509 10775 raft_consensus.cc:359] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:52.686095 10775 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:52.686652 10775 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:52.688838 10775 ts_tablet_manager.cc:1434] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:26:52.690361  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-b9ce4c75067748ad84434b89f28725b0 received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:52.690773  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-b9ce4c75067748ad84434b89f28725b0 on tablet b9ce4c75067748ad84434b89f28725b0 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:52.700067 10775 ts_tablet_manager.cc:933] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641)
I20260709 12:26:52.702198 10778 tablet_copy_client.cc:806] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:52.702756 10778 tablet_copy_client.cc:670] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:52.703838 10775 tablet_copy_client.cc:323] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.65:38641
I20260709 12:26:52.705348  8407 tablet_copy_service.cc:140] P 21c151c99bcf4cbeb819de06e68d95bf: Received BeginTabletCopySession request for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:50338)
I20260709 12:26:52.705854  8407 tablet_copy_service.cc:161] P 21c151c99bcf4cbeb819de06e68d95bf: Beginning new tablet copy session on tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:50338: session id = e3660d999c0a41658a1f1dbe7cc90746-3c0c82b4eaa64a08af0a1f0c7ddaaef0
I20260709 12:26:52.708592 10778 tablet_copy_client.cc:538] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:52.718252  8407 tablet_copy_source_session.cc:215] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:52.720001 10778 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:52.720774 10775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:52.734493 10775 tablet_copy_client.cc:806] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:52.735039 10775 tablet_copy_client.cc:670] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:52.738111 10775 tablet_copy_client.cc:538] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:52.744542 10775 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
I20260709 12:26:52.746810 10778 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.747730 10778 tablet_bootstrap.cc:492] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:52.748406 10778 ts_tablet_manager.cc:1403] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.004s
I20260709 12:26:52.751713 10778 raft_consensus.cc:359] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:52.752538 10778 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:52.753152 10778 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:52.758870 10778 ts_tablet_manager.cc:1434] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:52.765223  8556 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-046c03262b594a9c8af1b19c581fb4b6 received from {username='slave'} at 127.0.0.1:58406
I20260709 12:26:52.765659  8556 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-046c03262b594a9c8af1b19c581fb4b6 on tablet 046c03262b594a9c8af1b19c581fb4b6 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:52.776046 10700 raft_consensus.cc:993] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: : Instructing follower 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:52.776531 10700 raft_consensus.cc:1081] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Signalling peer 21c151c99bcf4cbeb819de06e68d95bf to start an election
I20260709 12:26:52.779086  8393 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:60384
I20260709 12:26:52.779636  8393 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:52.779994  8393 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.788303  8393 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.791373 10775 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:52.791208  8393 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:52.792644  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:52.793210 10775 tablet_bootstrap.cc:492] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:26:52.793979 10775 ts_tablet_manager.cc:1403] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.050s	user 0.033s	sys 0.005s
I20260709 12:26:52.796092  8388 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:52.796221  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:52.797192  8467 raft_consensus.cc:3055] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:26:52.793210  8545 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.797611  8467 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:52.797235 10775 raft_consensus.cc:359] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:52.798166 10775 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:26:52.798458  8467 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:52.798831 10775 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:52.799706  8467 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:52.801231 10775 ts_tablet_manager.cc:1434] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:26:52.802853  8407 tablet_copy_service.cc:342] P 21c151c99bcf4cbeb819de06e68d95bf: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-3c0c82b4eaa64a08af0a1f0c7ddaaef0 received from {username='slave'} at 127.0.0.1:50338
I20260709 12:26:52.803236  8407 tablet_copy_service.cc:434] P 21c151c99bcf4cbeb819de06e68d95bf: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-3c0c82b4eaa64a08af0a1f0c7ddaaef0 on tablet 3c0c82b4eaa64a08af0a1f0c7ddaaef0 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:52.798454 10626 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:26:52.811848  8545 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:52.824555  8467 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:26:52.831175  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:52.832294 10621 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:52.832846 10621 raft_consensus.cc:697] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:52.833678 10621 consensus_queue.cc:237] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:52.851882  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800303f00 after lost signal to thread 7264
W20260709 12:26:52.852989  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800257800 after lost signal to thread 8329
W20260709 12:26:52.854285  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc8e0 after lost signal to thread 8421
W20260709 12:26:52.855556  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800184d00 after lost signal to thread 8496
W20260709 12:26:52.856750  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08003b35e0 after lost signal to thread 8570
W20260709 12:26:52.857924  8418 debug-util.cc:398] Leaking SignalData structure 0x7b080039f860 after lost signal to thread 9074
I20260709 12:26:52.896152  8468 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:52.897984 10757 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:52.955076  8293 catalog_manager.cc:5697] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 1 to 2, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 2 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:52.961803  8281 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 2d99fb7f1afb4c958cdc302eb8ef165f from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 4 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:52.985723  8468 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:52.989401 10787 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.026465  8544 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:53.032711 10751 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.130395  9043 raft_consensus.cc:1217] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:26:53.163717  8545 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:53.168529 10781 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:53.224480  8393 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:26:53.250360  9043 raft_consensus.cc:1217] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:26:53.250573  8543 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.251984 10787 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.232136 10744 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:26:53.268319  9043 raft_consensus.cc:1217] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 12:26:53.320930  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:53.325125  8467 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:53.327816 10621 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:53.429728  8545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:26:53.430332  8545 raft_consensus.cc:606] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:53.434119  8388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:53.434681  8388 raft_consensus.cc:606] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:53.437304  8468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:53.437834  8468 raft_consensus.cc:606] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:53.441062  8468 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:53.441570  8468 raft_consensus.cc:606] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:53.450505  8388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12c64e413ad46968034a527b5290316"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:53.451081  8388 raft_consensus.cc:606] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:53.454970  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:53.456591  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:53.457340  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:55.148535  8326 debug-util.cc:398] Leaking SignalData structure 0x7b08000642e0 after lost signal to thread 7264
I20260709 12:26:55.423398 10621 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:55.424027 10621 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:55.425941 10621 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:55.427124 10621 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:55.427670 10621 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:55.429382 10621 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:55.430601 10621 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:55.431102 10621 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:55.433338 10621 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:55.433838 10621 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:55.434489 10621 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:55.436756 10621 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:55.442384 10621 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:55.443203 10621 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:55.452118 10621 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:55.514628 10621 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:55.523535 10621 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.089497 10621 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.090145 10621 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.090786 10621 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.099375 10621 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.100630 10621 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.101084 10621 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:56.119884 10621 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.120764 10814 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.121374 10814 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.122728 10813 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.122822 10819 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.123567 10814 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.123330 10813 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.124361 10814 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.125308 10807 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.125430 10817 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.125824 10807 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.126010 10817 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.128202 10817 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.115765 10806 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.124902 10819 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.134008 10813 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.124938 10814 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.133001 10806 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.146679 10807 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.150223 10814 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.152554 10819 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.153434 10806 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.166043 10814 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.166747 10814 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.167095 10821 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.167670 10821 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:56.168293  8326 debug-util.cc:398] Leaking SignalData structure 0x7b08000344c0 after lost signal to thread 8329
I20260709 12:26:56.166021 10815 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.167302 10820 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.169203 10820 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.168939 10815 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.171211 10820 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.171972 10815 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.173030 10814 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.169747 10821 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.185684 10804 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.185933 10811 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.186383 10804 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.186508 10811 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.187701 10807 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.188221 10807 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.188602 10811 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.188695 10804 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.189571 10804 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.189954 10809 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.190866 10807 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.191188 10818 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.191421 10807 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.191134 10809 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.191747 10818 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.191962 10807 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.190874 10811 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.193661 10809 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.190105 10813 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.190907 10812 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.193957 10811 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.191531 10816 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.194707 10812 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.189707 10808 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.195744 10808 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.196659 10799 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.195017 10816 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.198946 10799 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.200728 10816 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.201494 10799 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.194412 10813 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.203558 10813 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.190019 10621 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.208607 10621 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.212695 10621 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.196766 10812 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.197760 10808 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.198302 10780 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.216073 10780 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.209681 10804 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.218506 10780 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.193886 10818 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.218451 10802 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.191754 10794 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.226219 10794 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.228300 10794 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.229714 10804 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.235898 10802 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.241348 10802 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.245366 10700 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:56.250712  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 814713us
I20260709 12:26:56.257038 10825 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.257354 10799 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:56.263881  8326 debug-util.cc:398] Leaking SignalData structure 0x7b0800067c80 after lost signal to thread 8421
I20260709 12:26:56.257688 10780 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.245886 10700 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.260377 10744 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.257833 10799 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.293081 10826 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.293670 10826 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.296093 10756 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.296624 10756 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.298448 10756 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.275781 10780 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.267975 10825 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.290586 10744 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:56.372815  8326 debug-util.cc:398] Leaking SignalData structure 0x7b0800324120 after lost signal to thread 8496
W20260709 12:26:56.376176  8326 debug-util.cc:398] Leaking SignalData structure 0x7b080038dae0 after lost signal to thread 8570
I20260709 12:26:56.374038 10780 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.348933 10807 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.367900 10757 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.383620 10828 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:56.403916  8363 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.874s	user 0.030s	sys 0.021s
W20260709 12:26:56.404241  8363 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.030s	sys 0.021s
I20260709 12:26:56.384347 10837 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.405800 10837 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.407608 10814 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.408154 10814 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.408980 10807 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.409466 10807 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.410266 10814 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.410962 10841 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.384644 10798 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.384868 10824 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.385097 10759 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.387588 10756 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.388280 10827 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.388616 10825 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.388832 10830 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.390175 10840 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.411368 10807 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.424456 10840 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.411523 10841 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.427002 10841 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.391595 10839 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.394775 10844 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.395450 10843 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.396134 10845 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.401611 10811 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.403280 10826 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.413599 10744 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.405411 10799 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.435863 10845 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.436098 10843 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.413921 10757 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.437175 10837 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.435766 10844 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.438196 10840 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.403940 10828 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.440095 10844 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.440689 10828 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.417102 10798 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.441641 10843 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.443369 10798 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.417343 10824 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.417461 10759 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.446666 10759 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.417703 10756 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.436328 10839 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.449561 10839 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.450035 10756 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.418025 10700 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.414516 10834 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.451537  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.452188  9044 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:56.451973 10834 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.418308 10827 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:56.415508  8326 debug-util.cc:398] Leaking SignalData structure 0x7b08001027c0 after lost signal to thread 9074
I20260709 12:26:56.424218 10830 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.456442 10824 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.454041 10834 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.457264 10830 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.454850 10827 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.438304 10845 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.458771  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.459332  9044 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
W20260709 12:26:56.454885  8326 debug-util.cc:398] Leaking SignalData structure 0x7b08001c3940 after lost signal to thread 10790
W20260709 12:26:56.460120  8326 debug-util.cc:398] Leaking SignalData structure 0x7b080038b160 after lost signal to thread 10795
I20260709 12:26:56.460443  8510 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.461165 10827 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.461498 10827 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.461825 10827 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.414187 10831 raft_consensus.cc:1064] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:56.470049 10827 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.470242 10831 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.438308 10757 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.484958 10850 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.485666 10824 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.486323 10756 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.486459 10757 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.486881 10756 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.487002 10757 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.489017 10756 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.489017 10757 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.490691  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.490978  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.485010 10830 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.490744  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.492941 10830 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:56.494648  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.495070 10830 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.495292  8394 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:26:56.495568 10851 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.485623 10850 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.496946  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.496876 10851 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.495767  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.498294  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.498854 10850 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.499128 10851 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.500474  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.501091 10849 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.501091  9044 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:56.502022 10802 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.501856 10849 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:56.502513 10802 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.502875 10829 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.503397 10829 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.503683  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.504056  8510 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.504242  9044 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.505343  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.505832 10802 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.506747 10756 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.506810 10757 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.507066 10802 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.507248 10830 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.505805 10853 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.507871 10830 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.509436 10700 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.509994 10700 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:56.510664 10830 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.511162 10830 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.511513 10830 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.511919 10830 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.512488 10700 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.513201  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.485967 10837 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.508201 10802 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.514421  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.506927 10626 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.515237 10626 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.516386 10802 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.516867 10802 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.517060 10626 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.517318 10756 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.507390 10757 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.518357 10626 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.518822 10626 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.511394  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.508082 10853 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.522152 10730 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.522679 10730 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.519451 10756 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.522559 10802 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.525628 10802 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.528069 10730 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.505364 10829 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.530180 10825 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.530890 10826 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.531481 10826 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.530680 10825 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.533385 10826 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.533529 10825 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.533869 10826 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.534039 10825 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.530582 10823 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.534555 10825 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.534945 10823 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:56.535642 10798 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.536180 10798 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.536564 10825 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.537297 10823 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.534340 10826 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.538071 10798 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.538748 10824 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.539714 10826 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.542079  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.542630  8392 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:56.546072  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.546691  8396 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:56.530897 10853 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.548321  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.548925  8472 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:56.549618  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.550215  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.514482 10837 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.551687  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.552075  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.552242  8472 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:26:56.552656  9045 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:26:56.553488  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.554021  8472 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:26:56.520990 10849 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.555130  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.555719  8472 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:26:56.557703  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.555315  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:56.560422  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51193.7us
I20260709 12:26:56.560602  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:56.560112 10827 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.561864  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.563045  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.563452 10837 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.564754 10757 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.564963  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.561190 10824 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.566663  8512 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:56.567836  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.583307  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.583809  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.584336  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.569612 10829 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.585031 10829 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.585506  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.586489  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.570060 10850 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.572285 10828 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.586999 10626 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.587307 10828 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.588394  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.589290 10828 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.587013 10829 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.589886  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.590175 10850 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.568954  9016 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.572698 10837 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.573170  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.574661  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.592458 10837 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.576354 10849 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.592036 10836 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.593384 10836 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.593798 10836 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.594679 10837 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.591761  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.592142 10850 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.576890 10824 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.577029  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.596426  8393 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:56.596302 10824 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.597227  8396 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:56.599092 10824 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.601347  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.601941 10811 raft_consensus.cc:1064] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:56.577435 10855 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.602113 10814 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:26:56.604482 10814 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.604408 10855 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.578039  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.605460  8394 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:26:56.578384  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.579070  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.605803 10811 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.579587  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.580274  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.580801  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.581198  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.581584  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.607048  8546 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:56.583118 10730 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.584410  8539 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.604977 10814 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:56.593331 10849 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.608814 10730 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.609292 10730 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.604243 10820 raft_consensus.cc:1064] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:26:56.607976  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.578009  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.610658 10849 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.610771  8541 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:56.603946  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.611485  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.612066  9048 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:56.611616 10820 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.613098  8510 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.579977 10830 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.614279  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.614866  8539 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.615821 10830 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.628729  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.628230  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.628681  8539 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:56.632027  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.627010  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.632642  8470 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:56.572474  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.616796  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.617121  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.617493  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.618257  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.633937  8468 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.634618  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.618710 10855 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.619012  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.619268 10814 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.635460  8469 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:56.635818  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.624440  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:56.625084  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.626127  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:56.626087  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.634763  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.637549  8467 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:56.636426  8464 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:56.626087 10852 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.639667 10852 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.640138 10852 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.638052 10814 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.643939  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.645583  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.638964 10855 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.647014 10855 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.647119 10833 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.647564 10855 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.647708 10833 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.648274 10836 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.649925 10833 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.650579  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.652343 10730 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.652726 10833 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.653213 10833 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.656395  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.658595  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.659029  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.659746  8470 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:56.661005  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.663988  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.664064  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.666778  9044 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:56.667794  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.668345 10831 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:56.670923  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.672613  8537 raft_consensus.cc:1240] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:56.672835 10842 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.673081 10744 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.673385 10842 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.673557 10744 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.675398 10842 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.675464 10744 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.676076 10730 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.676258 10744 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.680213 10836 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.680588 10744 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.659150 10852 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.682554 10744 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.676806  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.677819  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.679121  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.679364  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.680161  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.684520  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.655205 10833 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:56.685837 10852 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:56.685947  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:56.686538  9048 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.687511  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.688894  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.689455  8543 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:26:56.689829  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.690379  8546 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.690725  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.691298  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.691955  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.692955  8546 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:56.693382  9048 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:56.690291  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.695695  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.696887  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.697691  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.698330  8543 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:56.698298  8469 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.695596  8510 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.699066  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:56.700078  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.701233  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.700703  8469 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:56.702308  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.702831  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.699990  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.703621 10852 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:56.704093 10852 raft_consensus.cc:697] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:56.700719  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.705348  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.706076 10852 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.706991  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.708426  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.682801 10855 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.710139  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.710464  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.712598  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.713429  8537 raft_consensus.cc:2393] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:56.714264 10855 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.713073  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.717279  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:56.756232  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.762871  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.764469  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.765415  8469 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:56.760907  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.767845  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.768074  8397 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:56.763123  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.769009  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.769584  8396 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:56.769894  8472 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:56.771347  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.772028  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.772845  8465 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.772287  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:56.773613  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.773844  8388 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.774412  8470 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:56.776755  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.778987  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.773042  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.762933  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.782114  8390 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:56.768163  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.788192  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.788904  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:56.789636  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.790331  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.791162  8390 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:56.792232  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.792979  8393 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:56.773029  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.795466  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.796106  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.796165  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.797261  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.798036  8540 raft_consensus.cc:2393] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:56.799352  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:56.800431  8543 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:56.802021  8546 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:56.808472  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.809625  8391 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:56.811597  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.814011  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.815014  8391 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:26:56.799335  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.816381  8469 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:56.817519  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.828065  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:56.831938  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:56.832939  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:56.833894  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:56.834463  9015 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:56.835446  8391 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.836848  9015 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:56.838629  9015 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.838972  8393 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:56.840543  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:56.841243  9047 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:56.842964  9048 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEARNER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:26:56.843225  8388 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:26:56.786849  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:56.851150  8397 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:56.851568  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:56.852528  8390 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.856302  9016 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.856891 10834 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.857401 10834 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.857875 10834 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.860030 10836 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:56.860510 10836 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:26:56.860630  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 74099.4us
I20260709 12:26:56.861333 10840 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:56.861550 10844 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:56.861740 10820 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:56.863014 10844 raft_consensus.cc:697] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:56.864620 10844 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.865074 10820 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:56.866191 10823 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:26:56.866647 10823 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.867033 10823 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:56.868371 10832 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:56.869693 10832 raft_consensus.cc:3055] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:56.870024 10832 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:56.876690 10832 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.870525 10840 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:56.878427 10840 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:56.878430 10832 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.883683 10836 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.893044  8295 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:56.927511  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 44591.4us
I20260709 12:26:56.927817  8391 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:56.908102  8390 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:56.915696 10843 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:56.935005 10843 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:56.935609 10843 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.960331  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:56.963464  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.964275 10820 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:56.964713 10820 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.965176 10820 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.964668  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:56.966122 10799 consensus_queue.cc:1059] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:26:56.967473 10799 raft_consensus.cc:3055] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:56.967923 10799 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:56.969022 10799 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.961580  8361 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:56.965106 10730 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.971051 10834 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.973903 10730 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.971431  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:56.963917  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:56.975342 10852 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:56.971277 10855 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.975791 10852 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.974336 10814 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.974413 10730 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.976688 10814 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.978489 10814 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.979137  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:56.976162 10855 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.980587 10855 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.980938 10834 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.976401 10852 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:56.973915  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:56.985073  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:56.986225 10811 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:56.986620 10811 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:56.987003 10811 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:56.973855  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:56.972456 10836 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.991717 10821 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:56.992165 10821 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:56.992574 10821 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:56.993206 10832 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:56.974233 10833 consensus_queue.cc:1059] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:26:56.994304 10836 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:56.995342  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:56.994943 10832 raft_consensus.cc:3055] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:56.996695 10832 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:56.997996 10832 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:56.999369 10832 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.001574  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.002879  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.001569  9048 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.010974 10807 consensus_queue.cc:1059] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:57.012782 10807 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:57.013175 10807 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.014451 10823 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.014292 10807 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.016630 10807 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:57.017477  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 46226.5us
I20260709 12:26:57.018716  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.019495 10799 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.019748 10831 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.019959 10843 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:56.994453  8293 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:57.023708 10820 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.023063  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.033041  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.033718  8465 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:57.034119  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.028261  9047 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.037459 10794 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.039446  8362 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.040860 10820 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.040709 10824 consensus_queue.cc:1059] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:57.041563  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.043742  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.044286  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.042804 10821 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.047576 10824 consensus_queue.cc:1243] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer e3660d999c0a41658a1f1dbe7cc90746 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:26:57.048183 10830 raft_consensus.cc:3055] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.048604 10830 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.049045 10821 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.052356  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.049553 10804 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.055294  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:26:57.056373  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.056382  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:57.061079  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.049595 10830 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.062542 10830 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.063496 10814 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.073120 10811 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.074478  8390 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.076973 10836 consensus_queue.cc:1059] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:57.078293 10834 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.078680 10834 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:57.079887 10834 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.051055 10840 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.082175 10834 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.082461 10843 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.081382  8362 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.087342  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.087512  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.089172  9044 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.043332 10855 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.094322 10855 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.083134 10852 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.099064  8541 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:57.100174 10852 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.104532 10823 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.105039 10805 consensus_queue.cc:1059] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:57.106314 10821 raft_consensus.cc:3055] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.106693 10821 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.106834 10811 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:57.107708 10821 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.108744  8541 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.109685  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:57.114334  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.114542 10821 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.115193  8540 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:57.115562  8362 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.116304 10820 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.116720 10820 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.117089 10820 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.111588 10730 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.106642 10744 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:26:57.120059  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.120784 10744 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:57.120677  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.121223  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.121397  8543 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:26:57.122014  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:57.122402  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:57.122987  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:57.122041  8539 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:57.123801  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.129551  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.130671  8546 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.121182 10744 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.131646 10805 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.138818  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:26:57.144778  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.146435  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.147281  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.148100  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.148015  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.149474  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.132246 10823 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:26:57.153621  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.155128  8539 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:57.156239  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.157490  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.159999  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.159133  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.150890 10805 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.162756  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.145468 10832 consensus_queue.cc:1059] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:26:57.165207  8512 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.165750  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.158778 10830 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.169297 10830 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:57.169713 10830 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.169142  8362 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.171092  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.171804 10821 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.167876  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.171226  8362 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.173883  8362 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.174670 10807 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.175019 10807 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.169167  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.175697 10821 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:57.175343 10807 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.179900 10832 raft_consensus.cc:3055] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.180282 10832 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.166731  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:26:57.184271  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 52164us
I20260709 12:26:57.185500 10831 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.188572  8540 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:26:57.186722 10831 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:57.191207 10831 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.192178 10830 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.202054  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.203234  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.194177 10820 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.195986 10730 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:57.196676  8362 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.197196 10833 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.163931 10805 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:57.205133  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.198851  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:57.205370 10805 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.207918  9014 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.208786 10843 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.205060 10833 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:26:57.211853  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 67583.2us
I20260709 12:26:57.212808  8470 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:57.212888  9014 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.212750 10833 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.213380 10744 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.213758 10836 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.214389 10833 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.214884 10840 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.213078 10811 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.216149 10811 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.216550 10811 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.217532  9014 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.205435  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:57.219561  8537 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:26:57.221978  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.225515  8470 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:26:57.225919  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.226572 10830 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.226814  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.228489 10836 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.234946  8463 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:57.181274 10832 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.244789 10832 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.214602 10744 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.243450  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.253463  8512 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.254930  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.256487 10831 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.258607 10831 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.260828  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.256573 10830 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.261698 10830 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:57.262130 10830 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.262945  8464 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:26:57.264655  8471 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:57.268384 10807 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:57.270797 10807 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.271487 10814 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:57.272835 10855 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.323732  8390 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:57.275389 10843 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.281945  9043 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:26:57.282415 10804 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.325290 10804 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:26:57.325726 10804 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.325935 10855 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:26:57.283022  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 86431.6us
I20260709 12:26:57.283746  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:57.331622  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.332468 10807 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.332963 10807 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.333469 10807 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.334426 10843 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:57.284214  9044 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.289132  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:26:57.291620  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 47766.7us
I20260709 12:26:57.292212 10830 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.338153 10830 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.301637  8466 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:26:57.340605 10804 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.270720 10836 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:57.303525  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.342782 10804 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:57.343868  8463 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:26:57.344129  8464 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:26:57.344559  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.344753  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.346292  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.346756  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.303550 10805 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.347683  9015 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.348886 10805 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:57.350063 10836 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:26:57.307183  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.297766 10811 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.297271 10820 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.332864  8362 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.348807  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.352831 10843 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.353083 10811 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.353305 10820 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.353729 10820 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.354112 10820 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.354499  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:57.354677  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:57.308003  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51847.9us
I20260709 12:26:57.345418  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.356105  8512 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.357007  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.353121  8362 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.358158 10811 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.358577 10811 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.358937  8362 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.359138 10830 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.359896 10830 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:57.358798 10855 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.358111  8512 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.359468 10811 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.360425 10855 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:57.360838 10855 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.361320  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.362026 10852 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.362188  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.362707 10870 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.363112 10870 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:57.363480 10870 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.364250  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.364890 10824 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.364849 10852 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:57.359112  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:57.365275 10804 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.366695  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:57.367535  9045 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:57.367924  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:57.368335  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.369781  8362 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.371039 10794 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:57.365440 10852 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.372212  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:57.373494  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.374310  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.364336 10805 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.375941  8470 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:26:57.374677  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.380664  8466 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:57.381466  8391 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.382452  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.383057 10836 consensus_queue.cc:1059] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:57.383425 10811 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.384064 10836 raft_consensus.cc:3055] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.384439 10836 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:57.384892  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.385531 10811 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.385305 10836 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.386289  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.381184 10820 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.386646 10836 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.371008  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.390475  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:57.417260  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 46343.8us
I20260709 12:26:57.389140  9015 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.428666  9015 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.417057 10811 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.430998 10844 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.431856 10834 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.427199 10830 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.432821 10820 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.433990  8362 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.440414 10811 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.440799 10811 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.429710 10824 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.442605  8362 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.443310 10811 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.445106  8539 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.446902 10744 consensus_queue.cc:1059] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:57.447963 10744 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.448299 10744 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:26:57.448436  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 74243.4us
I20260709 12:26:57.449193  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.449244 10744 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.449960 10824 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.450181 10811 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.450582 10744 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.451586 10820 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:57.451977 10820 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.452325 10820 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.452863 10852 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.456374  8362 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.457216 10805 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.457605 10805 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.458076 10805 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.458832 10824 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:57.459694  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 69301.2us
I20260709 12:26:57.457593  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.460379  8511 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.461081 10824 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.461661 10820 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.462405 10870 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.463385  8541 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.463689 10820 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.464658 10805 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.465997 10823 consensus_queue.cc:1059] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.466593 10805 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.466941 10832 raft_consensus.cc:3055] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.467324 10832 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.468227 10832 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.469334 10832 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.472097  8391 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.473192  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.473768 10834 consensus_queue.cc:1059] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:57.475159 10834 raft_consensus.cc:3055] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:57.475526 10834 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:26:57.475780 10869 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:57.371122 10814 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.476375 10834 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.479087 10834 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.488261  8362 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:57.488368  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 57910.9us
I20260709 12:26:57.477418 10811 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.490342 10805 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.497269  8362 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.504747 10805 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.500272 10811 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:57.507457 10811 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.507822 10811 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.509451  9045 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:57.511047 10831 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:57.512068 10831 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:57.512022  8362 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.499150 10852 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.512614 10831 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.513415  8362 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.513116 10820 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:57.539000  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.499490 10870 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.440436 10855 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:57.547909  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 74769.6us
I20260709 12:26:57.548789  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.463122 10807 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.551229 10871 consensus_queue.cc:1059] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:26:57.551834  8362 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.552214 10807 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.552883 10807 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.553181  8362 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.543656 10820 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.553824 10820 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.554373  8362 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.552784 10805 raft_consensus.cc:3055] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:57.555344 10821 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:57.555980  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.519644 10824 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.556547  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:57.552423 10871 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:57.560614 10871 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.560820 10807 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.561381 10807 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.555802 10805 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.562247 10807 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.563192 10805 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.564905 10805 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.568717 10821 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:57.572275  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:57.572701  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:57.574301  9047 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:57.557984 10804 consensus_queue.cc:1059] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:26:57.559369  8362 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:26:57.605398  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.555634 10794 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.589064 10871 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.612005 10831 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.618731  9043 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
W20260709 12:26:57.620178  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 71475.8us
I20260709 12:26:57.621057 10814 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:57.623378 10831 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.630632  8541 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.637251  8511 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:57.627761  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62900.4us
I20260709 12:26:57.629962 10814 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:57.613822 10821 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:26:57.639531 10814 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.641310  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.624032 10870 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.642239 10730 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:57.644773  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 68151us
W20260709 12:26:57.652588  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.631692 10820 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.653450  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:57.644234  9045 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:57.646981 10832 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:26:57.610358 10830 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.662861 10832 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.663237 10832 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.664090 10832 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:57.660298  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 101001us
W20260709 12:26:57.666564  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.647192 10852 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:26:57.613754 10804 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:26:57.667583  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:57.633981 10871 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.668563 10880 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:57.660279 10794 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:57.677054 10855 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.677659 10820 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.693912 10811 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.686288 10871 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.701465  8362 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.704795 10830 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:57.684275 10832 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.707772  8541 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.707579 10805 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:57.716176  8293 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.708309 10879 raft_consensus.cc:3055] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.718197 10879 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.719134 10879 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.720443 10879 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.708693 10794 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.710721 10820 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:57.722259 10820 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.722597 10794 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.723184 10820 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.724409 10820 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.713306 10811 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:57.729485 10823 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:57.730582 10744 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.730973 10744 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.721369 10814 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.731891 10744 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.733057 10744 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.733253 10814 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:57.741518  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 74011.6us
W20260709 12:26:57.757153  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 55775.8us
W20260709 12:26:57.766819  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 121953us
I20260709 12:26:57.766938  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.756078 10881 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.768265  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.768950  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.756161 10880 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.770226  8393 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:26:57.767704  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.772459 10882 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.773170  8390 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.774266  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.768419 10881 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.776396  8389 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.776140 10881 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:57.776576  8511 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.777356  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.777711 10882 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.778455  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.770231  8392 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.779233  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.780014  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.780321 10882 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.781595  8511 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.781759  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.782388 10882 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.786386  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.787175 10882 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.790411  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.790796  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.791575  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:26:57.791970  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.791355  8391 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:26:57.775345  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.780500  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.793872  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.795482  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.799047  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.799897  8391 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:57.802531 10824 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:57.816489  8395 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.818430  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.819185  8388 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:26:57.823500  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.829849  8541 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.836074  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.837237  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.838114 10823 consensus_queue.cc:1059] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.838511  8396 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.839357 10832 raft_consensus.cc:3055] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:57.839956  8388 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:57.840562  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.841053  8388 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.841958  8394 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:57.843753  8389 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
W20260709 12:26:57.844717  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.845217  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.835343  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.847493  8393 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:57.848301  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.849128  8512 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.849391  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.850055 10852 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.839803 10832 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.850095  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:57.850114  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.850770 10852 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.851156  8466 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:57.851331 10832 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.851706 10852 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.852684 10832 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:57.854331 10824 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:57.854840 10824 raft_consensus.cc:697] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.843159  8394 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.855646 10824 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.856585  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.861070  8394 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:57.837139  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.861699  8392 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:57.862406  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.863365  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.864666  8392 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.866030  8395 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.866747  8392 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:57.867594  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.867919  8394 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:26:57.868698  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.869580  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:57.842140  8388 raft_consensus.cc:1240] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.844590  8396 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.850378  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.875658  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:26:57.879429  8541 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:57.881096 10823 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:57.882094 10744 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:57.882453 10744 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.884765 10744 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.885913 10744 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:57.879541  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 71656.8us
I20260709 12:26:57.892967  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.893707 10870 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.894583  8511 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.895337 10870 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:57.898190 10870 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:57.900718  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.903155  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.904894  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.905452  8468 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.905794  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.912295  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.913370  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.914359  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.916445  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.916692  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.917969  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.918326  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.918956  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.919737  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.923895  8438 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.915264  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.924667 10823 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:57.925081  8438 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.925789 10823 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.926600  8468 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:57.919358  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:57.927999  8541 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:57.928398  8466 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:57.930348  8470 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:57.931639 10823 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.926615  8438 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.932736 10823 raft_consensus.cc:3055] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:57.933132 10823 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:57.933678  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:57.933929 10744 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:57.934935  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:57.935848  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.934635 10823 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:57.939858  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.940301 10832 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.946928 10870 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:57.947540  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 46900us
I20260709 12:26:57.957378 10823 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:57.958768  8511 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:57.951570 10830 consensus_queue.cc:1059] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:57.959818 10824 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:57.952176 10831 consensus_queue.cc:1059] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:57.960361 10824 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.960994 10831 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:57.951083  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.962103 10870 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.951143  8293 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.954258 10855 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.954819 10882 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:57.963763  8293 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 6, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:57.955644 10883 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:26:57.965021 10855 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:57.965124  8469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
new_leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
 from {username='slave'} at 127.0.0.1:54760
I20260709 12:26:57.965421 10855 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.961364 10831 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.966220  8469 raft_consensus.cc:606] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Received request to transfer leadership to TS 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:57.967325  8469 raft_consensus.cc:614] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:57.965983 10867 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.959972 10830 raft_consensus.cc:3055] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.963618  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:57.969412 10830 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.969970  8466 raft_consensus.cc:1240] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: []
I20260709 12:26:57.971422  8362 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:57.972594  8362 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:26:57.973465  8362 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.965461 10883 raft_consensus.cc:3055] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:57.975579 10883 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.975524 10881 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:57.977476 10883 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.977962 10881 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.980108  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.975612 10880 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:57.981356 10869 consensus_queue.cc:1059] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:57.966436 10855 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.982484  8511 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.984253  8541 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:26:57.978847 10883 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:57.981194  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:57.981688 10880 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:57.975680 10852 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:57.975003 10794 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:57.984295 10879 consensus_queue.cc:1059] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:26:57.970894 10831 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.982914 10870 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:57.968281 10867 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:57.983076 10730 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:57.978886 10881 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:57.986472  8541 raft_consensus.cc:606] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:57.961287 10824 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.995148 10794 raft_consensus.cc:3055] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:26:57.982189 10882 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:26:57.995427 10880 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.974761 10830 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:57.996066 10867 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.000254 10730 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:58.001230 10855 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.014761 10830 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.001528 10794 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:58.015316 10831 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:57.997118 10744 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:26:58.048604 10887 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:26:58.051579 10840 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:58.064162  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.059717 10805 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:58.065279 10869 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:58.083755 10869 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.084726 10869 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.083833 10894 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.055924 10867 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.052407 10852 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.092152  9045 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:58.064877 10870 raft_consensus.cc:3055] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:26:58.102442  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 120051us
W20260709 12:26:58.104735  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.104389  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.110102 10871 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:58.112941  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:58.113679  8471 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:58.113850  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:58.095158 10823 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:26:58.115271  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51186.2us
I20260709 12:26:58.116044  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:58.116328  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:26:58.115729  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.118414  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 137443us
I20260709 12:26:58.119230 10893 consensus_queue.cc:1059] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:58.119639 10897 consensus_queue.cc:1059] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:26:58.120241 10893 raft_consensus.cc:3055] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:58.122591  8468 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:26:58.103518 10870 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:26:58.125454  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.126080  8463 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:26:58.102234 10814 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:26:58.087231 10794 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.130550 10794 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:26:58.129647 10879 raft_consensus.cc:2955] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:58.135545 10892 raft_consensus.cc:3055] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:58.135964 10892 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:26:58.137105  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.136804 10892 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.137979 10892 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.120630 10893 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:26:58.202857  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.105310 10840 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:58.215623  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.206866 10852 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.420418  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:58.401947  8464 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:58.173180 10897 consensus_queue.cc:1059] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 12:26:58.420370  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.420563  8471 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:58.433293  8438 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.451081 10882 raft_consensus.cc:3055] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:58.451599 10882 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.452432 10882 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.456012 10869 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.453691 10882 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:26:58.472824  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 73196.5us
I20260709 12:26:58.479774  8438 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.472648 10891 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.492439 10823 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:58.489729 10814 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.493250 10814 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:58.495472 10814 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:58.489725 10824 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:26:58.506091  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.467619 10870 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.517242  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.517534  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.518179  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.471006 10893 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:58.520877 10893 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.508625 10820 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.525615  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.528874  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.529163  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.532545  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.533102  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:58.533677  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.533386  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.541031  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:58.531627 10899 log.cc:927] Time spent T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:26:58.544814  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.550669  8537 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
W20260709 12:26:58.554365  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 77128.8us
I20260709 12:26:58.546324  8470 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:58.569737  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:58.570449  9047 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:58.571491  8389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:58.572067  8389 raft_consensus.cc:606] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:58.572598  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.548743  8464 raft_consensus.cc:2955] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:58.575977  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:58.578737  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:58.525271 10820 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:58.574544  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:58.589900  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 190553us
I20260709 12:26:58.593603  8389 raft_consensus.cc:1240] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: []
W20260709 12:26:58.578768 10883 consensus_meta.cc:287] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.008s
I20260709 12:26:58.593369 10898 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:58.574512  9047 raft_consensus.cc:2955] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:58.596318  9044 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:58.596673  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:58.601781  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.605731  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.606171  8396 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:58.608207  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.592743 10880 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:58.615936 10880 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.616398 10880 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.618397  9042 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:58.601771 10744 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:58.621778  8393 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:58.626448 10820 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:58.642284  8544 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:26:58.628202 10814 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:58.625392 10855 consensus_queue.cc:1059] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:26:58.636504  8539 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:26:58.636884  8537 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:58.661865  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:58.662817  8469 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:58.663647  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:58.663856  8538 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
W20260709 12:26:58.665030  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 56903.9us
I20260709 12:26:58.666760  9045 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:58.635061 10744 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:58.670861 10744 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:58.666908  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:58.711366  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:58.712181  8393 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:58.715579  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.616019 10840 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:58.710264  9044 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:58.728860  8540 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
W20260709 12:26:58.727612  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.734127  8388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:26:58.734714  8388 raft_consensus.cc:606] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.605572 10898 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.744858  9016 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:58.747920 10926 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:26:58.728308 10823 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.753641 10922 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 12:26:58.757666  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 114787us
I20260709 12:26:58.762974  8538 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.757251 10914 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:58.774770  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 64960.5us
I20260709 12:26:58.776453  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:58.777127  8544 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:58.785753 10898 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:58.786773 10894 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:58.787276 10894 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.788105 10894 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.789283 10894 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.800654  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:58.800891  8539 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.801429  8541 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:58.801640  8544 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:58.802106  8545 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:26:58.801771  8438 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.804352  8538 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:58.802767  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:58.807080  8466 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:26:58.814251  8541 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:58.812040  8470 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:58.815820 10744 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:58.819989 10880 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:58.821997 10880 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:58.817977  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:58.826467  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:58.826985  8540 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:58.829430  8538 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:58.829924 10744 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:58.832379  8389 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:26:58.813746 10852 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.838173  8544 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:26:58.838905  8539 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:26:58.839720 10855 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:58.839903 10882 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:58.851011  8546 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:58.840377  8469 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:58.854013 10882 raft_consensus.cc:3055] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:58.854413 10882 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.855196 10882 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.856196 10870 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.856441 10882 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.858254 10918 raft_consensus.cc:3055] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:58.858609 10918 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.859190 10918 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.860477  8438 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:58.845202  8511 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:58.823012 10897 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:58.861395 10918 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:58.831634 10911 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:58.862301  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 71332.5us
I20260709 12:26:58.862515 10911 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:58.861735  8438 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.863605 10891 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:58.864131  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:58.862723 10871 raft_consensus.cc:993] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:58.866518  8511 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:26:58.867206  8293 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:58.869294  8388 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.870491  8393 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:58.870771  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:58.866014  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:58.885964 10897 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:58.885986  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:58.886422 10914 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:58.890000  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:58.919067  9047 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:58.890762  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:58.894820 10881 raft_consensus.cc:1081] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Signalling peer 2d99fb7f1afb4c958cdc302eb8ef165f to start an election
I20260709 12:26:58.894924 10906 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:58.898380 10855 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:26:58.899386 10896 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:26:58.907701  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:26:58.913061  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.836858 10883 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:58.916054  8470 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:26:58.894440 10794 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:58.919755  8539 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:26:58.926683  8546 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.929761  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.934540  8361 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.918023 10871 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:58.935856  8361 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:58.859571 10852 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:58.936220  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:58.942257  9042 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:58.944134 10915 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:58.927824 10897 raft_consensus.cc:697] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.946208 10744 consensus_queue.cc:1059] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:58.947211 10744 raft_consensus.cc:3055] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:26:58.947582 10744 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:58.947091  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:58.946242  8438 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.950382  8546 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:58.923599 10836 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:26:58.932565 10906 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.938532 10922 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:26:58.955960  8388 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:26:58.947049 10897 consensus_queue.cc:237] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.936630 10883 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:58.939124 10871 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.957882 10744 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:58.933318 10918 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:26:58.958809  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:58.956782 10805 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:58.951388 10832 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:58.953100 10891 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:59.052349 10805 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.053435 10805 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.965593 10906 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:58.961135 10871 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:58.961097 10855 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 12:26:59.047128  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 88377.3us
I20260709 12:26:59.060083  8361 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:58.955371  8469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:39218
W20260709 12:26:59.048833  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.060981  8469 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:59.061441  8469 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.080084 10744 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:26:59.083920  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:26:59.086638  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.055859 10922 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:26:59.091957  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:59.087956 10730 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:26:59.082005  8295 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: config changed from index 6 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.060185 10832 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:59.094822  8295 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.082756 10807 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.081035  9042 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:59.086364 10893 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.085798 10794 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.109640  8295 catalog_manager.cc:5697] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.116238 10744 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.117033 10744 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.100737 10912 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:59.102056 10832 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.123380 10744 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.124578  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.125300  8546 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:26:59.126549  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:59.127221  8389 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:59.107434 10820 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:59.135943 10744 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:59.114748 10807 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.136988 10744 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.148314 10744 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:59.153757  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 49589.6us
I20260709 12:26:59.154438  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:59.132934 10912 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.156370  8438 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:59.119226 10893 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.136549 10820 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.147312 10907 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.133534 10869 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:26:59.149519 10914 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.172609 10744 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.175597  8438 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:59.159049 10880 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:59.130782 10883 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.203303  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.203869  8472 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:59.179003  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:59.204733  8546 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.206276 10917 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:59.207602 10917 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:59.208112 10893 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.208953 10814 raft_consensus.cc:993] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:59.209414 10917 raft_consensus.cc:1081] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:26:59.181274 10914 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.212837 10869 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:59.214607  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:59.214743  8546 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:26:59.215361 10814 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:59.215870 10814 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.215965 10917 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:59.216761 10814 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.215878  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:59.179514 10744 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.159502 10891 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:26:59.176779 10907 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.221346  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:59.221798 10907 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:59.183957 10931 log.cc:927] Time spent T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:26:59.187744 10932 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:26:59.188450 10807 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.176659 10852 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.190119  8469 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.191906 10912 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.193121 10820 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.194149  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:59.198765 10880 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.224423 10744 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:26:59.224155  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 48625.8us
I20260709 12:26:59.224186  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:59.225657  8361 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:26:59.187148  8543 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:26:59.252692  8396 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:26:59.253099  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:59.253783  8546 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.218880 10832 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.238008  8470 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:59.243391  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:59.254084  9016 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:59.263221  8393 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:26:59.236171 10879 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:59.273615  8469 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.260936  8546 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:26:59.240832 10823 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:59.244287 10855 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.282068  9016 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:59.292801  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:59.234648 10908 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:26:59.304154  8438 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:59.311049 10744 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.296661 10907 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:59.296351 10823 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:59.298310  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:59.300660 10914 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:26:59.315045  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 99611.7us
I20260709 12:26:59.291723 10922 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.314682 10891 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:59.309672 10917 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:26:59.340660  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 115078us
I20260709 12:26:59.311527 10805 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.342193  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:59.297411 10855 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:59.380247  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 65696.3us
I20260709 12:26:59.314235 10907 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.383320 10907 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:59.383654 10940 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:59.343973  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:59.344157 10904 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:59.299191 10871 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.382620  8438 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:59.340876  9045 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.319571 10927 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.389919  8546 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:59.390475 10951 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:59.392630  8538 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:26:59.390967  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.391592  8540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49268
I20260709 12:26:59.391305 10922 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:59.392175 10950 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:26:59.380129 10914 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.392706 10832 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.391249 10938 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.393707  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.315593 10880 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.385603  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.419137  8540 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:59.444638  8540 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.416605  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:59.433859 10879 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.384588 10926 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:59.386379 10904 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.384003 10917 raft_consensus.cc:697] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.386137 10794 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:59.440757  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.442817  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.443989  9044 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:59.446866 10744 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:26:59.449083  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 66546.6us
I20260709 12:26:59.384240 10940 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.405191 10805 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.460928  8468 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:26:59.386544 10823 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.465653  8540 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.456899  8510 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:26:59.430222 10927 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.459050 10904 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:59.492640  8540 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:59.496480 10744 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:59.497077 10744 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.443673 10914 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.493629  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:59.501938 10744 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.459473 10959 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:59.505213  8468 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.512482  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.512878  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.513093  8538 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:26:59.514537  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.515194  8472 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:26:59.517619  9043 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:59.447983 10938 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.478828 10794 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.530400 10923 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:59.577737  9044 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:26:59.578164  9044 pending_rounds.cc:85] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Aborting all ops after (but not including) 4
I20260709 12:26:59.530545 10905 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.532050 10940 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:26:59.532603 10946 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:26:59.532948 10917 consensus_queue.cc:237] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.537146 10927 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.537314  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:26:59.537770 10958 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:26:59.541850  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.596050  8469 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:26:59.546151  8468 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:26:59.518455  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:59.597517  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 79154.6us
I20260709 12:26:59.583194 10744 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:59.598829 10744 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:59.587739  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 93526.4us
I20260709 12:26:59.510672 10855 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.578403  9044 pending_rounds.cc:107] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:26:59.601545 10962 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.593849  8393 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:26:59.601825  9044 raft_consensus.cc:2917] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:26:59.602350  9044 raft_consensus.cc:2889] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:59.604317  8361 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.936s (SENT) [suppressed 1 similar messages]
I20260709 12:26:59.605805  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.606187  8544 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:59.607334  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:59.607957  8538 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.577031 10914 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:59.581372 10832 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:59.614732  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:26:59.616740  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 159931us
I20260709 12:26:59.619302  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:59.511940 10959 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.631062  8538 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:26:59.617166 10927 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.620904 10870 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:59.620761 10871 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.589134 10879 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.639665 10970 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:59.623903 10914 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:59.641940  9045 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:26:59.587931 10923 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.593851 10905 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.650938  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:26:59.627871 10926 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:26:59.607859 10958 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.621436 10832 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.645258 10870 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:26:59.652763 10960 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:26:59.654757  9050 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:59.645239 10898 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.664948 10905 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.668092 10904 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:26:59.669178 10948 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:26:59.669507  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.653556  8361 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:26:59.638257 10805 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.643020 10914 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.663987  9048 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:26:59.644140 10970 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.686060  8464 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:26:59.643709 10927 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.695112 10927 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.695267 10938 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.695519 10970 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:59.696036 10975 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:26:59.697011 10832 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.697933 10794 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.671451 10926 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.698639 10914 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:59.699043 10958 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.679433 10960 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.700910 10923 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.701905 10953 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:59.702541 10959 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.703161  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:26:59.690480 10964 consensus_queue.cc:1059] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:26:59.699039 10805 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:26:59.704909 10870 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:59.650792 10978 raft_consensus.cc:670] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:26:59.686373 10898 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:26:59.726718  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 75872.5us
I20260709 12:26:59.733281  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.744484  8463 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:26:59.736333  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.728703 10927 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:59.721868 10907 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.753872  8472 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:26:59.746666  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.748894  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.750205 10960 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.750595 10965 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.734772 10958 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.752243 10926 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.752738 10898 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.754812  9047 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:26:59.758519  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:26:59.759835  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:26:59.768258  9045 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:59.769472 10976 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:59.770017 10976 raft_consensus.cc:697] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.825299  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.826465  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.743894 10807 raft_consensus.cc:3055] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:59.796614  9045 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:26:59.822471  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:59.821102  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:26:59.821465  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.771572  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.739290 10951 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.840811  8472 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:59.842362  9044 raft_consensus.cc:2368] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
I20260709 12:26:59.843573  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.845863  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:26:59.770165 10904 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:59.765394 10927 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:26:59.864818  8540 pending_rounds.cc:85] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 4
I20260709 12:26:59.935688  8540 pending_rounds.cc:107] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 12:26:59.820663 10907 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:26:59.912915 10970 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.764531 10811 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
W20260709 12:26:59.915917 10941 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:26:59.916253 10951 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.841871 10807 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:26:59.931281  8472 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:26:59.845090  8545 raft_consensus.cc:2393] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:59.920075 10794 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.778203 10958 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:26:59.953202 10794 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.954599 10958 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:26:59.955298 10794 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.937250  8540 raft_consensus.cc:2917] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 12:26:59.937556 10976 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.956068  8540 raft_consensus.cc:2889] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:59.938082 10927 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.778059 10965 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:26:59.960865 10965 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:26:59.962693  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:26:59.963318  9044 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:26:59.973968  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.975003  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.975965  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.977766  8465 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:59.980348  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.980551  8538 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:59.980763  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:26:59.981467  8472 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:59.982995  8465 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:26:59.999193  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.000052  8465 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:00.008620  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.028744  8465 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:26:59.998523 10922 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:00.008528 10794 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:00.043421  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.043641  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.044024  8396 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:00.048815  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.045486  8396 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:00.044466  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.049906  8394 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:00.050436 10913 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:00.050827  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.050956 10913 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.047502 10811 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:00.053073  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1674) took 1535 ms (client timeout 1936 ms). Trace:
I20260709 12:27:00.053648 10811 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:00.053755  8543 rpcz_store.cc:269] 0709 12:26:58.517485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.517943 (+   458us) service_pool.cc:224] Handling call
0709 12:27:00.052905 (+1534962us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54000384d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:00.052992 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292385152}
I20260709 12:27:00.055770 10811 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.057049  8470 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.071481  8470 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:00.070729  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.071830  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.070483  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.086055  8545 raft_consensus.cc:2393] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:00.086247  8394 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:00.053073  8391 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.086726  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:00.075608  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.049953  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.081830  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.070439  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.088225  8543 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:00.088295  8544 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:00.070744  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.092937  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.093541  8472 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:27:00.093713 10914 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.038462 10922 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.095985 10970 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:00.097225  8537 raft_consensus.cc:2393] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:00.085577  8392 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:00.097761  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:00.100104  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:00.100705  9044 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:00.043774 10991 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.006s
I20260709 12:27:00.058494  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 252) took 1466 ms. Trace:
I20260709 12:27:00.107532  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:00.105629  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.050071  8396 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.108587  8394 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:00.109448  9044 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:00.109942  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.110064  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.110419  8510 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:00.110550  8546 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:00.111096  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.112985  8396 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.114202  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.041332 10794 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.031258 10807 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.208359  8391 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:00.270123  8396 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:00.114861  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.203665  8395 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:00.096011 10922 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:00.307668 10954 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.765s	user 0.000s	sys 0.002s
I20260709 12:27:00.322523  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:00.182106 10990 log.cc:927] Time spent T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 12:27:00.322402  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.326341  8390 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:00.114416 10918 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:00.171190 10897 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.328508 10897 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.333092  8391 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:00.334050  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.337491 10988 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.337983 10988 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.341621  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.342917 10744 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.278676 10855 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.120980 10970 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:00.181414 10910 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:00.297058 10914 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.277585 10852 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.211367 10870 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.220157 10882 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.330454  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:00.345372  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 247678us
I20260709 12:27:00.346515 10967 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.349076  8438 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.353304  8396 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:00.343590 10855 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.329703 10807 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.344089 10970 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.345435 10910 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:00.354631 10911 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.378509  8436 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:00.400712  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:00.353652 10992 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.401813  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:00.404532  8466 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.401582  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1610) took 1149 ms. Trace:
I20260709 12:27:00.403800 10744 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:00.406607 10744 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.406966 10744 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.107719  8293 rpcz_store.cc:276] 0709 12:26:58.591901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.592043 (+   142us) service_pool.cc:224] Handling call
0709 12:27:00.058396 (+1466353us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:59.143716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:59.194237 (+ 50521us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:59.194274 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:59.194296 (+    22us) tablet.cc:662] Decoding operations
0709 12:26:59.194668 (+   372us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:59.194732 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:59.194765 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:59.194954 (+   189us) tablet.cc:701] Row locks acquired
0709 12:26:59.194972 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:59.195126 (+   154us) write_op.cc:270] Start()
0709 12:26:59.195223 (+    97us) write_op.cc:276] Timestamp: P: 1783600019195076 usec, L: 0
0709 12:26:59.195243 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:59.315708 (+120465us) log.cc:844] Serialized 535 byte log entry
0709 12:26:59.639760 (+324052us) op_driver.cc:464] REPLICATION: finished
0709 12:26:59.765547 (+125787us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464384e28 00007f6467dbf581 00007f6467dbed58 00007f6467dc39f1 00007f6467dc39a9 00007f6467dc3939 00007f6467dc3901 00007f6467dc2b2d 0000000000388634 0000000000388479
0709 12:27:00.007569 (+242022us) write_op.cc:301] APPLY: starting
0709 12:27:00.027333 (+ 19764us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:00.035645 (+  8312us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:00.035671 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:00.052817 (+ 17146us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:00.052999 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:00.053046 (+    47us) write_op.cc:312] APPLY: finished
0709 12:27:00.053231 (+   185us) log.cc:844] Serialized 23 byte log entry
0709 12:27:00.053438 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.053513 (+    75us) write_op.cc:454] Released schema lock
0709 12:27:00.053557 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:00.053945 (+   388us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.053971 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":340921,"apply.run_cpu_time_us":4088,"apply.run_wall_time_us":55336,"num_ops":1,"prepare.queue_time_us":202546,"prepare.run_cpu_time_us":28601,"prepare.run_wall_time_us":634373,"raft.queue_time_us":126785,"raft.run_cpu_time_us":30596,"raft.run_wall_time_us":299489,"replication_time_us":426126,"spinlock_wait_cycles":63534848,"thread_start_us":411631,"threads_started":4,"wal-append.queue_time_us":167144}]]}
I20260709 12:27:00.359570 10970 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.418591 10985 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:00.419153 10985 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:00.418658 10910 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.353665 10870 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.356433 10882 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.351058 10852 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.421183  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:00.423053 10744 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.401507 10976 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:00.402907 10832 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.405416  8467 rpcz_store.cc:276] 0709 12:26:59.226390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.226626 (+   236us) service_pool.cc:224] Handling call
0709 12:26:59.226891 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.250171 (+ 23280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.250201 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.264398 (+ 14197us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.462000 (+197602us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:59.462038 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:59.462100 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.298810 (+836710us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:00.359142 (+ 60332us) raft_consensus.cc:1685] finished
0709 12:27:00.359162 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.376225 (+ 17063us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17340,"raft.queue_time_us":23675,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":10095,"spinlock_wait_cycles":16933760,"thread_start_us":156061,"threads_started":1,"wal-append.queue_time_us":178264}
I20260709 12:27:00.401376 10958 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:00.400177 10914 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.404456 10988 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:00.424566 11003 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:27:00.416625 10981 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:00.419538 10985 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.356295 10967 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.415750 10927 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:00.428529  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:00.427191  8466 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:00.438776 10855 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.430508 10744 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.411954 10911 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.415890 10992 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.443818  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.444813  8538 raft_consensus.cc:2393] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:00.432024 10988 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:00.441440  8545 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:00.426846 10823 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:00.424429 10976 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.452651  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:00.454823  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.454943  8539 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.428503 10958 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.429131 10914 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.437564 10927 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.450747 10794 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.466069 10958 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.456197 10891 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:00.467870 10891 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.468220 10891 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.468382 10976 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.451745 10823 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.475483 10913 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.476311 10897 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.476562  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 422) took 1040 ms. Trace:
I20260709 12:27:00.434545 10981 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.476816  8294 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:00.478637 10981 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.480144  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.480785  8466 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:27:00.457815 10988 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.481405 10992 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.482146  9050 rpcz_store.cc:276] 0709 12:26:59.436175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.476439 (+ 40264us) service_pool.cc:224] Handling call
0709 12:26:59.651249 (+174810us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.677181 (+ 25932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.476353 (+799172us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540041f850. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:00.476487 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325131008}
I20260709 12:27:00.482904 10988 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.475648 10823 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.486423 10832 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:00.492337 10914 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.493522 10882 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.461752 10911 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.496531 10870 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.497008  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.496619  8467 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.497972  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:00.498124  8438 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.499775  8438 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.464057 10967 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.500995  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.504237  8466 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:00.504331  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.475224  8295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 292) took 1541 ms. Trace:
I20260709 12:27:00.505350  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:00.495568 10823 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.461334 10927 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.519021  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:00.520653  8392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60370
I20260709 12:27:00.521251  8392 raft_consensus.cc:606] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Received request to transfer leadership
I20260709 12:27:00.521895  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.522111  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.522325  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.522902  8388 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:00.523312  8396 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:00.517643  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.515517  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.523675  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.524098 10744 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:00.476395 11005 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:27:00.519515  8539 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:00.506279 10870 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.524753  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.528556  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.532437  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.525504 10988 raft_consensus.cc:2764] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:27:00.531582 10992 raft_consensus.cc:2764] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:27:00.534192  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.535306  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.535486 10823 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.535930  8389 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.536288  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.538648 10985 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.506453 10911 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.539709  8463 raft_consensus.cc:2368] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:00.542270  8392 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:27:00.543334  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.508165  8295 rpcz_store.cc:276] 0709 12:26:58.933762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.933902 (+   140us) service_pool.cc:224] Handling call
0709 12:27:00.475160 (+1541258us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:59.864103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:59.917844 (+ 53741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:59.917873 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:26:59.917890 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:59.918415 (+   525us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:59.918463 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:59.918492 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:59.918807 (+   315us) tablet.cc:701] Row locks acquired
0709 12:26:59.918823 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:26:59.918956 (+   133us) write_op.cc:270] Start()
0709 12:26:59.919056 (+   100us) write_op.cc:276] Timestamp: P: 1783600019918914 usec, L: 0
0709 12:26:59.919075 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:26:59.925102 (+  6027us) log.cc:844] Serialized 1411 byte log entry
0709 12:26:59.939773 (+ 14671us) op_driver.cc:464] REPLICATION: finished
0709 12:27:00.071118 (+131345us) write_op.cc:301] APPLY: starting
0709 12:27:00.071188 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:00.071322 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:00.071441 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:00.220139 (+148698us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:00.243858 (+ 23719us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:27:00.270015 (+ 26157us) write_op.cc:312] APPLY: finished
0709 12:27:00.273413 (+  3398us) log.cc:844] Serialized 35 byte log entry
0709 12:27:00.273602 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.274624 (+  1022us) write_op.cc:454] Released schema lock
0709 12:27:00.275011 (+   387us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:00.275379 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:00.275421 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":131106,"apply.run_cpu_time_us":5520,"apply.run_wall_time_us":204208,"mutex_wait_us":40928,"num_ops":3,"prepare.queue_time_us":710147,"prepare.run_cpu_time_us":2852,"prepare.run_wall_time_us":81091,"replication_time_us":20575,"thread_start_us":93771,"threads_started":1}]]}
I20260709 12:27:00.549999  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.508008 10832 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:00.533577  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.555588  8391 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:00.550711  8392 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:27:00.556247  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:00.517339 10967 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
W20260709 12:27:00.567245  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.567848  8464 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:00.567986  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.573160  8467 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:00.574407  8391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60370
I20260709 12:27:00.574958  8391 raft_consensus.cc:606] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Received request to transfer leadership
I20260709 12:27:00.574925  8389 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:00.577589  8438 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:00.577960  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.578625  8393 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.579655  8512 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:00.584808  8436 leader_election.cc:400] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
W20260709 12:27:00.585439  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 57631.3us
I20260709 12:27:00.589130  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.574214 10891 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.590502  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.591323  8546 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:00.591826 11008 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:00.592245  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.592923  8544 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:00.593829  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.594246 11014 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.594329 10832 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:00.594817 10832 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.595227 10832 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.594583  8540 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:00.597668 10992 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:00.594833 11014 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.598161 10992 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:00.599002 10992 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.600031  9042 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:00.601158  8512 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:00.602573 10871 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:27:00.594934  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:00.603237 10896 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:00.603705 10896 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.603799  8537 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.604095 10896 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.608304  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.608958  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.609983  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.610417 10870 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:00.610512  8465 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:00.610847 10870 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.611294  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.611665  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.611997  8465 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:27:00.612334  8467 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:00.612754  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.613337  8467 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:00.614650 10976 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:00.615186  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:00.615734  8466 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:00.613399  8465 raft_consensus.cc:2393] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:00.617885  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.618491  8397 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:00.593932  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.619882  8391 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:00.617314  8537 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:00.626359  8436 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.627204 10744 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.628671  8464 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:00.629510  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.634191  8466 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:00.637158  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:00.637880  9043 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:27:00.641621  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:00.642257  8389 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.611235 10870 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:00.662076  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.664738  8470 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:00.666077 10744 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:00.654417  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.666710  9045 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:00.667029  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.658383  8389 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:00.660353  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:00.652498  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.670461  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.668889  9045 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:00.672528  8436 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:00.668247 11013 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.623612 10823 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:00.680990 10744 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:00.698062  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.712296  8546 raft_consensus.cc:2368] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:00.698563  8544 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:00.698804  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.700492  8545 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:00.710227  8539 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:00.681159  8391 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:00.718658 10744 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:00.720024  8537 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:00.725936 10744 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:00.652815 10883 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.652613 10894 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.727349 10744 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.720916  8397 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:00.733364  8546 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:00.668744 10893 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.632784 10958 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:27:00.734328 10744 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:00.737221  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.740793  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.741146  8545 raft_consensus.cc:2368] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:00.678140 11009 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:00.741621  8397 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:00.742609  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:00.704866 10823 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.730374 10906 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.731142 10852 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.787326  8542 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:00.797626  9016 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:00.800429  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.802155  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:00.816113  9016 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:00.735957 10894 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.735702 10883 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:00.819350 10944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.031s	sys 0.032s
I20260709 12:27:00.742406 10893 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.829356 10744 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.819168 10978 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:00.843966 10744 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.750610 11009 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:00.845055  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 172609us
I20260709 12:27:00.848991  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.850183  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:00.850718 10744 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.827265 10869 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:00.827275 10944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.289s	user 0.032s	sys 0.032s
I20260709 12:27:00.804808 10906 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:00.868749  8282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 247988us
I20260709 12:27:00.869678 10823 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.866801 10978 raft_consensus.cc:697] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:00.897006 10906 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.896741 10978 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.843043 10918 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.898229 10918 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.880872 11009 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.900218 10918 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.901710 10894 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.840375 10910 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.902529 10910 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.847396 11008 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:27:00.839643 10985 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:00.908238 10883 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.844817 10814 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.909013 10814 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.911000 10814 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:00.845731 10852 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:00.916045 10852 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.918182 10852 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:00.921818  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1710) took 1532 ms. Trace:
I20260709 12:27:00.923678 10938 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.924187 10938 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.925192 10730 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.925704 10730 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.926157 10938 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.922227  8541 rpcz_store.cc:276] 0709 12:26:59.389140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.392831 (+  3691us) service_pool.cc:224] Handling call
0709 12:26:59.393111 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.590976 (+197865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.591004 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.591424 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:26:59.734202 (+142778us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:59.734243 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.113322 (+379079us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:00.921459 (+808137us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400467b54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:00.921511 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:00.921560 (+    49us) raft_consensus.cc:1685] finished
0709 12:27:00.921574 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.921720 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1896,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6671,"spinlock_wait_cycles":466550016,"thread_start_us":113790,"threads_started":1,"wal-append.queue_time_us":229855}
I20260709 12:27:00.930465  8362 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.937352  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:00.938015  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:00.938645  8465 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:00.938962  8469 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:00.940481  8472 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:00.881265 10869 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.883061 10893 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.809564 10970 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:00.989627  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:00.892835 10807 consensus_meta.cc:287] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.535s	user 0.002s	sys 0.007s
I20260709 12:27:00.943192 10915 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:00.969681 10730 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:00.867331 10914 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:00.983572  8362 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:00.992854  8362 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:00.986114  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 309126us
I20260709 12:27:01.023109  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:01.001587 10832 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.005998 10970 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:01.007521 10911 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:00.875164 10896 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:00.984743  8393 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:01.023437 10744 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:00.995180 10976 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:01.032481 10744 raft_consensus.cc:697] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:01.033428 10744 consensus_queue.cc:237] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:01.023895  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 171338us
I20260709 12:27:01.068037  8471 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:27:01.068833  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.025373 10814 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:01.019269 10914 raft_consensus.cc:697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:01.026031 10794 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:01.030920 10985 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:01.079870 10927 consensus_meta.cc:287] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 12:27:01.108465 10870 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.109867  8543 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:27:01.025204 10958 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:27:01.115899  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.116819  8538 raft_consensus.cc:2393] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:01.087719 10794 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.064713 10915 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
W20260709 12:27:01.116779  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 407137us
I20260709 12:27:01.031641 10951 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:27:01.121625 10794 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:01.142930  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 326878us
I20260709 12:27:01.144255  9016 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:01.102720 10985 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:01.149784  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 333770us
I20260709 12:27:01.113619 10927 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.139762 10967 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.142676 10881 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:01.163770 10987 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 1.247s	user 0.004s	sys 0.001s
I20260709 12:27:01.153530 10910 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:01.173173  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.184559  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 341277us
I20260709 12:27:01.139605 10914 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:01.194515  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 146612us
I20260709 12:27:01.174431 10870 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:01.190171  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:01.189340 10910 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.187244 10869 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:01.217620  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 143305us
I20260709 12:27:01.188640 10832 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.172850 10881 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.219201  8394 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:27:01.220999  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 75701.1us
W20260709 12:27:01.205619 11024 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:27:01.222249  9016 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:01.220692  8362 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:01.223765  8511 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:01.171691 10967 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.226269  8361 leader_election.cc:400] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:01.227329  8361 leader_election.cc:403] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:01.205932 10896 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:01.226651  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 74184.4us
I20260709 12:27:01.213894 11035 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:01.228183 10897 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:01.221623 10910 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.243875  9015 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:01.275743  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:01.277854  9015 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:01.228669  8362 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:01.248435  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:01.253863 10891 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:01.278859  8396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.022s
W20260709 12:27:01.286139  8396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.004s	sys 0.022s
I20260709 12:27:01.286746  8542 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:01.287437  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:01.288905  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 60315.9us
W20260709 12:27:01.259439 11038 log.cc:927] Time spent T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:27:01.252583 11020 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:27:01.303174 10744 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:01.303397  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:01.303216  8541 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:01.303875 10744 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.302822  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1471) took 1242 ms. Trace:
I20260709 12:27:01.295130  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.306349  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.306929  8471 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:01.307693  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:01.308338  8471 raft_consensus.cc:2393] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 3: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:01.309005  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.309507  8471 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:01.310570  8471 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:01.295358  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.295958  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.296164  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.311560  8463 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:01.311722  8465 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:01.299926  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.299171  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.232730 10944 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:01.285295 10855 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:01.236855 10881 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.311690  8469 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:27:01.330314  8471 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:01.331050  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:01.331440  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 148099us
I20260709 12:27:01.331599  9045 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.300607  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:01.312721  8464 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:01.291739  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:01.242748 10979 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.313634  8542 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:01.305063  8394 rpcz_store.cc:276] 0709 12:27:00.047973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.110899 (+ 62926us) service_pool.cc:224] Handling call
0709 12:27:01.290354 (+1179455us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54002b5554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:01.290461 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032797952}
I20260709 12:27:01.255021 10908 raft_consensus.cc:993] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower aef8c9f023564378a04e3e1e6171930d to start an election
W20260709 12:27:01.259542 11028 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:27:01.246627 10962 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:01.298499  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.249801 10870 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:27:01.240837 10927 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:01.259058 11035 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:01.302929 11031 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:27:01.289963 10915 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:01.357121  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:01.367281 11032 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.367688 10992 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:01.367877 11032 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.368209 10992 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.370353 10992 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:01.372068  8281 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2d99fb7f1afb4c958cdc302eb8ef165f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:01.374034 10794 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.375662 11046 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.376194 11046 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.378856 11046 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.381450 11035 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.383857  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.249675 11036 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:27:01.300428 11034 raft_consensus.cc:2764] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:27:01.303762 10896 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:01.318542  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.319195  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.319479 11037 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:01.259897 11014 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.261747 10985 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.320549 10805 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.261435 10910 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:01.320056  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 97700.9us
I20260709 12:27:01.319826  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:01.357069 10891 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:01.241345 10967 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:01.323720  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.325362 10744 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.317427  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.328078  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.403928  8472 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
W20260709 12:27:01.337095  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 45441.1us
I20260709 12:27:01.330768  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.335377  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:01.344847  9045 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:01.346079  8544 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:01.404949  8469 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:01.321358 10978 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:01.352777  8466 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:01.312511  8467 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:01.353041  8542 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:01.356645  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.407088  8540 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:01.362594  8468 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:01.348501 10881 raft_consensus.cc:2764] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:01.339761 10938 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.413173 11008 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:01.413671 11008 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.413283 10938 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.414028 11008 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.339510 10852 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.415629 10852 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.417517 10852 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:01.394268  8543 raft_consensus.cc:2393] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:01.359728 10939 raft_consensus.cc:1081] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Signalling peer aef8c9f023564378a04e3e1e6171930d to start an election
I20260709 12:27:01.356341 10962 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.401300  8465 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.418469 10962 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.420712  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:01.421366  9042 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:01.421636 11041 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:01.422255 10744 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:01.422734 10744 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.423259  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.423733 10891 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.424774 10744 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:01.425809 10891 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:01.430540 10962 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.431541 11045 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:01.432246 11045 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.409017  8539 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:01.346140 11013 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:27:01.434052 10794 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:01.410825  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 75529.6us
I20260709 12:27:01.434739 11037 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.435164  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:01.436342  8511 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:01.436746 10896 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:01.436993 11037 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:01.437137 10896 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.348187 11025 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:27:01.432564 11032 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:01.434346 11045 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.361650 10958 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:01.402216  9044 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:01.406400  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:01.458189  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 51867.1us
I20260709 12:27:01.437131  8511 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:01.443722  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.454463  8361 leader_election.cc:400] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:01.475216  8361 leader_election.cc:403] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:01.515360  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 78282.5us
I20260709 12:27:01.516192  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:01.517560  8511 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:01.418191 10914 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.437870 10896 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:01.529888  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.354938 10979 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:01.535065  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 80761.5us
I20260709 12:27:01.528168  8362 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:01.410899 10978 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:01.533437 11032 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:27:01.515018 10944 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:27:01.557163 10744 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.557701 10744 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.460167 10938 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:01.459846 10869 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:01.699596  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 146972us
I20260709 12:27:01.431463 11008 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.457273 10981 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:01.692554  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:01.528894 11041 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:01.516337 11037 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:01.515938 10970 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:01.437295 10967 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:27:01.432951 10922 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
W20260709 12:27:01.700870  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 139386us
I20260709 12:27:01.700173 10855 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.532706 10870 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:01.701534 11013 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.534735 10958 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.562844 10823 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:01.744451  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 216355us
I20260709 12:27:01.556231 10978 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:01.533385 10893 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:01.768522  8544 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:01.548432 10951 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:01.814810  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.700675 10871 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:01.699764 10891 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.814847 10744 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.552495 10910 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:01.791654  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:01.818372  9050 raft_consensus.cc:2368] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9.
I20260709 12:27:01.818529  8465 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:01.739154 10832 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:01.798626  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.798640  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.804355  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:01.745124 10985 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.692222 11029 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:27:01.741636 11041 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.825505  8362 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:01.813937  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:01.760908 10970 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.543879 10914 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.762495 10927 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.833443 10897 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.837994  8469 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.840405 10744 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.730846 10869 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.779829 10870 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.876317 10744 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.878456  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:01.792552 11008 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:01.762521 11037 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.881681  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:01.814641 10893 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.782689 10915 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 12:27:01.898756  9050 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:01.830024 10910 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.782370 10855 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.824898 10823 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.826510 11013 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.876719 10965 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.150s
I20260709 12:27:01.977810  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:01.952780  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 127344us
I20260709 12:27:01.841627 10985 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:01.834514 10891 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:01.977103 10744 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:01.845369 10970 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:01.988966  8469 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:02.085103  8394 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:01.877832 10944 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:01.841595 11041 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:02.068480  8539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.017s	sys 0.005s
W20260709 12:27:02.089713  8539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.017s	sys 0.006s
I20260709 12:27:02.071935  8542 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:02.093369  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:01.887283 10870 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.086355  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:02.040874  8511 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:02.085198  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.023509  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:02.088954  8545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49268
I20260709 12:27:01.937786 10852 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:02.096122 10911 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:01.932896 11047 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 12:27:01.931659 11051 log.cc:927] Time spent T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:27:01.939845 10914 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.098834  8469 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:01.899477 10962 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:01.907107 10893 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.103884  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.096546 10744 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.105147  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.105374  8362 leader_election.cc:400] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:02.105923  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:01.935648 10992 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:01.936421  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:02.060405 10938 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.061630 10910 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:02.108527  8540 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:02.081632  8543 raft_consensus.cc:2955] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:02.060707 10939 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:02.097306  8468 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:02.062883 10988 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.062743 10794 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:01.837332 10832 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:01.938515 10896 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.124915  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:01.900101 10897 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:02.146643  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.127226  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.148834  8388 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:02.149317  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.149607  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.096288 10976 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:27:02.118748 10744 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.098398 10852 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:02.108047 11040 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:02.142553 10832 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:02.143507  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:01.887135 10927 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.126327  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.114888 10908 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:27:02.153543  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:02.143594 11066 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:02.099313 10942 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:27:02.123464 10951 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:27:02.178587 10823 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.189529  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.217849 11040 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.220141  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.217232 10962 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.220242  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.224380 11037 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.144903 10938 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.146796 10988 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.228446 10915 raft_consensus.cc:1064] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:27:02.229364 11041 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.229753  8545 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:02.212755 10794 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.116190 10911 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.227147 10896 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:02.169236 10958 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:02.258292  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.197019 10870 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.259557 10744 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.137473 10992 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.264151  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.224817 10897 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:02.144279 10939 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.225502 10832 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:02.237037 11066 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.151064 10913 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:27:02.275305  8545 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.152513 10979 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.425411  8537 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:02.425556  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.426172  8393 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.278378 11041 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.278792  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:02.279844 11013 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.281339 10976 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:02.331236  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 241249us
I20260709 12:27:02.264611 11040 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.361896  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.399814  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.449637  8395 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:02.406032  8468 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:02.407541  8469 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.408548  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:02.451845  8464 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:27:02.411278  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:02.361227 10915 raft_consensus.cc:1068] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Unable to promote non-voter e3660d999c0a41658a1f1dbe7cc90746: Service unavailable: leader transfer in progress
I20260709 12:27:02.413576  8390 raft_consensus.cc:2368] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 3. Current term is 4.
W20260709 12:27:02.422175  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 261528us
I20260709 12:27:02.399147 10869 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:02.276376 10852 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.270129 10962 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.423233 11066 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.444619  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.446436 10870 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:02.452692  8465 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:02.461272  8469 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:27:02.489166 11065 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:27:02.477269 11036 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:02.436825 11070 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.427448 10985 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.494469 10970 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.417563 11046 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:27:02.477659 10976 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:02.495368  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 46781us
W20260709 12:27:02.424368  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 383554us
I20260709 12:27:02.422650 10832 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.452857  8545 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:27:02.576731  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 473532us
I20260709 12:27:02.644456  8544 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:02.647806  8469 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.646873  8394 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:02.651767  8511 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:02.497645  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.659657  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:02.652714  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:02.497367  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.654280  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.520211  8393 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:02.658528 10744 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.659251  8465 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:02.651883  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1651) took 1122 ms. Trace:
I20260709 12:27:02.659878  8397 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:02.665407  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.665895 10794 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.666539  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.667789  8389 raft_consensus.cc:2368] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
I20260709 12:27:02.668452  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.668942  8389 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:02.662086 11070 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.662158 11036 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.669659  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.674371  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.677552  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.678632  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.680217  8389 raft_consensus.cc:2393] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:02.680658  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.687351  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.662190  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.669659  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1755) took 1334 ms. Trace:
I20260709 12:27:02.661005  8511 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:02.699383  8540 rpcz_store.cc:276] 0709 12:27:01.334724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.407692 (+ 72968us) service_pool.cc:224] Handling call
0709 12:27:01.794592 (+386900us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.130904 (+336312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.669467 (+538563us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540006aed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:02.669604 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703455104}
I20260709 12:27:02.706923  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.707731  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.626891 10891 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.612571 11045 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.709604 11036 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:02.709363 11045 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.495560 11013 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.215s
I20260709 12:27:02.711445  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.712030  8545 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:02.712899  8538 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:02.705683 10744 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.718066  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:02.587482 10852 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:02.718787  8390 raft_consensus.cc:2376] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8. Re-sending same reply.
W20260709 12:27:02.721230  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 60296.8us
I20260709 12:27:02.724180  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.495663 11076 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.629724 10855 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:02.725986  8389 raft_consensus.cc:2410] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:27:02.747773  8397 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:02.688450 10869 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:02.662663  8463 rpcz_store.cc:276] 0709 12:27:01.529086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.529542 (+   456us) service_pool.cc:224] Handling call
0709 12:27:01.533125 (+  3583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.698229 (+165104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.698285 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:01.704924 (+  6639us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.237971 (+533047us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:02.238013 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.238076 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.445490 (+207414us) raft_consensus.cc:1685] finished
0709 12:27:02.445507 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.651827 (+206320us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206118,"raft.queue_time_us":166186,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":408837,"threads_started":1,"wal-append.queue_time_us":675913}
I20260709 12:27:02.702093 10882 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:02.771468  8393 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:02.618643 11029 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.121s
I20260709 12:27:02.772117  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.645674 10913 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:27:02.776768 10744 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.797652  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:02.821396  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:02.822508  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:02.823045  8466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.024s	sys 0.019s
W20260709 12:27:02.825371  8466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.024s	sys 0.019s
I20260709 12:27:02.809178  8469 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:02.743207 11063 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:02.774631  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:02.739989 10911 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.835690  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.836274  8540 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:02.747815 11036 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:02.832386  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1680) took 1396 ms. Trace:
I20260709 12:27:02.830811  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.831449  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.774044 10869 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.839732  8539 rpcz_store.cc:276] 0709 12:27:01.435669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.435929 (+   260us) service_pool.cc:224] Handling call
0709 12:27:01.436278 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.439597 (+  3319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.439701 (+   104us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:01.453446 (+ 13745us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.090088 (+636642us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:02.090126 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.090184 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.832194 (+742010us) raft_consensus.cc:1685] finished
0709 12:27:02.832213 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.832330 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6841,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":61857,"thread_start_us":527547,"threads_started":1,"wal-append.queue_time_us":563860}
I20260709 12:27:02.815774 10915 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.849742  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.852336  8395 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:02.819633 10965 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.814293 10882 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.816303 10870 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:02.885509  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.885859  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.831903 10967 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:02.825752 10938 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:02.838873 10939 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.839569 11036 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.892974  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.893963  8393 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:02.725986 11078 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.190s
I20260709 12:27:02.742547 11085 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.169s
I20260709 12:27:02.743901 11076 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.848907 10869 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:02.898600  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.916378  8540 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:02.853193 10911 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:02.887440 10882 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:02.920966  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.902606  8395 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:02.847646 10927 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:02.907342  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 269530us
I20260709 12:27:02.908356  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:02.934932  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 228243us
I20260709 12:27:02.941191  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:02.894838 10992 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:02.900782 10938 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:02.838022 11063 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.906297 10855 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:02.906418 11036 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:02.901060 10967 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:02.944823  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 217210us
I20260709 12:27:02.977979  9016 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:02.966886  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.967628  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:02.909344 11067 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:02.885324 10915 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.967619 11029 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.936110 11070 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:02.892140 10870 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:02.989634  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 149682us
I20260709 12:27:02.890867 10965 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.942001 10911 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.108894  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.116698  8544 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:03.009982  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:03.029969  8391 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60370
I20260709 12:27:03.118779  8391 raft_consensus.cc:606] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Received request to transfer leadership
I20260709 12:27:03.056097  8389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:03.130587  8389 raft_consensus.cc:606] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:03.131035  8389 raft_consensus.cc:614] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:03.107465 11045 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.167610 10967 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:02.968650 10855 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.177846  8471 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:02.969838 11035 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:03.173250  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:03.182487  8540 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:27:03.182596  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:03.171432  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 226419us
W20260709 12:27:03.180199  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 65143.9us
W20260709 12:27:03.171335 11081 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
W20260709 12:27:03.181072  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 236612us
W20260709 12:27:03.170194 11075 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 12:27:03.180718  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:03.023310 10970 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:02.989197 10897 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.191731  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:02.990679 10938 raft_consensus.cc:697] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:03.106920 11087 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:27:03.179154 10855 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:03.203903 11093 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.205106 11070 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:03.206068 11045 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:03.206897  8472 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:27:03.172045 11086 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:27:03.171605 11100 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:27:03.208292  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:02.990307 10992 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.117146 10976 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:03.056488 10962 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:03.135243 11088 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
W20260709 12:27:03.202884 10893 consensus_meta.cc:287] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 1.063s	user 0.008s	sys 0.002s
I20260709 12:27:03.236395  8467 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
W20260709 12:27:03.134984 11089 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
W20260709 12:27:03.246017  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 49510.1us
I20260709 12:27:03.184645  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:03.057245 10832 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.095271  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:03.024477 11029 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:02.992596 11067 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.277029  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:03.270160  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 292265us
I20260709 12:27:03.207154 10914 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:27:03.235778 10794 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:27:03.268414 11093 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:03.289988 10805 consensus_meta.cc:287] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.887s	user 0.020s	sys 0.000s
I20260709 12:27:03.199620 11035 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:03.249511 10897 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:03.317545 11103 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:27:03.321624  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:03.282928 10962 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:03.262462 11098 consensus_queue.cc:1059] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:27:03.268893 11070 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:03.327855  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1583) took 1199 ms. Trace:
I20260709 12:27:03.331641  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1763) took 1291 ms. Trace:
I20260709 12:27:03.287961 10893 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.273413 10992 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.332351  8546 rpcz_store.cc:276] 0709 12:27:02.040550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.040660 (+   110us) service_pool.cc:224] Handling call
0709 12:27:02.088920 (+ 48260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.089239 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.089265 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.104584 (+ 15319us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.425880 (+321296us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:02.425917 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.426043 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.331430 (+905387us) raft_consensus.cc:1685] finished
0709 12:27:03.331448 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.331582 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9729,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5828,"thread_start_us":303263,"threads_started":1,"wal-append.queue_time_us":523418}
I20260709 12:27:03.332260  8396 rpcz_store.cc:276] 0709 12:27:02.120708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.121471 (+   763us) service_pool.cc:224] Handling call
0709 12:27:02.121772 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.480781 (+359009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.480814 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.481457 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.906736 (+425279us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:02.906792 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.906900 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.319964 (+413064us) raft_consensus.cc:1685] finished
0709 12:27:03.319984 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.320095 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35142,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":634219,"threads_started":2,"wal-append.queue_time_us":534768}
W20260709 12:27:03.342906  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 143702us
I20260709 12:27:03.343359  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1682) took 1274 ms. Trace:
I20260709 12:27:03.313009 10939 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:03.345471  8543 rpcz_store.cc:276] 0709 12:27:02.068849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.070280 (+  1431us) service_pool.cc:224] Handling call
0709 12:27:02.081171 (+ 10891us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.081517 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:02.200476 (+118959us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.661959 (+461483us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.701137 (+ 39178us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.701300 (+   163us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:02.701333 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.701397 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.343168 (+641771us) raft_consensus.cc:1685] finished
0709 12:27:03.343186 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.343302 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1117,"raft.queue_time_us":22287,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":9227,"thread_start_us":459972,"threads_started":1,"wal-append.queue_time_us":699789}
I20260709 12:27:03.355765  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.355985  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.356068  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.357250  8545 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:03.361079  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.361761  8543 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:27:03.329039 10805 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:03.289469 11097 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:27:03.333561 10852 consensus_meta.cc:287] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.003s
I20260709 12:27:03.365212  8544 raft_consensus.cc:1240] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:27:03.365963  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:03.340337 11095 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:27:03.367345  8469 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.367601  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:03.396202  8546 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.362653  9046 raft_consensus.cc:2410] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:27:03.402220  8394 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:03.362269 10976 raft_consensus.cc:3055] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:03.334736 10962 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.411972  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:03.363137 11070 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:03.415025  8464 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:27:03.395128 10794 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.416435  8512 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:03.322528 10938 consensus_queue.cc:237] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.419983  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:03.428893  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:03.416661  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 97150.2us
I20260709 12:27:03.367298 11076 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.436419  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:03.399446 11101 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.452791  9014 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:03.371592 10915 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:03.456125  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 82306.1us
I20260709 12:27:03.457155  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:03.457742  8464 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:03.457901  8396 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:03.458559  8396 raft_consensus.cc:606] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Received request to transfer leadership to TS e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:03.410653 10976 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:03.408836 11063 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:03.470422  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:03.363109 10939 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.478899  8464 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.479758  8546 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:27:03.484897  8469 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:27:03.421770 11115 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.421756 10911 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.454636 11070 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.454099 10794 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:03.519244  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 61367us
I20260709 12:27:03.538036  8464 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
W20260709 12:27:03.539546  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 86838.8us
I20260709 12:27:03.511960  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:03.540221  8472 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:03.455767 11032 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.464270 10965 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:03.560164  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.509595 10870 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:03.546132 10871 consensus_meta.cc:287] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.717s	user 0.011s	sys 0.001s
W20260709 12:27:03.562932  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.564297  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:03.583913 11104 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.593452  8464 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.540266 10970 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.464725 11101 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:03.591224  8472 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:03.540035 11115 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.607981 11104 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.606669 11132 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:03.612888  8362 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:03.614071  8464 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
W20260709 12:27:03.607275 11106 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:27:03.616967  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:03.619908  8472 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:03.584403 11109 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.623720 11117 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:27:03.634328 11109 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:03.621335 10978 consensus_meta.cc:287] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 1.780s	user 0.012s	sys 0.000s
I20260709 12:27:03.636565 10978 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:03.637017 11036 consensus_meta.cc:287] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.645s	user 0.007s	sys 0.001s
I20260709 12:27:03.637454 11036 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.638552 11101 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.627830 10897 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.622107 11097 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:03.628782 10962 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.629042 10939 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.616247 11029 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:03.621858 10976 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:03.631578 11115 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:03.631769 11068 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 1.480s	user 0.006s	sys 0.000s
W20260709 12:27:03.629406 11113 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:27:03.633522 11104 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.639954  8545 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:27:03.627202 11066 consensus_meta.cc:287] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.925s	user 0.006s	sys 0.017s
I20260709 12:27:03.561123 11032 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.603446 10871 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.644237  8468 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:27:03.647097  9048 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:03.629657 10910 consensus_meta.cc:287] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 1.482s	user 0.011s	sys 0.001s
W20260709 12:27:03.650839 11112 log.cc:927] Time spent T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:27:03.617895 10970 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.636580 11035 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.864677  8511 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:03.710713  8540 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:27:03.735018  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 180193us
I20260709 12:27:03.866477  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:03.867341  9014 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:03.644127 10992 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.880972  8511 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:03.710193  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 62267.9us
I20260709 12:27:03.882927  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:03.646030 11097 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:03.799876 11054 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 1.568s	user 0.000s	sys 0.003s
W20260709 12:27:03.719434 10869 consensus_meta.cc:287] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.768s	user 0.003s	sys 0.006s
W20260709 12:27:03.721406 11040 consensus_meta.cc:287] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.222s	user 0.002s	sys 0.009s
W20260709 12:27:03.856819 10882 consensus_meta.cc:287] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.906s	user 0.006s	sys 0.002s
W20260709 12:27:03.852725 11123 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:27:03.885876  8511 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:03.884820  8392 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:03.889474  8362 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:03.685040 11109 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.657209 10915 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.237s
I20260709 12:27:03.881340 11052 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:03.883960 11115 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:03.886713 11097 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.915599  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 232) took 2111 ms. Trace:
I20260709 12:27:03.882895 10910 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.925732 11136 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:03.927031 10910 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.924978 10988 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.926141 10893 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.913281  8511 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:03.886588 10896 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:03.898348 11036 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.928280  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1637) took 2632 ms. Trace:
I20260709 12:27:03.896981 11041 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:27:03.897408 11058 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:03.928901 11058 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.929055 11036 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:03.929301 11058 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:03.929620 11036 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:03.880149 11066 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.930495 11036 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.931897 11066 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.916380 11032 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.934263  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:03.915180 11134 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:03.934564 11067 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.935091  9048 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:03.923128 11133 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:03.935091 11032 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:03.936172 11032 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.936503 10794 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:03.936614 11032 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:03.918572 10967 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:03.898722 10882 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.939904 10967 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:03.927618  8541 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:27:03.940037 11058 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:03.940845 10967 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:03.942672  8541 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:03.943872  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:03.923090  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:03.889765 10869 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.928700  8470 rpcz_store.cc:276] 0709 12:27:01.296086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.296599 (+   513us) service_pool.cc:224] Handling call
0709 12:27:01.313934 (+ 17335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.314291 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.314331 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:01.314783 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:27:01.448707 (+133924us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:01.448750 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.448820 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.799272 (+2350452us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:03.927977 (+128705us) raft_consensus.cc:1685] finished
0709 12:27:03.927998 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.928195 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":5930240,"thread_start_us":130115,"threads_started":1,"wal-append.queue_time_us":805670}
I20260709 12:27:03.890964 11040 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.918869 11115 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:03.945299 11115 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:03.945554  8388 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:03.925045  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:03.946412 11040 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:03.946519  8388 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1590) took 1821 ms (client timeout 2177 ms). Trace:
I20260709 12:27:03.946985 11040 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:03.936123 11133 raft_consensus.cc:697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:03.948344 11133 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:03.947371 11040 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:03.950098 11040 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:03.947579  8362 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:03.925158 11129 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:03.951339 10794 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:03.920048  9045 rpcz_store.cc:276] 0709 12:27:01.800307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.800982 (+   675us) service_pool.cc:224] Handling call
0709 12:27:01.801272 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.820900 (+ 19628us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.820930 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:01.821376 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.061251 (+239875us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:02.061287 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.061344 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.631146 (+1569802us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:03.911763 (+280617us) raft_consensus.cc:1685] finished
0709 12:27:03.911785 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.911991 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87524,"raft.queue_time_us":104438,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":64432,"spinlock_wait_cycles":107271936,"thread_start_us":239618,"threads_started":1,"wal-append.queue_time_us":306057}
I20260709 12:27:03.951898  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:03.946949  8388 rpcz_store.cc:269] 0709 12:27:02.125396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.149390 (+ 23994us) service_pool.cc:224] Handling call
0709 12:27:03.946355 (+1796965us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b540029ccd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:03.946461 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4128573184}
I20260709 12:27:03.944718 10896 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:03.976233  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:03.978315  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.979118  8540 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:03.980098  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.980625  8540 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:03.981338  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.981895  8540 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:03.982646  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.985294  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:03.986117  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:03.986383  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:03.987177  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:03.944798 10882 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.951727 10794 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.991742  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:03.946559 11134 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:03.997116  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:03.946544 10869 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:03.970682 10871 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:03.999984  8436 leader_election.cc:400] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9.
I20260709 12:27:04.006103  8436 leader_election.cc:403] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:27:04.007689 10992 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9.
I20260709 12:27:04.005157  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.008945  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.009953  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.007249  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:04.012173 10992 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:04.012560  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:04.013458 10992 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:04.014541  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:04.015496 11014 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:04.020033  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.020707  8543 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:04.020330  8436 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.030702  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.031438  9045 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:04.033186  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:03.953138 11032 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:03.991961 11136 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:04.047837  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.048527  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.049232  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:04.003962 10794 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:04.050671  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:03.991659 10896 raft_consensus.cc:697] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:04.050931  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 47669.4us
I20260709 12:27:04.053411  9044 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:04.005648 11134 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:04.005987 10871 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:04.060714  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.065487  8543 raft_consensus.cc:2393] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:04.059157 11136 raft_consensus.cc:697] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:04.072901 11136 consensus_queue.cc:237] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.053306 11014 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:04.080497  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.075704 10985 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:04.088487  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.089641  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.090340  8543 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:04.077813 11052 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.077868 10970 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:04.091748  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.083160 11014 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:04.094501  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 45340.7us
I20260709 12:27:04.096850 11014 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:04.098598 11139 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:27:04.103449 11118 log.cc:927] Time spent T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.510s	user 0.001s	sys 0.001s
I20260709 12:27:04.094225 11115 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.104329  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1494) took 1564 ms. Trace:
I20260709 12:27:04.104823  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.105535 11115 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:04.105983  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.106510 11090 raft_consensus.cc:3055] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:04.106905 11090 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:04.107576  8541 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:04.107650 11090 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.108850 11090 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:04.104714  8394 rpcz_store.cc:276] 0709 12:27:02.540179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.708593 (+168414us) service_pool.cc:224] Handling call
0709 12:27:02.708860 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.402643 (+693783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.104112 (+701469us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b5400204ed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:04.104269 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593816832}
I20260709 12:27:04.112468  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.111209  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:04.093736 10938 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:04.116106 10938 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.118175 10938 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:04.106542  8537 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:04.119621  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.120342  8537 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:04.128654  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.128921  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.129457  8465 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:27:04.130029  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.132270  9014 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:04.134085  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.134305  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:04.108690  8438 connection.cc:256] RPC call timeout handler was delayed by -1.42809342999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 12:27:04.135210  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.136066  8472 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:04.141873  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.141968  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.142704  8465 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.133867  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.143297  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.143958  8470 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
W20260709 12:27:04.144742  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 46632.7us
I20260709 12:27:04.144482  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.143947  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.145875  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.146507  8469 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:04.147979  8436 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.110967 10871 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.095754 11052 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.153301 11097 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.157835 11032 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:04.155988  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.265374  8470 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:04.160575  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.267001  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.267663  8393 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:04.164427 11014 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:04.166821 10855 consensus_meta.cc:287] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.893s	user 0.007s	sys 0.001s
I20260709 12:27:04.172571 10951 raft_consensus.cc:993] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: : Instructing follower e3660d999c0a41658a1f1dbe7cc90746 to start an election
I20260709 12:27:04.159083  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.161527  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.161514 11111 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:04.227910  8465 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:04.281172  8472 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:04.228338  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.153668 10992 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.300364  8388 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:04.097566 10896 consensus_queue.cc:237] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.166544 11098 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:27:04.168663 11041 consensus_queue.cc:1059] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:27:04.153147 11074 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:04.167304 11029 consensus_queue.cc:1059] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:27:04.144944 11082 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:04.163208 10979 consensus_queue.cc:1059] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:27:04.163331 11133 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:27:04.231160  8294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46076 (request call id 130) took 5113 ms. Trace:
I20260709 12:27:04.232388 10978 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:04.237099 11025 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:04.155982 11122 consensus_queue.cc:1059] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:04.238656  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:04.239665  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:04.241175  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1858) took 1068 ms. Trace:
I20260709 12:27:04.425627  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.430171  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.329234  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.409228  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.332067  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1655) took 2533 ms. Trace:
I20260709 12:27:04.431371  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:04.277570 11102 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.925s	user 0.007s	sys 0.001s
I20260709 12:27:04.279817  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1584) took 2158 ms. Trace:
I20260709 12:27:04.298739 11111 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.306895  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.439778  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.307551  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.305845 11136 raft_consensus.cc:1081] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Signalling peer e3660d999c0a41658a1f1dbe7cc90746 to start an election
I20260709 12:27:04.309923  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.229085 10794 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.329237  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.436269  8544 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:04.431826  8470 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:04.437309  8543 raft_consensus.cc:2410] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:27:04.434240  8466 rpcz_store.cc:276] 0709 12:27:01.799046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.799162 (+   116us) service_pool.cc:224] Handling call
0709 12:27:01.799525 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.102117 (+302592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.102148 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.114148 (+ 12000us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.827312 (+713164us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:02.829575 (+  2263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.307639 (+1478064us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400024ed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:04.307687 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.307733 (+    46us) raft_consensus.cc:1685] finished
0709 12:27:04.307746 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.331995 (+ 24249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123190,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"spinlock_wait_cycles":695155456,"thread_start_us":663381,"threads_started":1,"wal-append.queue_time_us":816272,"wal-append.run_cpu_time_us":2526,"wal-append.run_wall_time_us":1432291}
I20260709 12:27:04.431609  8463 rpcz_store.cc:276] 0709 12:27:03.172863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.173688 (+   825us) service_pool.cc:224] Handling call
0709 12:27:03.175479 (+  1791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.175797 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.175824 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:03.201793 (+ 25969us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.275756 (+ 73963us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:03.275817 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.275884 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.102930 (+827046us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:04.240921 (+137991us) raft_consensus.cc:1685] finished
0709 12:27:04.240941 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.241116 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5733,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":23185,"spinlock_wait_cycles":5444864,"thread_start_us":72350,"threads_started":1,"wal-append.queue_time_us":325544}
I20260709 12:27:04.439245  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.441425  8465 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:04.438688  8392 rpcz_store.cc:276] 0709 12:27:02.123675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.123814 (+   139us) service_pool.cc:224] Handling call
0709 12:27:02.124095 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.911943 (+1787848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.279052 (+367109us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54002b5054. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:04.279243 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4048516480}
I20260709 12:27:04.443593  8394 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:04.444726  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:04.447959 11092 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:04.423569 11096 log.cc:927] Time spent T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.924s	user 0.000s	sys 0.002s
I20260709 12:27:04.487685  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.248740  8469 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:04.451520  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.311322 10805 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:04.496344  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:04.497002  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.493727  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.493870  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.497584  8469 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:04.494819  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.498637  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.498885  8394 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:04.499488  8466 raft_consensus.cc:2368] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5.
I20260709 12:27:04.499650  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:04.500568  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:04.495550  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 50913.2us
I20260709 12:27:04.501415  8465 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:04.493317  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.424299 11130 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:04.497805  8393 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:04.503552  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.432567 11074 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.396015 11098 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:04.510190  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.510617  8510 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:04.449594  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.300413 10855 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.430935 11025 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.438484  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.511531  8544 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:04.511745  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.497874 11052 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:04.430135  8294 rpcz_store.cc:276] 0709 12:26:59.117284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.145980 (+ 28696us) service_pool.cc:224] Handling call
0709 12:27:04.200059 (+5054079us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:01.111712 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:01.185567 (+ 73855us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:01.187164 (+  1597us) write_op.cc:435] Acquired schema lock
0709 12:27:01.189039 (+  1875us) tablet.cc:662] Decoding operations
0709 12:27:01.227033 (+ 37994us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:01.237563 (+ 10530us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:01.237600 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:27:01.237779 (+   179us) tablet.cc:701] Row locks acquired
0709 12:27:01.237794 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:27:01.237925 (+   131us) write_op.cc:270] Start()
0709 12:27:01.238029 (+   104us) write_op.cc:276] Timestamp: P: 1783600021237884 usec, L: 0
0709 12:27:01.238059 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:27:01.238731 (+   672us) log.cc:844] Serialized 591 byte log entry
0709 12:27:01.994485 (+755754us) op_driver.cc:464] REPLICATION: finished
0709 12:27:02.775668 (+781183us) write_op.cc:301] APPLY: starting
0709 12:27:02.787753 (+ 12085us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:02.832606 (+ 44853us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:02.851868 (+ 19262us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:02.898109 (+ 46241us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:02.939660 (+ 41551us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:27:02.947273 (+  7613us) write_op.cc:312] APPLY: finished
0709 12:27:03.023250 (+ 75977us) log.cc:844] Serialized 23 byte log entry
0709 12:27:03.249903 (+226653us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:03.249992 (+    89us) write_op.cc:454] Released schema lock
0709 12:27:03.250036 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:03.250496 (+   460us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:03.250524 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":196112,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":719254,"apply.run_cpu_time_us":12054,"apply.run_wall_time_us":484522,"num_ops":1,"prepare.queue_time_us":567867,"prepare.run_cpu_time_us":3340,"prepare.run_wall_time_us":148463,"replication_time_us":641574,"thread_start_us":827924,"threads_started":3,"wal-append.queue_time_us":288613}]]}
I20260709 12:27:04.560737  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.562032  8465 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:04.513317  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.563640  8397 raft_consensus.cc:2376] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6. Re-sending same reply.
I20260709 12:27:04.442087 11111 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:04.423341 11046 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:27:04.515535  8392 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:04.516441  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.568873  8389 raft_consensus.cc:2376] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6. Re-sending same reply.
I20260709 12:27:04.511643 11074 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:04.496344 11101 raft_consensus.cc:3055] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:04.309508 10992 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.448874 11091 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:04.502359 10869 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:04.512770  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 63240.8us
I20260709 12:27:04.512758 11130 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.512930 11014 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:04.540323 10970 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:04.518741 11082 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:04.540118  8390 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:04.519752 10893 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:04.521162 11025 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.601763 10992 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:04.554275 10855 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:04.554807  8539 raft_consensus.cc:2393] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:04.603734  8539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 1693) took 1697 ms (client timeout 2214 ms). Trace:
W20260709 12:27:04.604110  8539 rpcz_store.cc:269] 0709 12:27:02.906246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.906607 (+   361us) service_pool.cc:224] Handling call
0709 12:27:04.603527 (+1696920us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b540003acd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:04.603671 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3709104000}
I20260709 12:27:04.557014  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.606024  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.606567  8466 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:04.579221 11101 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:04.607276  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.608017  8466 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:04.608444  8541 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:04.608114 11101 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.308341 11134 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.557687  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:04.609406  8470 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:04.610208  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.610879  8470 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:04.564292  8546 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:27:04.612449  8470 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:27:04.519920 11098 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.577571 11093 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:04.615166  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:04.564250  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 416308us
I20260709 12:27:04.565702  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.566653  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1760) took 2528 ms. Trace:
W20260709 12:27:04.567436 11121 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.982s	user 0.000s	sys 0.002s
I20260709 12:27:04.562844  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:04.570698  8391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.012s	sys 0.022s
I20260709 12:27:04.618497  8436 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:04.619892  8391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.012s	sys 0.023s
I20260709 12:27:04.620491  8393 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:04.620605  8467 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:27:04.580188  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:04.622198  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.519258 11097 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:04.568702 11040 consensus_meta.cc:287] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.001s
I20260709 12:27:04.506392 10805 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.591390  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.498150 11092 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.594112  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.593883 11082 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:04.597587  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.379182 11041 raft_consensus.cc:3055] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:04.620349 11134 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:04.643728  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 52414.7us
I20260709 12:27:04.644734  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.645591  8511 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.618417  8538 rpcz_store.cc:276] 0709 12:27:02.038377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.039188 (+   811us) service_pool.cc:224] Handling call
0709 12:27:02.039489 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.718169 (+678680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.566405 (+1848236us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400387f54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:04.566567 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548242816}
I20260709 12:27:04.592715 10970 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.631214  8467 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:04.631960  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:04.631873  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.630213  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:04.621583 11138 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.738s	user 0.001s	sys 0.001s
I20260709 12:27:04.623500  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.692140  8391 raft_consensus.cc:2410] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:04.590086 11091 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.646356  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.694475  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.698740  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.699486  8393 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:04.694487 10794 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:04.632200 11120 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:04.634157 11014 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:27:04.706292  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 76162.7us
I20260709 12:27:04.706995  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:04.708426 10744 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:04.708787 10744 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.709096 10744 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:04.697531  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 51238.7us
I20260709 12:27:04.712033  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.712857  8511 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.713603  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:04.702091  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.690114 10869 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:04.702747  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.738652  8390 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:04.690325 10893 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:04.690212 10855 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:04.704332  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.642999 11041 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:04.737779  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.756800  8391 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:04.690472 10970 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:04.746397  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 254780us
I20260709 12:27:04.748114 10794 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:04.637316 11040 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.754359  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.756168  8397 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:04.802280 10805 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:04.798084  9015 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:04.803822 11092 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:04.806351 10744 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.705894 11115 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:04.705295 11014 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.754510 10893 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.757156 10855 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.816540 11091 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:04.737013 11120 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.824223 11130 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:04.878062  8395 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:04.823902 11041 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.742100 11156 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:04.825253  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1863) took 1644 ms. Trace:
I20260709 12:27:04.825188  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:04.785087  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.885332 10744 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:04.851300 10942 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:04.889940  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:04.889953  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.889815 10942 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:04.892540  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.846479  8391 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:04.854043  8397 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 12:27:04.854398  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 88223.2us
I20260709 12:27:04.851606 11115 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:04.894407  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:04.894587  9015 leader_election.cc:400] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5.
I20260709 12:27:04.903326  9015 leader_election.cc:403] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:27:04.872507 11014 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:04.894044  8397 pending_rounds.cc:85] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 4
I20260709 12:27:04.887389  8471 rpcz_store.cc:276] 0709 12:27:03.181066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.181181 (+   115us) service_pool.cc:224] Handling call
0709 12:27:03.181443 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.181749 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.181777 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:03.182178 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 12:27:03.360335 (+178157us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:03.360377 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.360443 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.628294 (+267851us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b4800231e58. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64692b2aa1 00007f64692a9b37 00007f64692a99ca 00007f64693a126f 00007f64693a0f37 00007f64693b555c 00007f64693b5508 00007f64693b5488 00007f64693b5443 00007f64693b46ec 00007f64682dea96
0709 12:27:04.566878 (+938584us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:04.825047 (+258169us) raft_consensus.cc:1685] finished
0709 12:27:04.825067 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.825186 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2927,"raft.run_cpu_time_us":2151,"raft.run_wall_time_us":430082,"spinlock_wait_cycles":103420544,"thread_start_us":98324,"threads_started":1,"wal-append.queue_time_us":199542}
I20260709 12:27:04.872191 11092 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:04.875455 10893 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:04.850271 11025 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:04.904474  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:04.906567 11130 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5.
I20260709 12:27:04.904140  9015 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:04.905880  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:04.851158 10794 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.276921  8397 pending_rounds.cc:107] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:27:05.276737  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:05.277269  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 373179us
W20260709 12:27:05.162938  8469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.011s	sys 0.025s
W20260709 12:27:04.918865  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 363214us
W20260709 12:27:04.930764  8436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.214s (SENT) [suppressed 24 similar messages]
W20260709 12:27:05.280155  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 349399us
I20260709 12:27:04.874615 11161 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:05.281143 11161 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.887995 11156 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:04.908200  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1772) took 1626 ms. Trace:
I20260709 12:27:05.281844 11156 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.282588 11092 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:05.171798  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1613) took 1185 ms. Trace:
I20260709 12:27:04.904031 11115 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:04.922092  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:05.009862 11041 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:04.888126 11091 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:05.285650 11091 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:05.286450 11091 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:05.124886  9048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47412 (request call id 436) took 3126 ms (client timeout 2198 ms). Trace:
W20260709 12:27:04.971158  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 256867us
I20260709 12:27:05.062386 11098 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:05.169775  8438 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.000s	sys 0.039s
I20260709 12:27:04.875771 10855 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:05.278400  8469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.018s	sys 0.027s
I20260709 12:27:05.289557  9044 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:05.288913  9048 rpcz_store.cc:269] 0709 12:27:01.977430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.977554 (+   124us) service_pool.cc:224] Handling call
0709 12:27:05.103480 (+3125926us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54007576d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:05.103605 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3645610240}
W20260709 12:27:05.281682  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 279189us
I20260709 12:27:05.281505 11161 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.291929  8466 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:05.293246 11025 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.127545  9049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee"
dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
 from {username='slave'} at 127.0.0.1:47412
I20260709 12:27:05.294220  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:05.294799  9049 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:05.282114  8468 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.175370  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.277375  8397 raft_consensus.cc:2889] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:05.169020  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:05.162000 11111 consensus_meta.cc:287] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.002s
I20260709 12:27:05.295225  9049 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:05.297494  8438 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.006s	sys 0.044s
W20260709 12:27:05.297818  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 1.15242e+06us
W20260709 12:27:05.298180  8438 connection.cc:256] RPC call timeout handler was delayed by -1.319345618999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260709 12:27:05.298483  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1917550570001367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:27:05.298779  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1798456189999342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:27:05.299058  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1528456189998906s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
W20260709 12:27:05.299443  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1125550570000087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 12:27:05.299726  8438 connection.cc:256] RPC call timeout handler was delayed by -1.0198550569998588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
I20260709 12:27:05.283824  8388 rpcz_store.cc:276] 0709 12:27:03.986744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.986979 (+   235us) service_pool.cc:224] Handling call
0709 12:27:05.171582 (+1184603us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400143cd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:05.171732 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718459136}
I20260709 12:27:05.296237  8392 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:05.288013  8393 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:05.300254  8542 rpcz_store.cc:276] 0709 12:27:03.282005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.541115 (+259110us) service_pool.cc:224] Handling call
0709 12:27:03.687709 (+146594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.687909 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.687934 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.687975 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:03.688011 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.688062 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.908018 (+1219956us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003fa7d0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:04.908129 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336345856}
I20260709 12:27:05.001137 11032 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:05.318866 11098 consensus_queue.cc:1059] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:05.320113 11098 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:05.320449 11098 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:05.320663  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.321218 11098 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.322412 11098 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.283517 11092 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.310774 10988 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.323946 11168 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:04.908047 10942 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:05.324218 10988 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.128947 10908 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.325119 11097 consensus_queue.cc:1059] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:05.325536 10908 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.327503 10908 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.329349 10988 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.331079 10913 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:05.331562 10913 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:05.332324 10913 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.333689  8362 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.334479 11098 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.269973 11040 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.335453  8362 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.335938 11040 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:05.338150  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:05.338367 10896 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:05.338764  8545 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:27:05.341264  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:05.324470 11168 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.352073  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:05.352715  8464 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
W20260709 12:27:05.353410  8510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.005s	sys 0.022s
W20260709 12:27:05.354036  8510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.005s	sys 0.022s
I20260709 12:27:05.343981  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:05.345360  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:05.346370  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:05.344502  8463 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.021s	sys 0.037s
I20260709 12:27:05.351372  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:05.355482  8463 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.021s	sys 0.037s
I20260709 12:27:05.355772  8472 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:05.356107  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1694) took 1123 ms. Trace:
I20260709 12:27:05.356150  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.347033  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.356565  8463 rpcz_store.cc:276] 0709 12:27:04.232606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.494282 (+261676us) service_pool.cc:224] Handling call
0709 12:27:04.501170 (+  6888us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.501332 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:04.749419 (+248087us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.355800 (+606381us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.355850 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:05.355897 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.355956 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.356057 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2583,"prepare.queue_time_us":297668,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3874,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":260,"thread_start_us":845809,"threads_started":2}
I20260709 12:27:05.358170  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.354202  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:05.275043 11129 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:05.347713  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:05.338932 10896 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.363083  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.288483 11101 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:05.365947  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.361874  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.360502  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.368007  8465 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:05.214601 11058 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.316341 10985 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.240330 10869 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:05.311079 10978 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.216023 11120 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:05.373201 10744 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.374109  8438 leader_election.cc:400] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
I20260709 12:27:05.388108  8438 leader_election.cc:403] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:27:05.378795  8472 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:05.294752 11148 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.381492  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:05.393576  8468 raft_consensus.cc:2410] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:27:05.395849  8438 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.396904 10744 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
I20260709 12:27:05.390192  8510 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.401366  8540 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:27:05.365298 11129 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:05.368817 11032 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:05.382970 10910 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.024s
W20260709 12:27:05.402238  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 53445.3us
I20260709 12:27:05.402915  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1686) took 1260 ms. Trace:
I20260709 12:27:05.317054 11111 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.416788  8438 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.421478  8468 rpcz_store.cc:276] 0709 12:27:04.135963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.136979 (+  1016us) service_pool.cc:224] Handling call
0709 12:27:04.904334 (+767355us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b58001c7198. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:27:05.395812 (+491478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10767232}
I20260709 12:27:05.429183  8438 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.430356  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.431212 10744 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:05.431896 10744 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.432449 10744 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.436491  9048 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:27:05.417565 10970 consensus_meta.cc:287] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.000s
I20260709 12:27:05.398795 11025 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.425792 10910 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.006s	sys 0.025s
I20260709 12:27:05.447994  8540 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:27:05.453330  8362 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.454681  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.394709 10985 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.401712 11148 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.460642  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:05.439713 11178 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:05.461364  8540 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 1.
W20260709 12:27:05.450636 11074 consensus_meta.cc:287] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.860s	user 0.006s	sys 0.003s
I20260709 12:27:05.463846  8542 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:05.427196 11029 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:27:05.466504  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:05.475966  8540 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
W20260709 12:27:05.479032  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.438019 11040 consensus_queue.cc:1059] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:27:05.455881 10976 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:05.459703 11120 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:05.443216 11085 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:27:05.608382  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 296573us
I20260709 12:27:05.448449 10970 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.448619 11025 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.464416 11178 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:05.600714 11120 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:05.462598 11165 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:05.482903 10794 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:05.664085  8540 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:05.673532  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:05.675618  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 380922us
I20260709 12:27:05.437281 11161 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.620420 11120 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:05.680164  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 381659us
I20260709 12:27:05.461144 10869 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.456446  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.622014 11178 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.480552 11074 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.656935 10988 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:05.705668 10744 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:05.468582 11129 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.713544  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.715356  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.743846  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:05.744771  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:05.745878  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:05.746053  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:05.706959 10744 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:05.710078  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.748442  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:05.746102  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:05.750382  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:05.751893  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:05.753696  8464 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:27:05.707172  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 276890us
I20260709 12:27:05.760170  8544 raft_consensus.cc:2393] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:05.707692 11029 raft_consensus.cc:3055] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:05.692068 11163 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:05.760879  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.712729 11091 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:05.776808  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61512.8us
I20260709 12:27:05.693451 11168 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:05.707899 11111 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:05.780179  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 323776us
I20260709 12:27:05.781721 10744 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.618312 11032 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.762704  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.788138  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.783785  8361 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:05.788872  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 103653us
I20260709 12:27:05.789876 10744 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.774638  8544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4"
dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:44166
I20260709 12:27:05.755780 11133 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:05.757894 11129 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:05.757468 11058 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:05.706408 11098 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:27:05.747920 10896 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:05.795630 10992 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:05.795616  8544 raft_consensus.cc:606] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:05.689631  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 439) took 1796 ms. Trace:
W20260709 12:27:05.793327  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 115924us
W20260709 12:27:05.807235 11180 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 12:27:05.757074 11085 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:05.712467 10988 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.777642 11029 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:05.812039  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:05.855063  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.791761 11202 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:05.807523 11168 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.859851  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:05.863036  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 102217us
I20260709 12:27:05.864215  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.865545 10744 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:05.863051  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:05.873092  9049 consensus_meta.cc:287] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.000s
W20260709 12:27:05.846489 11188 log.cc:927] Time spent T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 12:27:05.878942  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:05.793495 11091 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.873504  9049 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:05.859100 11186 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
W20260709 12:27:05.892165  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 105178us
I20260709 12:27:05.906816  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.905169  8438 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:05.820369 11058 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:05.910420  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:05.876224 11202 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:05.868633 11201 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.825616  9046 rpcz_store.cc:276] 0709 12:27:03.890387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.897000 (+  6613us) service_pool.cc:224] Handling call
0709 12:27:03.920805 (+ 23805us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.029249 (+108444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.049327 (+ 20078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:04.051436 (+  2109us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:04.054215 (+  2779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.674671 (+1620456us) spinlock_profiling.cc:243] Waited 78.9 ms on lock 0x7b5400611a54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:05.675671 (+  1000us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.687131 (+ 11460us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181368064}
I20260709 12:27:05.904021 10992 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.856179 11085 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.948603  8512 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:05.949055 11214 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:05.950654  8512 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:05.951835  8512 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:05.952950  8512 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:05.912338  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 245) took 1023 ms. Trace:
W20260709 12:27:05.943068 11173 log.cc:927] Time spent T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:27:05.936491 11190 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:05.975024 11169 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:05.913854 11185 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
I20260709 12:27:05.947345  9049 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.962778 10910 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:05.978224  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 350) took 1058 ms. Trace:
I20260709 12:27:05.965215  9041 rpcz_store.cc:276] 0709 12:27:04.888762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.889978 (+  1216us) service_pool.cc:224] Handling call
0709 12:27:04.902475 (+ 12497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.918044 (+ 15569us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:05.403462 (+485418us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.892907 (+489445us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.902850 (+  9943us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:05.906425 (+  3575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.912117 (+  5692us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.912267 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":538004,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":195068,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":19559,"thread_start_us":927354,"threads_started":3}
I20260709 12:27:05.965654 11183 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:05.981339 10855 consensus_meta.cc:287] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.001s
I20260709 12:27:05.984966 10855 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:05.985733 11148 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:05.986039 11014 consensus_meta.cc:287] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.701s	user 0.008s	sys 0.001s
I20260709 12:27:05.986408 11014 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:05.990190 10893 consensus_meta.cc:287] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.701s	user 0.007s	sys 0.000s
I20260709 12:27:05.990397 11122 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:05.963881 11215 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.990772 11122 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:05.991865 10988 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:05.993922 11195 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:27:05.994961 10908 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:27:05.999066 11115 consensus_meta.cc:287] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.657s	user 0.005s	sys 0.002s
I20260709 12:27:05.999358 10939 raft_consensus.cc:3055] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:05.999832 10939 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:06.000929 11196 log.cc:927] Time spent T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:27:06.000711 10939 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.002102 10939 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:05.972381 11190 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:06.003806 11190 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:05.971940 11192 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:27:05.967253 11208 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:05.968026 11214 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.987142 10855 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:05.937974  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:05.983191  8391 rpcz_store.cc:276] 0709 12:27:04.960794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.287323 (+326529us) service_pool.cc:224] Handling call
0709 12:27:05.287657 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.313234 (+ 25577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.313262 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.327613 (+ 14351us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.746576 (+418963us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:05.746611 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.746673 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:05.978026 (+231353us) raft_consensus.cc:1685] finished
0709 12:27:05.978044 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.978166 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25142,"raft.queue_time_us":31972,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":418557,"threads_started":1,"wal-append.queue_time_us":566051}
I20260709 12:27:05.913228 11029 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.068943 11058 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:05.945988 11197 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:06.004664  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1780) took 1854 ms. Trace:
I20260709 12:27:06.056051  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:06.070696  9049 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:06.070755  9048 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEARNER]: Advancing to term 6
I20260709 12:27:06.000545 11085 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.039466 11090 raft_consensus.cc:3055] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:05.947568 11202 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:27:06.075065  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:06.079650  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 143991us
I20260709 12:27:06.081138  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:06.082299  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.995340 10908 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:06.067625 11200 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:27:06.068076 11091 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:06.001151 11156 consensus_meta.cc:287] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.001s
I20260709 12:27:06.070336  8543 rpcz_store.cc:276] 0709 12:27:04.150407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.503283 (+352876us) service_pool.cc:224] Handling call
0709 12:27:04.516006 (+ 12723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:04.902734 (+386728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.902764 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.316043 (+413279us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.661349 (+345306us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:05.763105 (+101756us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.974403 (+211298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.974673 (+   270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.004464 (+ 29791us) raft_consensus.cc:1685] finished
0709 12:27:06.004483 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.004605 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8042,"prepare.queue_time_us":145906,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":4238,"raft.queue_time_us":114910,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":41767,"thread_start_us":936342,"threads_started":4,"wal-append.queue_time_us":327491}
W20260709 12:27:06.067081 11101 consensus_meta.cc:287] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.685s	user 0.005s	sys 0.000s
I20260709 12:27:06.076841 11161 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.010766 10988 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:06.040630 11074 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.093536  8511 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:06.097260  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 276174us
W20260709 12:27:06.098320  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 193251us
I20260709 12:27:06.099773  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:06.103247  9048 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:27:06.078325 11090 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:06.104609  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:06.088402 11177 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:06.043503 11115 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.046173 10893 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.105978  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:06.093118 10896 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:06.092662  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:06.069576 11122 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.120736  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:06.121044  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:06.122038  9049 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:27:06.122097  9045 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:06.123538  8438 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:06.126399  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.126509  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:06.132898  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.090862 10855 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:27:06.134457  8436 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:06.135864  8539 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:06.135367  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 343733us
I20260709 12:27:06.109982 11177 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:06.168620  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:06.170316 10744 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:06.180344 10744 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:06.180709 10744 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.172518  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1880) took 1603 ms. Trace:
I20260709 12:27:06.181515  8466 rpcz_store.cc:276] 0709 12:27:04.568660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.625113 (+ 56453us) service_pool.cc:224] Handling call
0709 12:27:04.625371 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.292264 (+666893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.172261 (+879997us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400194e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:06.172456 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532482304}
I20260709 12:27:06.111766 11161 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:06.175348  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:06.177083  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 322616us
I20260709 12:27:06.174228  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:06.183719  9014 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:06.138093  8545 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:06.107471 10988 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:06.128166 10794 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:06.183061 11177 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:06.094061 11156 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:06.073971 11214 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.191171 11220 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:06.121253 11197 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:06.234040  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 43617us
I20260709 12:27:06.110538 11207 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:06.134152 10992 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:06.253720  8537 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:06.260921  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 77268.1us
W20260709 12:27:06.266536  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 132942us
W20260709 12:27:06.261890  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 134052us
I20260709 12:27:06.181699 11168 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:06.267532  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:06.267894  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:06.268219 10744 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:06.338340  8541 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.260383 11197 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:06.235592 11148 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:06.232144 11014 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.181358 10896 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:06.352332 10896 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:06.354058 11178 consensus_meta.cc:287] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.644s	user 0.006s	sys 0.001s
I20260709 12:27:06.134271 11201 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.125s
W20260709 12:27:06.257387 11120 consensus_meta.cc:287] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.000s
W20260709 12:27:06.284969 10976 consensus_meta.cc:287] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.798s	user 0.004s	sys 0.007s
I20260709 12:27:06.234388 10794 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:06.138603 10908 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:06.360913 11224 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:27:06.361351 10908 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:06.362968  8396 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:06.363502 11166 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.137167 11165 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:06.265484 11220 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:06.284970  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:06.372078  8546 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:06.364737 10794 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:06.375695  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 292) took 1907 ms. Trace:
I20260709 12:27:06.369513  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:06.376117  8469 rpcz_store.cc:276] 0709 12:27:04.468701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.507325 (+ 38624us) service_pool.cc:224] Handling call
0709 12:27:04.507617 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:04.596432 (+ 88815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.596460 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:04.596873 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.289499 (+692626us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:05.289535 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.358696 (+1069161us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b54000f2dd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:06.358741 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.358785 (+    44us) raft_consensus.cc:1685] finished
0709 12:27:06.358797 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.375616 (+ 16819us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":203397888,"thread_start_us":654160,"threads_started":1,"wal-append.queue_time_us":846965}
W20260709 12:27:06.366789 11231 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:27:06.364656 11120 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.368485 10988 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:06.355983 11197 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:06.176326 11090 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.198237 11161 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:06.403753 11214 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:06.298620 11041 consensus_meta.cc:287] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.013s	user 0.010s	sys 0.000s
W20260709 12:27:06.336933  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 200148us
I20260709 12:27:06.405201 11156 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:06.262431 11207 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:06.405959 11207 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.339762  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:06.230654 11074 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 12:27:06.341960 11229 log.cc:927] Time spent T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:27:06.342382 11115 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:06.342969 10744 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:06.344434 11025 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.347790  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:06.428943  9044 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.356770 10893 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:06.357170 11198 log.cc:927] Time spent T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:27:06.363965 11166 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:06.366750  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1620) took 2329 ms. Trace:
I20260709 12:27:06.431044  8395 rpcz_store.cc:276] 0709 12:27:04.037067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.040955 (+  3888us) service_pool.cc:224] Handling call
0709 12:27:04.041296 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.878943 (+837647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.366504 (+1487561us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54003de0d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:06.366690 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1923943680}
I20260709 12:27:06.342408 11148 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.367442 11223 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:06.386269  8546 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:06.293938  8471 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:06.354460 11178 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.413332  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:06.433435  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 351) took 1431 ms. Trace:
W20260709 12:27:06.444311  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 176086us
I20260709 12:27:06.383831 11220 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.456833  8397 rpcz_store.cc:276] 0709 12:27:05.001641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.297008 (+295367us) service_pool.cc:224] Handling call
0709 12:27:05.313296 (+ 16288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:05.380330 (+ 67034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.380361 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:05.380789 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.690079 (+309290us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:05.690122 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.690193 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.433203 (+743010us) raft_consensus.cc:1685] finished
0709 12:27:06.433223 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.433371 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67318,"raft.queue_time_us":67374,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16481,"thread_start_us":264490,"threads_started":1,"wal-append.queue_time_us":713672}
I20260709 12:27:06.473618 11168 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:06.474128 11168 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:06.426152 11177 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.454012 11148 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:06.383291 11190 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:06.729727  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1803) took 1251 ms. Trace:
I20260709 12:27:06.730185  8540 rpcz_store.cc:276] 0709 12:27:05.478012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.479763 (+  1751us) service_pool.cc:224] Handling call
0709 12:27:05.613047 (+133284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.664636 (+ 51589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.729444 (+1064808us) spinlock_profiling.cc:243] Waited 50.8 ms on lock 0x7b540006bdd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:06.729654 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116903808}
I20260709 12:27:06.482975 11220 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:06.471285 11223 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:06.726004  9046 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
W20260709 12:27:06.906004 10794 consensus_meta.cc:287] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.531s	user 0.008s	sys 0.000s
I20260709 12:27:06.928092 10794 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:06.930452 10794 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.916577 11190 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.914039 11220 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:06.939646  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 533959us
I20260709 12:27:06.940970  8438 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:06.941107 11090 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:06.941574  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 483362us
I20260709 12:27:06.943212 11161 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:06.943915  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 980153us
I20260709 12:27:06.945142  8512 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:06.945744 11120 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:06.946034 10855 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:06.946740  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:06.969425  8512 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:06.998586  8512 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:07.000649  8541 consensus_meta.cc:287] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.662s	user 0.033s	sys 0.046s
I20260709 12:27:07.000976  8541 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:07.001278  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:07.008231  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 67313.5us
I20260709 12:27:07.009193  8438 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.010076 10744 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.025352  9044 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:27:07.011322  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.038816  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:07.011523 10744 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:27:07.040735  8438 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:06.945465 11223 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:07.006345 11168 consensus_meta.cc:287] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 12:27:07.046329 11025 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:07.046278 10744 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.008270 10896 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:07.044425 11207 consensus_meta.cc:287] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.638s	user 0.004s	sys 0.005s
I20260709 12:27:07.008056 11115 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:07.047055  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.083920 10744 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:06.998208 11178 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.009052 10893 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:07.039572 11214 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:07.043540 11074 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:07.076426  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 75204.9us
W20260709 12:27:07.074290  9041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.048s	sys 0.053s
I20260709 12:27:07.088068  8512 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:07.084419  8438 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:07.084084 11197 consensus_meta.cc:287] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.000s
I20260709 12:27:07.081545 11025 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:07.080073 10896 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.083333 11115 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:07.090559 10893 raft_consensus.cc:2764] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
W20260709 12:27:07.088411  9041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.048s	sys 0.053s
I20260709 12:27:07.096580  9043 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.097190  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 449) took 1969 ms. Trace:
I20260709 12:27:07.097508  9043 rpcz_store.cc:276] 0709 12:27:05.127932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.128055 (+   123us) service_pool.cc:224] Handling call
0709 12:27:07.096257 (+1968202us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264eee 000000000036eb39 00007f64692d81e0 00007f64693a10c4 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:27:07.096422 (+   165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.096959 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.097136 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5008512}
I20260709 12:27:07.084513 11207 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.090910 11197 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.078284 11168 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.090728 10896 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.092685 11115 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.102267 11240 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:07.104430 11240 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:07.104816 11240 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.114586 11166 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:07.115965 11148 consensus_meta.cc:287] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.000s
I20260709 12:27:07.118049 11082 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.104074 11025 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.121292 10985 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.121469 11197 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.122267 10913 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.133159 11133 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.133634 11133 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.127858 11148 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.136988 11148 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.136708 11240 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.130460 11082 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.132095 11168 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:07.132369 11181 log.cc:927] Time spent T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 1.452s	user 0.015s	sys 0.021s
I20260709 12:27:07.135164 11207 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.141093 11029 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.142637 11240 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.136714 11085 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:07.144263 11085 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:07.144354 11122 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.145068 11085 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.146389 11085 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.147583 10970 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:07.148476 11177 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:07.156142 11133 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.158545 11115 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.207022  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.290025  8538 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
W20260709 12:27:07.224630  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 1715) took 1483 ms (client timeout 1699 ms). Trace:
W20260709 12:27:07.291903  8545 rpcz_store.cc:269] 0709 12:27:05.741356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.750129 (+  8773us) service_pool.cc:224] Handling call
0709 12:27:07.224224 (+1474095us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54003fa7d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:07.224430 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":883017984}
I20260709 12:27:07.221309  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.296417  8541 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:07.235764  8464 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:27:07.223847  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1807) took 1096 ms. Trace:
I20260709 12:27:07.207687  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.298889  8546 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:07.216012  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.159829 11133 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:07.300386  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.301396  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.301806  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.220161  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.221932  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1706) took 1480 ms. Trace:
I20260709 12:27:07.308032  8468 rpcz_store.cc:276] 0709 12:27:05.741485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.741652 (+   167us) service_pool.cc:224] Handling call
0709 12:27:05.741969 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.876482 (+134513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:05.876510 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.876546 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:05.876575 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.221280 (+1344705us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400189f54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:07.221333 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.221600 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308932352}
I20260709 12:27:07.310237 11074 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:07.193415  8396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1608) took 3208 ms (client timeout 1508 ms). Trace:
I20260709 12:27:07.312028  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.312758  8470 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.314002 11115 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:07.314855 11148 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.315824  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.316222 11178 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.222819  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1793) took 1879 ms. Trace:
I20260709 12:27:07.317214 11178 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.319873 10985 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:07.229555  8295 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.320865 10985 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:07.186520  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 102060us
I20260709 12:27:07.315816 11156 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.297583  8539 rpcz_store.cc:276] 0709 12:27:06.127290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.130944 (+  3654us) service_pool.cc:224] Handling call
0709 12:27:06.131280 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.182463 (+ 51183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.223349 (+1040886us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b540003a2d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:07.223669 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10077056}
I20260709 12:27:07.307641 11177 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:07.332485 11177 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.333969  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.334805  8466 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:27:07.324565 11156 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.230962  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1699) took 1881 ms. Trace:
I20260709 12:27:07.207935  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:07.311771  8396 rpcz_store.cc:269] 0709 12:27:03.984969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.985083 (+   114us) service_pool.cc:224] Handling call
0709 12:27:07.192824 (+3207741us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54001c9654. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:07.193104 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5466562304}
I20260709 12:27:07.317759  8537 rpcz_store.cc:276] 0709 12:27:05.343649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.344397 (+   748us) service_pool.cc:224] Handling call
0709 12:27:05.344638 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.266177 (+921539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.222266 (+956089us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54001b3354. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:07.222635 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043945344}
I20260709 12:27:07.306021 11133 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.332664  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.336678  8471 rpcz_store.cc:276] 0709 12:27:05.349642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.349766 (+   124us) service_pool.cc:224] Handling call
0709 12:27:05.350023 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.454581 (+1104558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.230392 (+775811us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54000262d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:07.230770 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114695040}
I20260709 12:27:07.346016 11205 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:07.346297 11148 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.349241 10979 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:07.346061 10985 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.350419 11207 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.350649 11029 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:07.351217 11207 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.351383 11029 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.352270  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.353636 11207 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.353866  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.349290 11148 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.323398 10744 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.333328  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.336016  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.354950  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:07.340476  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47416 (request call id 301) took 1275 ms (client timeout 1624 ms). Trace:
I20260709 12:27:07.337924  8438 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.364636  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.366266  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.363857  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.353659 11029 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.349860 10979 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:07.311329 11074 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.376433  8465 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.373989  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.338249  8295 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:07.376080  8470 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:07.381240  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 55522.8us
W20260709 12:27:07.381647  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 57040us
I20260709 12:27:07.382851  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.384536  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47416 (request call id 303) took 1322 ms. Trace:
I20260709 12:27:07.384975  9048 rpcz_store.cc:276] 0709 12:27:06.061712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.061817 (+   105us) service_pool.cc:224] Handling call
0709 12:27:06.062119 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.103771 (+ 41652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.384021 (+1280250us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b54006b9c54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:07.384329 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19524480}
I20260709 12:27:07.386852 11202 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.387701 11202 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.388176 11156 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.389590 10871 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.390220 11202 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.390559 11178 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.391032 11067 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.391849 11067 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.391970 10979 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.389489 11133 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.392606  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.393556 10979 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:07.378204  8472 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:27:07.393918  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.394814  8397 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.394997 10744 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:07.390823 11129 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.396652  8472 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:07.362511  9046 rpcz_store.cc:269] 0709 12:27:06.061150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.070740 (+  9590us) service_pool.cc:224] Handling call
0709 12:27:07.336052 (+1265312us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54004e16d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:07.336281 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049116416}
W20260709 12:27:07.393638  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47412 (request call id 452) took 2112 ms (client timeout 1696 ms). Trace:
I20260709 12:27:07.393448  8471 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.397805  8390 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.400105  8537 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:07.386251  9047 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:07.404419  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:07.405889 11074 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.406419  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:07.407069  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 948065us
I20260709 12:27:07.407064 11223 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:07.408000  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.407294  8544 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:07.416087  9046 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:07.417222 11067 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.417717 11245 consensus_queue.cc:1059] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:07.419355 11245 raft_consensus.cc:3055] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:07.419736  8438 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:07.426330  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.427495  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 175843us
I20260709 12:27:07.427644 11177 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:07.429193  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 341189us
I20260709 12:27:07.429684  9046 raft_consensus.cc:1240] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:07.420032 11025 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:07.436131  8295 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 8, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:07.436800  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:07.399921  9042 rpcz_store.cc:269] 0709 12:27:05.281496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.281642 (+   146us) service_pool.cc:224] Handling call
0709 12:27:07.392298 (+2110656us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:27:07.393549 (+  1251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5469056}
I20260709 12:27:07.408671  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.437770  8295 catalog_manager.cc:5697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.438649  8392 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.439261  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.411461 11156 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.441216  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 453) took 2129 ms. Trace:
I20260709 12:27:07.419852 11245 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:07.444883  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.399328 11082 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.408682 11223 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:07.451649  8468 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:07.446362  9047 rpcz_store.cc:276] 0709 12:27:05.283077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.283189 (+   112us) service_pool.cc:224] Handling call
0709 12:27:07.385391 (+2102202us) spinlock_profiling.cc:243] Waited 913 us on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:27:07.385764 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:07.401220 (+ 15456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.411943 (+ 10723us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099456}
I20260709 12:27:07.461457  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:07.460196 11025 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.467320  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:07.471946  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.396622 11129 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.473950  8470 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:07.467761 11246 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.475373 11082 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.478663 11082 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.476740 11241 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:07.450802 11202 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.473934  8464 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:07.483235 11122 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.484265 11122 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.486861 11122 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.487803  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.489764  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:07.492169 11245 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.493675  8471 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:07.495024  8472 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.497512  8467 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:07.495019  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47416 (request call id 300) took 1436 ms. Trace:
I20260709 12:27:07.462098 11120 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:07.500058  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.453369  8392 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:60370
I20260709 12:27:07.500778  8392 raft_consensus.cc:606] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 12:27:07.464119 11133 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.462829 11025 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.501155  8392 raft_consensus.cc:614] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:07.482333  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.499821 11120 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.507014 11082 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.507628  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.507845 11202 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.508906  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.504544 11067 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.507126  8388 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12c64e413ad46968034a527b5290316"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:07.510178  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.507967 11122 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.511529  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.511808  8393 raft_consensus.cc:2393] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:07.512326  8468 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:07.511760 11122 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.521376 11129 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.522578  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.507746 11082 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:07.524224  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 57064.5us
I20260709 12:27:07.525045  8512 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:07.525518 11082 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.525995 11177 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:07.526412 11177 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:07.526809 11177 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.510155 11067 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.528801 11067 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.529002 11025 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.499320  9041 rpcz_store.cc:276] 0709 12:27:06.059645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.077959 (+ 18314us) service_pool.cc:224] Handling call
0709 12:27:06.121233 (+ 43274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.429435 (+308202us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:07.095501 (+666066us) log.cc:844] Serialized 14 byte log entry
0709 12:27:07.475373 (+379872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:07.493755 (+ 18382us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:07.493863 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.494546 (+   683us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54004132d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:07.494601 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.494742 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":670810,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":16743,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":11840,"spinlock_wait_cycles":653201792,"thread_start_us":983201,"threads_started":2,"wal-append.queue_time_us":304413}
I20260709 12:27:07.532111  8388 raft_consensus.cc:606] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.532521  8388 raft_consensus.cc:614] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:07.533272  8512 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:07.533762  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.501202 10913 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.534896 11241 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:07.535586 11223 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.536399  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:07.538379 10914 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:07.538853 10914 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.539253 10914 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.540285 11074 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.540917 11074 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.541265 10913 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.544067 11202 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.544100 11074 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.547936  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.546943  8389 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:07.551805 11148 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.551965  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.552511 11148 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.552898 11099 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:07.493718 11245 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:07.554607 11241 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:07.533435 11122 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.555390 11148 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.556218  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.558156  8464 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.546864  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.558952  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.559790  8469 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:07.560774  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.561053  8468 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:07.562353  8468 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:07.563062  8463 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:07.563534 11074 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:07.564131 11074 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.564409  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.565223  8471 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:07.558964  8540 raft_consensus.cc:2393] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:07.556519  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.569447 10805 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.570135  8464 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:07.569989 10805 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.570847 11074 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.571760  8394 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:07.572187 11241 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:07.574131 10913 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.574975 10805 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.540879 11120 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.574856 11241 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:27:07.581782  8390 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:07.554240 11177 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:07.553035  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 101816us
I20260709 12:27:07.584929  8468 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:27:07.577039  8394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1645) took 3147 ms (client timeout 2054 ms). Trace:
I20260709 12:27:07.470472 11156 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.611402  8465 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:07.612913  8546 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:07.614159  8397 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
W20260709 12:27:07.588507  8394 rpcz_store.cc:269] 0709 12:27:04.429525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.500383 (+ 70858us) service_pool.cc:224] Handling call
0709 12:27:07.576760 (+3076377us) spinlock_profiling.cc:243] Waited 3.07 s on lock 0x7b5400103454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:07.576941 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7061502336}
I20260709 12:27:07.617228  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.590173 11246 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:07.622684  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.627730  8539 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:07.627542  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.629477  8463 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:07.610055 10914 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.631520  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.631716  8540 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:07.626050  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:07.638383  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.639045  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.637732  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.641306  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.642088  8539 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:07.643637 10896 consensus_meta.cc:287] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.539s	user 0.000s	sys 0.014s
I20260709 12:27:07.645498 10896 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.648272 11177 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:07.642048  8545 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:07.650525  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.650480  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.661059  8537 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.666280  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.667054  8469 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:07.663571  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:07.669770  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 59486.7us
I20260709 12:27:07.671196  8467 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:27:07.677099 11122 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.677778 11167 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:07.677690 11122 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.678400 11167 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.679961 11120 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.680552 11120 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.682691 11120 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.683423  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.684068  8542 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.688045 11122 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.688745 11122 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:07.689409 11122 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.691658  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.692242  8471 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:07.679926  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.700135  8394 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:07.698891  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.669593 11156 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.701603  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.704421  8463 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:07.708559  8544 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:07.710476  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.712409  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.713753  8540 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:27:07.716092  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.718770  8538 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:07.719728  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.720626  8470 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:07.723832  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.724562  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.725159  8472 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:07.725270  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.725919  8468 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:07.726791  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.727319  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.727782  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.728489  8388 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:07.728819  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.729368  8391 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:07.730129  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.730837  8391 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:07.731029  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.731586  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.731742  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.732143  8391 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:07.728505  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.732862  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.733158  8390 raft_consensus.cc:2368] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:07.733539  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.733969  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.734115  8392 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:07.734514  8467 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.735695  9015 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.732161  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.738023  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.738902  8391 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:07.735591  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:07.741535  8397 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:07.737445  8396 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:07.746588  8546 raft_consensus.cc:2368] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:07.747134  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.753549  8542 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 2.
I20260709 12:27:07.757120 10914 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.757726 10914 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:07.749087  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:07.759334  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 61357.6us
I20260709 12:27:07.705776 11223 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:07.713882 11122 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.724182 10970 raft_consensus.cc:3055] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:07.762109  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:07.761153  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 150303us
I20260709 12:27:07.764423  8397 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.766464  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.768363  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:07.769757  8512 connection.cc:256] RPC call timeout handler was delayed by -1.8455305060001592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 12:27:07.770000  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:07.770378  8512 connection.cc:256] RPC call timeout handler was delayed by -1.5463575190001393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:27:07.765838  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.767093  8539 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
W20260709 12:27:07.774632 11250 log.cc:927] Time spent T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:27:07.775074  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.775013  8540 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:07.776237  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.776845  8469 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:07.777678  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:07.778409  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.775722  8395 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:07.779958  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.780404  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.781097  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.781567  8539 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.781816  8395 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:07.782073 11122 consensus_queue.cc:1059] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:07.782636  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:07.782989  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.737757 11099 consensus_queue.cc:1059] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:27:07.784582  8394 raft_consensus.cc:2410] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:27:07.785346  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:07.781116  8465 raft_consensus.cc:2393] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:07.783602 11245 raft_consensus.cc:3055] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:07.783978  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.792405  8362 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:07.779933  8389 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:07.795059  8396 raft_consensus.cc:2393] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:07.765177 10970 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:07.799165  8540 raft_consensus.cc:1240] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:07.796880  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.800729  8546 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:07.802572  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.804363  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.805151  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:07.806228  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.806769  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:07.807492  8465 raft_consensus.cc:2368] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:07.806835  8393 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:07.792919 11245 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:07.811262  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:07.816468  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:07.796375 10979 raft_consensus.cc:3055] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:07.818717  8539 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.816898  8470 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.808079 10805 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:07.787894 11223 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:07.829200  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 44319.8us
I20260709 12:27:07.820237 10979 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:07.835585  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 99983.6us
I20260709 12:27:07.834882  8394 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:07.822609 11099 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:07.834641  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 97199.6us
I20260709 12:27:07.819525 11167 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.827104 10805 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.843106  8397 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:07.844028  8469 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:07.833519 10896 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.845474  9016 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.846428  8472 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:07.845119  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:07.849859  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.844789 10805 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:07.849167 10970 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.844696 11099 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.878937 11099 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:07.859915  9015 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.860966  8465 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:07.861560 10913 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:07.880534 10913 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:07.849211 11179 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.861979 11255 log.cc:927] Time spent T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:27:07.886636  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:07.862323 11262 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:07.862562  9016 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:07.862841 11223 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.863283 11249 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:07.863698 11251 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:27:07.863963  8511 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:07.866475  8467 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:27:07.836160 10871 consensus_queue.cc:1059] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 12:27:07.872876  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 46813.9us
I20260709 12:27:07.846014 11167 consensus_queue.cc:1059] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:27:07.875725  8463 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:07.849131 10896 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:27:07.885972  8471 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:07.893877  8391 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:07.886538 10913 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:07.915670 11263 log.cc:927] Time spent T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 12:27:07.919445 11029 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:07.925632  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 63163.3us
I20260709 12:27:07.923401  8362 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:07.895660 11099 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:07.925381 11029 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.928689 11265 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:07.849292 11245 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:07.932230  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 94321.4us
I20260709 12:27:07.927947 11202 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:07.887043 11179 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:07.929773 11099 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:07.934540 10970 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.941661 11246 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:07.951321 11099 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:07.950230  9015 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:07.930816 11129 consensus_queue.cc:1059] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:27:07.943436 11178 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:07.943948 11202 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:07.969417  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 43588.7us
I20260709 12:27:07.972008 11029 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.973999  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.975152  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.975741  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.976085 11262 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.976536  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.976825  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.977286  9046 raft_consensus.cc:2368] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5.
I20260709 12:27:07.979156 11179 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:07.979633 10805 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.980917  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:07.981492  9041 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.981760 10805 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:07.982872  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:07.985528  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.985776 11148 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:07.986222 11148 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.986593 11148 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:07.968859 11202 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:07.976212  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.989187  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:07.987857 11082 raft_consensus.cc:3055] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:07.990561 11082 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:07.991463 11082 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:07.992637 11082 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:07.954819 10871 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:07.996379  8391 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:07.996963  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:08.009971  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 86719.3us
W20260709 12:27:08.006629  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 188755us
I20260709 12:27:08.011819  8539 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
W20260709 12:27:08.006357  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 50221.2us
W20260709 12:27:08.013705  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.007252 10871 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.023675 10871 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:08.016626  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 73608.5us
I20260709 12:27:08.020754  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:08.021414  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.028730  8470 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:07.995644 11098 consensus_queue.cc:1059] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:27:08.036402 11262 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:08.037132  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:08.038743 11245 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:08.040009  9015 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:08.040126 10979 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.041411 10979 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:08.044220  8362 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.014782 11178 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.060307  8397 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:08.026815 11265 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:08.062531 10744 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:08.057503 11223 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:08.052448 11179 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.031096 11246 consensus_queue.cc:1059] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:27:08.033136 11270 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:27:08.075495 10744 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:08.078039 10744 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.079365 10985 consensus_queue.cc:1059] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:27:08.082958 10985 raft_consensus.cc:3055] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.087740  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.083302 10985 raft_consensus.cc:740] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.090442  8546 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:08.091933  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.092554  8542 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:08.092304 11099 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.093014  8436 leader_election.cc:400] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5.
I20260709 12:27:08.093305  8436 leader_election.cc:403] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:08.094303 11156 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 4. Current term is 5.
I20260709 12:27:08.094913  8397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:08.095438  8397 raft_consensus.cc:606] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:08.086822 11133 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:08.095890 11133 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.096426  8362 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.096819 11133 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.097782  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.090214 11067 consensus_queue.cc:1059] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:08.098934 11067 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:08.099815 11265 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.103633  9042 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:27:08.103550 11067 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.098055 11133 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.094458 11099 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.099107  9044 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:08.107466 11206 consensus_queue.cc:1059] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:27:08.095800  8397 raft_consensus.cc:614] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:08.087277  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.109740  8468 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:08.094202  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.110734  8539 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:08.099015  8362 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.111827  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.107867 10871 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.103933 11029 raft_consensus.cc:3055] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:08.114073 11029 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.108562 11206 raft_consensus.cc:3055] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:08.079725 11223 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:08.121455  8362 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.098045 11245 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:08.120002 11025 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:08.123781  8539 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:08.123526 10871 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.123889 10913 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.139678  8393 raft_consensus.cc:1240] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:08.113372 10896 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:27:08.121160 11074 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:27:08.139820 10913 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:08.123252 11029 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.141606 11029 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.126556  8436 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:08.146066  9015 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:08.127532 10805 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.123893 11223 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.105475 11067 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.088944 11177 consensus_queue.cc:1059] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:27:08.131770 11273 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:08.136333  8397 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:08.120482 11120 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.124032 11156 consensus_queue.cc:1059] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:08.193612  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.174187 10744 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.155737  8362 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.185395  8391 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:08.195755  8362 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:08.181386  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 116118us
I20260709 12:27:08.121003 11206 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:08.194303  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 124356us
I20260709 12:27:08.199719 10744 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.201297  8362 leader_election.cc:400] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:08.201658  8362 leader_election.cc:403] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:08.175298 11122 raft_consensus.cc:3055] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:08.156708 11179 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.173312 11245 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:08.206637  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.207652  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:08.206820  9048 raft_consensus.cc:2410] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:08.193271 11120 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.191592 10871 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.191969 11178 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.195813  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:08.210796  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:08.191895 11273 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:08.211588  9047 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:08.173372 11025 consensus_queue.cc:1059] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:27:08.203187 10805 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.210721 10871 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:08.212872  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 67929.4us
I20260709 12:27:08.204221 11129 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:08.205859 11122 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.209646 10913 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.210520 11120 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.208128 11179 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:08.223369  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.224908  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.225664  8539 raft_consensus.cc:2393] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:08.215005 10805 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.227419  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.231809 11245 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.216575 10871 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.216123 11273 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.212134 11099 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:27:08.215788 11178 consensus_queue.cc:1059] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:27:08.256644 11178 raft_consensus.cc:3055] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:08.257011 11178 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.217023 11202 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.239393 11286 raft_consensus.cc:3055] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:08.235314 11246 raft_consensus.cc:3055] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:08.263744 10744 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:08.226136 11179 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.264147 11246 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:08.264358 10896 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:08.265034 11246 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.265877 10913 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:08.266343 11246 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.267789 11282 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:08.271085 11283 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:08.272440 11283 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:08.273396 11283 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:08.273774 11283 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:08.273854 11148 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.263693 11223 consensus_queue.cc:1059] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:27:08.275250 11099 raft_consensus.cc:3055] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:08.274715 11283 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.275633 11099 raft_consensus.cc:740] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:08.276279 11283 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.241119  8362 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.241654 11098 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:08.242367 11272 consensus_queue.cc:1059] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:08.243595 11133 consensus_queue.cc:1059] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:08.244316 11206 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.237025 11249 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.235306 10805 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.282226 11272 raft_consensus.cc:3055] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:08.255120 11120 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.258606 11286 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.282577 11272 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.283298 11286 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.283677 11178 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.284279 11286 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.263908 11202 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:08.285491 11272 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.262825  8394 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:08.263041 11177 consensus_queue.cc:1059] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:08.240336  9041 raft_consensus.cc:2410] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:27:08.272924  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:08.278849  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 51537.9us
I20260709 12:27:08.276453 11099 consensus_queue.cc:260] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:08.290849  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.291723  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 50691.5us
I20260709 12:27:08.294793 10744 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:08.306993  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.307605  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.307657  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.307875  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.312114  8468 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:08.312880  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.313632  8469 raft_consensus.cc:2410] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:08.314339  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.314900  8466 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:08.308077  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.316088  8467 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:08.316461 11277 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.308252  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.316967 11122 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.317919  8463 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:08.318333 11122 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.315979 10871 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.308629  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.318926  8542 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:08.319518 11282 raft_consensus.cc:3055] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:08.319881 11282 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:08.320612 11099 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.320775 11282 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.322003 11282 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:08.323228  8540 raft_consensus.cc:3055] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:08.323580  8540 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:08.317018  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.324607  8465 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:08.324307  8540 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.308787 11178 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.325479  8540 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:08.327503 11082 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:08.328029 11082 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.328925 11082 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.308843 11223 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.330245  9046 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:08.333060  8438 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.331437 11241 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:08.338199  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 65365.8us
I20260709 12:27:08.319828  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:08.340962 11202 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.341495 11202 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.343503 11177 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:08.344470 11202 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.344997  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.316267 10913 raft_consensus.cc:3055] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:08.345542  8542 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.345842 10913 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.348155  8438 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.348754 11025 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:08.349161 11025 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.349386  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.350145 11274 raft_consensus.cc:3055] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:08.350566 11274 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.350449 11025 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.343544 11133 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.302350 11206 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:08.351981 11133 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.352298 11288 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:08.353716 11288 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.354099 11133 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.330307 11223 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.354880 11290 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:08.354110 11288 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:08.355374 11290 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:08.355836 11290 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.346837 10913 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.337862 11241 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.359001 10871 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.358781 11120 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.359575 11241 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:08.360116  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.360613 10913 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.352334 10985 consensus_queue.cc:260] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.362056  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.358086 11249 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:08.351773 11025 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.363507 11179 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.364573  8471 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:08.338017 11277 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:27:08.365667  8343 auto_rebalancer.cc:893] Removing replace marker failed: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:27:08.366081  8343 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:27:08.362686  8394 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:08.370862  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:08.366423  8343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:27:08.332237 11272 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.336496 11148 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.365949 11277 raft_consensus.cc:3055] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:08.376631  8397 raft_consensus.cc:606] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:08.377821  9016 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:08.378038  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.379223  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.373627 10744 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.374310  8539 raft_consensus.cc:1240] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:08.330963 11273 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.361455 11223 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.377272  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.383776  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.378646  8472 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
W20260709 12:27:08.380735  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.387092  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.387915  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.388767  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.389997  8388 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:08.390633  8471 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0"
dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39212
I20260709 12:27:08.391359 10985 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.392025  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.394032 11179 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.395010  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.395666  8539 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.405925 11290 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.385819 11274 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.408068  8539 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:08.339779 10805 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.409617  8436 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:08.410828 10805 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:08.411517  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.411943  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.412067  8389 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
W20260709 12:27:08.408236  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.383451 10970 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:27:08.391722  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.380021 11277 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:08.415444  8395 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:08.417819  8511 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.418591  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.412534  8389 pending_rounds.cc:85] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 5
I20260709 12:27:08.385504 11262 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.382215 11177 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:08.426755  8542 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:08.427170 11148 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:08.435794  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.436503  8388 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:08.427318  8391 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:08.407936 11241 raft_consensus.cc:476] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:27:08.431830  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.422437  8389 pending_rounds.cc:107] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:27:08.434062  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:08.434548  8511 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.408684 11274 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:08.428110  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 48960.4us
I20260709 12:27:08.501258  8389 raft_consensus.cc:2889] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:08.503087  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 69102.6us
I20260709 12:27:08.504777  8438 leader_election.cc:400] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:08.505105  8438 leader_election.cc:403] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:08.507588 11249 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:08.508114 11249 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.508965 11249 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.510286 11288 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.511121 11241 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.511345 10744 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
W20260709 12:27:08.504478  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 74474.2us
I20260709 12:27:08.440204  8295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35638 (request call id 246) took 7347 ms. Trace:
I20260709 12:27:08.432533 11074 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:08.512393  8463 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:08.521085 11074 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.521708  8292 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 5, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.522571  8390 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:08.515432  8396 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:27:08.433228 11262 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.522022 11074 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.524190  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.525024  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:08.499855  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.526885  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.550526  8388 raft_consensus.cc:2410] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:27:08.529057  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.523383  8292 catalog_manager.cc:5697] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.548430  8395 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:08.560165  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.560335  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.560755  8389 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.561381  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.562408  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:08.563082  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.563597  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.564021  8292 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 8, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 8 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.565419  8468 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:08.566116  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.565681  8292 catalog_manager.cc:5697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.566434 11281 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:08.567052  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.568279  8396 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:08.567198  8292 catalog_manager.cc:5697] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.568967  8394 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:08.569547  8396 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:08.582767  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:08.585804  8540 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:27:08.572857  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.581713  8389 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:08.593606  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.594306  8389 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:08.571102  8292 catalog_manager.cc:5697] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.537374 11262 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.590178  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.597064  8465 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:08.606364  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.608358  8389 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:08.581604  8391 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:08.583735  8388 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:08.600665  8396 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:08.602035  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.602232  8292 catalog_manager.cc:5697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.612217  8539 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:08.612416  8469 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:27:08.618211  8472 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:08.569797 11067 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:08.617950  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.618716  8390 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:27:08.619899 11295 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:27:08.620180 11273 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:08.620755 11293 log.cc:927] Time spent T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:27:08.619774  8292 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.621551 11288 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:08.623780  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 121172us
W20260709 12:27:08.624810  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 58755.8us
I20260709 12:27:08.569957 11082 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:27:08.513082  8295 rpcz_store.cc:276] 0709 12:27:01.081965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.082091 (+   126us) service_pool.cc:224] Handling call
0709 12:27:01.238528 (+156437us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5400210610. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461265640 00007f646a13c846 00007f646a24690e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc 00007f6468706392 00007f64626c448c 00007f64626c38c6
0709 12:27:08.429161 (+7190633us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:07.684295 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:07.685142 (+   847us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:07.685192 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:27:07.685220 (+    28us) tablet.cc:662] Decoding operations
0709 12:27:07.685988 (+   768us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:07.686068 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:07.686096 (+    28us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:07.686846 (+   750us) tablet.cc:701] Row locks acquired
0709 12:27:07.686899 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:27:07.691495 (+  4596us) write_op.cc:270] Start()
0709 12:27:07.691722 (+   227us) write_op.cc:276] Timestamp: P: 1783600027687032 usec, L: 0
0709 12:27:07.691746 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:27:07.700118 (+  8372us) log.cc:844] Serialized 1738 byte log entry
0709 12:27:08.108343 (+408225us) op_driver.cc:464] REPLICATION: finished
0709 12:27:08.225517 (+117174us) write_op.cc:301] APPLY: starting
0709 12:27:08.225614 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:08.225763 (+   149us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:08.227841 (+  2078us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:08.228505 (+   664us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:08.228867 (+   362us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:27:08.228917 (+    50us) write_op.cc:312] APPLY: finished
0709 12:27:08.251698 (+ 22781us) log.cc:844] Serialized 41 byte log entry
0709 12:27:08.251890 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:08.251991 (+   101us) write_op.cc:454] Released schema lock
0709 12:27:08.252050 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:08.252507 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:08.252535 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":5486976,"child_traces":[["op",{"apply.queue_time_us":114029,"apply.run_cpu_time_us":3075,"apply.run_wall_time_us":29006,"num_ops":4,"prepare.queue_time_us":218219,"prepare.run_cpu_time_us":19237,"prepare.run_wall_time_us":140897,"raft.queue_time_us":136198,"raft.run_cpu_time_us":33526,"raft.run_wall_time_us":120010,"replication_time_us":416431,"thread_start_us":462827,"threads_started":4,"wal-append.queue_time_us":148129}]]}
I20260709 12:27:08.625802  8397 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:08.626917  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.639721  8539 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:08.631585  8545 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:08.608114 11122 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.611152 10914 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:27:08.633455  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 91829.7us
W20260709 12:27:08.611634 11270 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:27:08.636598  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.653812  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.651813  8292 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.625689 11290 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.661571  8390 raft_consensus.cc:2393] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 2: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:08.661777  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:08.664124  8397 raft_consensus.cc:2376] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8. Re-sending same reply.
I20260709 12:27:08.662278  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.611039 11148 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:27:08.658155  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.666918  8361 leader_election.cc:400] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
W20260709 12:27:08.669555  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.669476  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.570632 11177 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.672794  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.673557  8546 raft_consensus.cc:2393] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:08.675213  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.675395  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.675966  8539 raft_consensus.cc:2393] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:08.675932  8397 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:08.681650  8392 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:08.669085  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.674670  8292 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:08.691114  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 54601us
I20260709 12:27:08.692735  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.693876  8438 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.693940 11178 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:08.693986  8471 raft_consensus.cc:606] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 12:27:08.694828  8471 raft_consensus.cc:614] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:08.603549 11277 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.668883 11273 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.704155  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:08.717916  8397 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:08.717546  8292 catalog_manager.cc:5697] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:08.661154 11099 consensus_queue.cc:1059] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:27:08.721793  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.724892 10913 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.725319  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:08.677280 10914 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:08.728749  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.714588 11025 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:08.735117  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.694429 11178 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:08.736366  8397 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:08.737531  8546 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:08.742781  8464 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:08.752487  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.734882 11074 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.759895  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.760560  8545 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:08.761459  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.764384  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.740180 11178 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:08.754015 10985 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:08.752126 10913 raft_consensus.cc:697] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:08.775118  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.777872  8438 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.763759 11277 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:08.781273  8545 raft_consensus.cc:2393] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:08.912664  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.828431 11288 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.912084  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.930590  8470 raft_consensus.cc:2410] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:27:08.839885 11312 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:08.932727  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.933362  8545 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.897475  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:08.841141  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:08.913281  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.848263  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.831631  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.911435  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:08.935703  8471 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.936077  8472 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.780387 11025 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:08.860852  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.937867  8395 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:08.836737  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:08.816821  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.939162  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.835985  8546 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:08.861517 11281 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:08.868268  8512 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:08.836369  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.837096  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.832810  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.832404  8538 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:08.921929 10744 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:08.923460  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:08.889178 11206 consensus_meta.cc:287] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.003s
I20260709 12:27:08.833097 10985 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:08.864254  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:08.828055  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50258.5us
I20260709 12:27:08.947333  8396 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:08.947600  8438 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:08.947731 10744 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.948752  8438 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.863797  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:08.949553  8390 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:08.925172  8463 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:08.925922  8469 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.863880 10913 consensus_queue.cc:237] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:08.955190  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:08.929447  8464 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:08.955736  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.936903  8540 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:08.941054  8537 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:08.956739  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.827273 11262 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.945806  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.960827  8546 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:08.835664 10914 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:08.927103  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.963234  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.956302  8544 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:08.963487  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.962581  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 208897us
I20260709 12:27:08.962045 10744 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:08.963707  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:08.938812 11312 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:08.969898  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.970147 11148 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:08.970309  8362 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.970638  8537 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:08.970745  9050 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:27:08.969774 11025 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:08.972707  8390 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:08.973290  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:08.974010  8540 raft_consensus.cc:2393] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:08.974406  8543 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:08.976874 11074 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:08.977353 11074 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.977557 11122 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:08.977967 11122 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.978310 11122 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:08.977248  8362 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.971097  9050 pending_rounds.cc:85] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Aborting all ops after (but not including) 7
I20260709 12:27:08.985342  9050 pending_rounds.cc:107] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 12:27:08.985595  9050 raft_consensus.cc:2889] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:08.986943  8362 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.987610  9045 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:08.988476  8362 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:08.989346 11274 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.989734 11274 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:08.990101 11274 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.991150 11082 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:08.991596 11082 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.991931 11082 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:08.996912  8469 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:09.003265  8544 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:09.003432  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:09.018458  8396 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:09.002528  8471 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:08.986032 11241 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:09.035184  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:09.004204 11067 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:08.999927 11288 raft_consensus.cc:2764] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:27:09.057814  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.059543  8542 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:09.062747 11122 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.032243 10979 raft_consensus.cc:3055] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:27:09.064720  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 112774us
I20260709 12:27:09.067780  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:09.068971  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:09.073575  8438 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.074854  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.076128  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.029089 11178 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.044531 11067 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:09.086504  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 98082.2us
I20260709 12:27:09.075551 11148 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.067210 10979 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:09.091967  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:09.093896  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:09.089286 10744 consensus_queue.cc:1059] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:27:09.076784 11025 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.096532  8438 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.082023 11156 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:09.099999  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:09.108140  8362 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:09.108323  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 133543us
I20260709 12:27:09.120569  8393 raft_consensus.cc:1240] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:09.092839 11067 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.124091  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:09.090198 11179 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:09.125284  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:09.310141  8396 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:09.310364  8545 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
W20260709 12:27:09.311198  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.107260 11156 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:09.128345  8343 auto_rebalancer.cc:893] Removing replace marker failed: Replica 2d99fb7f1afb4c958cdc302eb8ef165f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:09.315126  8343 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:27:09.315443  8343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 12:27:09.134258 11308 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.202s	user 0.001s	sys 0.001s
I20260709 12:27:09.205430 11262 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:09.207011 11302 log.cc:927] Time spent T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 12:27:09.101387 11099 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.080005 11314 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:27:09.135286 10979 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.335850 10914 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:09.336323 10979 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.338387 11274 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.120348 11249 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:09.339705 11249 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.108975 11273 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.340657  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:09.341205  8540 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:09.106253 11286 raft_consensus.cc:3055] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:09.341773 11249 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.341996 11286 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:09.083983 10985 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:09.303920  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 178439us
W20260709 12:27:09.328924 11311 log.cc:927] Time spent T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.239s	user 0.002s	sys 0.009s
I20260709 12:27:09.154552 10913 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:27:09.308344 11264 log.cc:927] Time spent T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Append to log took a long time: real 0.245s	user 0.001s	sys 0.010s
I20260709 12:27:09.344712  8362 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:09.308126  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:09.312336  8472 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:09.345647  8362 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:09.308252  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 211801us
I20260709 12:27:09.351739  9014 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.319660  8396 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:09.327689  8545 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:09.328924  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:09.333503 11099 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.330035  8538 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:27:09.335646 11313 log.cc:927] Time spent T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.271s	user 0.000s	sys 0.007s
I20260709 12:27:09.340085  8543 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:27:09.342859 11286 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.109048 11272 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.342764  8541 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:09.364668  8540 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
W20260709 12:27:09.365929  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.324282 11156 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:09.368103  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 243260us
I20260709 12:27:09.373726  8467 raft_consensus.cc:2393] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:09.345961 11326 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:09.344668 11274 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.367684 11249 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.336333 11325 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:09.330864 11223 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:27:09.353837 11298 raft_consensus.cc:2764] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:09.367800 11312 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.345644 11082 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.400439  8465 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
W20260709 12:27:09.393872  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 48326.1us
W20260709 12:27:09.394958  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.413589  8471 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:09.416374  8469 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:27:09.418177  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.419301  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:09.419863  8396 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:09.394130 11286 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.423245  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:09.425060  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.425338  8362 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:09.401988 11312 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:09.426421  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:09.426962  8388 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:09.427544 11289 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:09.411772 11325 raft_consensus.cc:697] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:09.430105  8465 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:09.402081 11274 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:09.393635 11249 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.431224  8396 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
W20260709 12:27:09.431843  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.434804  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:09.398610 11327 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:09.435938  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:09.437848  8472 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:09.436393  8471 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:09.438583 11249 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:09.439265  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 81728.6us
I20260709 12:27:09.441763  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.445218  8472 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:09.449365  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:09.450090  8390 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:09.428602 11206 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.454691 11206 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.428035 11289 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.412647 11179 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:09.457072 11289 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:09.456717 11179 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.458225  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.459017  8395 raft_consensus.cc:2393] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 4: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:09.464394 11312 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.465019 11335 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:09.464895 11312 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.465605 11335 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:09.466552 11274 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:09.467463 11312 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:09.412097 11178 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.470978  8388 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:09.471626  8438 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.416600 11122 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.390182 11326 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.477442  9016 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:09.460600 11156 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.456663 11206 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:09.482957  8438 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.468816 11262 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:09.465622 11099 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.487632  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:09.489913 11317 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:27:09.490089 11156 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.483479 11312 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.490643 11333 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:09.491012 11312 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.491477 11178 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:09.493235 11312 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:09.494073  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.495724  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.496397  8392 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:27:09.497469  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.498169  8397 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:09.498958  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.499668  8390 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:09.500569  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.508193  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:09.466454 11272 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:27:09.521881  9016 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:09.522168  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:09.490101  8471 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:27:09.525333  8472 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:09.529855  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:09.534113  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:09.531641 11265 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:09.535750 11265 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.536119 11265 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:09.536477 11306 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:09.536945 11306 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.537283 11306 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:09.535279 11206 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:09.538661 11206 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.538980 11206 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:09.542459 11318 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.415s	user 0.002s	sys 0.000s
I20260709 12:27:09.544072 11337 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:09.544718 11337 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:09.545711 11337 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.546212 11206 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.536578 11067 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.535030 11340 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:09.550820  8388 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
W20260709 12:27:09.526513 11074 consensus_meta.cc:287] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.522s	user 0.016s	sys 0.000s
W20260709 12:27:09.532356 11277 consensus_meta.cc:287] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.690s	user 0.015s	sys 0.000s
I20260709 12:27:09.466444 11335 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:09.557261  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 689015us
I20260709 12:27:09.558223  8512 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:09.554034  9015 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:09.519901 11325 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.560025 11270 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:09.561014  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 565288us
W20260709 12:27:09.561933  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.551579 10913 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:27:09.549136 11082 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.467473 11274 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.532683 11025 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:09.569093  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 122350us
I20260709 12:27:09.569768  8362 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:09.571316  8438 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.572562 10970 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:27:09.579785 11319 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:09.580008 11333 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:09.580237 11319 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.572556 11312 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:27:09.581758 11282 raft_consensus.cc:1064] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
W20260709 12:27:09.582178 11282 raft_consensus.cc:1068] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Unable to promote non-voter e3660d999c0a41658a1f1dbe7cc90746: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:27:09.583703 11343 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:09.580349 10970 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:09.584954 10970 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:09.585736 10970 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.586861 10970 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:09.580646 11319 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:09.568020 11327 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:09.552502 11340 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:09.609982  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.611619  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:09.613552  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:09.616073  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.616264  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:09.616699  8396 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:09.616914  8395 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.617643  8512 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:09.620587  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:09.621186  8539 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:09.622361  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:09.562266 10896 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:27:09.625222  8469 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:09.620589  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:09.685343  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 57638.8us
I20260709 12:27:09.686730  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:09.685286  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:09.685504  8541 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:09.684787  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:09.691674  8393 raft_consensus.cc:2393] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:09.691982  8395 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:09.570173 11241 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:09.696130  8545 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:27:09.697443  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50167.2us
W20260709 12:27:09.700608  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 83038.7us
I20260709 12:27:09.701417  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.702098  8512 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:09.571002 11277 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:09.702940  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:09.623492 11288 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:09.562908 11074 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.706601  8512 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:09.706658  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:09.614627 11343 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:09.720125  8436 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:09.693593 11246 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:09.727167  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:09.624312 11340 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:09.787132  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.731242  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:09.758163 11288 raft_consensus.cc:697] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:09.730670 11277 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:09.745240 11324 log.cc:927] Time spent T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.409s	user 0.000s	sys 0.002s
I20260709 12:27:09.724414 11325 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:09.750406 11310 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.756s	user 0.000s	sys 0.003s
I20260709 12:27:09.749240 10744 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:09.759548 11282 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:09.735926 11329 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.864192 11099 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:09.740659 11345 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.745043 11265 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.748142 11327 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.626677 11333 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:09.746506 11326 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.760558 11067 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:09.729888 11332 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:10.112977  9045 raft_consensus.cc:2368] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
I20260709 12:27:09.736680 11347 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:09.740052  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:09.759850  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:10.118438  8393 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:09.758736 11319 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:09.746994 11177 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:09.731513 10985 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:09.736327 11299 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:09.864130  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.703504 11272 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 12:27:09.758142 11206 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:09.726862 11281 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:09.999388  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:10.142939  8390 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:10.001031 11246 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:09.730526 11241 raft_consensus.cc:697] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:10.008010  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:10.013026  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.014237 11325 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:09.735299 11289 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:10.008750 11262 raft_consensus.cc:670] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } [suppressed 4 similar messages]
I20260709 12:27:09.998656 11290 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:10.003053 11334 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.864046 10970 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.154s
I20260709 12:27:10.015763 10914 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:10.121275  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 372785us
W20260709 12:27:10.123792  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 383439us
I20260709 12:27:10.190081  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:10.021799 11329 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.136219 11249 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.142539 10744 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:10.143342  8468 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:10.003018 11298 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:10.148614  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:10.150904 11321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.007s	sys 0.017s
I20260709 12:27:10.118166 11326 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.152155  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.172309 11332 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:10.177553  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:10.151916  9014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.788s (SENT) [suppressed 10 similar messages]
I20260709 12:27:10.131223 11277 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.025373 11099 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.157456  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.203018  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:10.205251  8396 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:10.205063 10744 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.171486 11323 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.142107 11067 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:10.144230 11299 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.100941 11352 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:27:10.192066  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:10.194597  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 339911us
W20260709 12:27:10.182726 11270 consensus_meta.cc:287] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.622s	user 0.000s	sys 0.011s
I20260709 12:27:10.203644  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1685) took 1676 ms. Trace:
I20260709 12:27:10.181142 11122 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.201586  8390 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
W20260709 12:27:10.197414 11306 consensus_meta.cc:287] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.000s
W20260709 12:27:10.201232 11321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.007s	sys 0.017s
I20260709 12:27:10.191128 11177 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.209110  8543 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:10.209496 11332 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.210162  8436 leader_election.cc:400] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
I20260709 12:27:10.216854 10913 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:10.219255 11122 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.213757 11299 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:10.211256 11067 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.199702 10914 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.215190 11323 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.196214 11290 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.220741 11346 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.235006  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.235685  8396 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:10.235962 11352 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:10.220942  8361 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:10.237329  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:10.238358  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:10.221083 11177 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.218847 11074 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.239851 11273 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:10.240826 11281 raft_consensus.cc:3055] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:10.241204 11273 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:10.241613 11177 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:10.203909 11298 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:10.221325 11350 log.cc:927] Time spent T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:27:10.222016 11241 consensus_queue.cc:237] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.243937 11298 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.244032 11328 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:10.244422  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1853) took 1304 ms. Trace:
I20260709 12:27:10.244655 11328 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:10.244881  8537 rpcz_store.cc:276] 0709 12:27:08.940499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.971267 (+ 30768us) service_pool.cc:224] Handling call
0709 12:27:08.972834 (+  1567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:09.560083 (+587249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.560113 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:09.560544 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:27:09.723844 (+163300us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:09.723886 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.723953 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:10.244240 (+520287us) raft_consensus.cc:1685] finished
0709 12:27:10.244260 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:10.244369 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586871,"raft.queue_time_us":595395,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":53184,"thread_start_us":162953,"threads_started":1,"wal-append.queue_time_us":462759}
I20260709 12:27:10.204644 11326 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:10.247077 11348 log.cc:927] Time spent T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:27:10.248374 11326 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.248981 11356 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:10.215338 11333 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.244484 11148 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:10.252221 11319 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:10.252317 11148 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.253237 11265 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:10.253901 11286 consensus_meta.cc:287] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.823s	user 0.007s	sys 0.000s
I20260709 12:27:10.254385 11148 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.249496 11356 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.242281 10970 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:10.181365 11288 consensus_queue.cc:237] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.193576 11334 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.208019 11249 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.200275 11327 raft_consensus.cc:2764] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:27:10.234519  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:10.540139  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.299945  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:10.364424  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:10.696159  8397 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
W20260709 12:27:10.391175  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 185447us
W20260709 12:27:10.479722  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 327798us
I20260709 12:27:10.232945  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:10.544859  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.239320  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:10.691548  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:10.305707  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 87923.5us
I20260709 12:27:10.389506  8392 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:10.254719 11325 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.226653  8436 leader_election.cc:403] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:10.713807  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 503815us
I20260709 12:27:10.714164  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.714993  8436 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:10.713824  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:10.305768  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 92292.8us
I20260709 12:27:10.211844  8394 rpcz_store.cc:276] 0709 12:27:08.518832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.600117 (+ 81285us) service_pool.cc:224] Handling call
0709 12:27:08.615518 (+ 15401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.632248 (+ 16730us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.632279 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:08.632699 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 12:27:08.755867 (+123168us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:08.755907 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.755982 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.749745 (+993763us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:10.190416 (+440671us) raft_consensus.cc:1685] finished
0709 12:27:10.190437 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:10.195619 (+  5182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4333,"spinlock_wait_cycles":19495296,"thread_start_us":80839,"threads_started":1,"wal-append.queue_time_us":271576}
I20260709 12:27:10.716322  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.546700  8468 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
W20260709 12:27:10.704128  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.719458  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:10.696543  8388 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:10.702793  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 463486us
I20260709 12:27:10.722184  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:10.717379  8397 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:10.222265 11332 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.720065  8463 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:10.388108 11335 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.240231 11321 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:10.716078  8392 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:10.686800 11359 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.596127 11082 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:10.458011 11336 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.015s
I20260709 12:27:10.241276 11281 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:10.299113 11148 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.217229 11270 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:10.618656 10805 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.230710 11067 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.688977 10970 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:10.609958 11367 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.207s
I20260709 12:27:10.220038 11306 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.609359 11262 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.430800 11272 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.388444 11363 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.736846  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:10.730934 11178 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.234634 11290 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:10.233546 11323 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:10.816124 11321 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.788000  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.687084 11368 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:10.236485 11352 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:10.791509  8466 raft_consensus.cc:1275] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.232249 11099 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.233048 10914 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:10.844012  8390 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:10.848177  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 145326us
I20260709 12:27:10.853257  8438 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:10.854171  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:10.819073 11148 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.795055  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:10.644279 11347 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:10.797127  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.455339 11265 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.795197  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:10.869140  8468 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:10.740551  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:10.809526  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 94599.1us
I20260709 12:27:10.810105  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:10.871569  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61542.1us
I20260709 12:27:10.227391 11362 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.566s
I20260709 12:27:10.874303 10914 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:10.874673 10914 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.875012 10914 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.880048 11323 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:10.880553 11323 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.810495  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.882851  8392 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:27:10.707507 11333 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:10.884528 11333 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:10.887491  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:10.887694  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 188890us
I20260709 12:27:10.603807 11345 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:10.815640  8396 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:10.235426 11346 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:10.808300 11299 consensus_meta.cc:287] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.004s
W20260709 12:27:10.800021 11336 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.008s	sys 0.017s
I20260709 12:27:10.831933  8463 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:10.799046 11298 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:10.838929  8393 consensus_meta.cc:287] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.000s
I20260709 12:27:10.865018 11290 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:10.800133 11359 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.229691 11122 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:10.855356  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.840065 11262 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:10.736876  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:10.856648  8470 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:27:10.826180  8388 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:10.796300 11082 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:10.866683 11156 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:10.850569 11241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.016s	sys 0.032s
I20260709 12:27:10.819043 10805 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.851186 11329 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:10.853833 11368 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.802140 11335 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.839847 11272 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.895707  8393 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:10.818270 11332 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:10.826952 11025 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.899215  8362 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:10.740240 11361 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 12:27:10.901800  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:10.902415  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:10.902768  8540 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:10.902837  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:10.842561 11363 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:10.911651  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:11.098670  8539 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 2.
I20260709 12:27:11.098924  8540 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:27:10.912551  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 184699us
I20260709 12:27:10.921311  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:10.911952  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:10.986188  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 264072us
I20260709 12:27:10.890630 11362 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.897096 11347 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.991573 11156 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:11.004745  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:11.005316  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:10.897873 11290 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:11.093103 11354 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:10.854274 11321 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:10.985155 11365 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.530s	user 0.001s	sys 0.001s
I20260709 12:27:10.984925 11122 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.888113 11265 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:10.992528 11241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.016s	sys 0.032s
I20260709 12:27:10.987556 11384 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:11.073650  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 178014us
I20260709 12:27:10.897475 11299 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:11.075148  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 176001us
I20260709 12:27:10.891332 11281 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.092182 10744 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:11.092252  9016 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:10.927836 11179 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:10.886541 11356 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:11.100175  8541 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:10.910961 11364 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 12:27:11.101135  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:10.905145 11298 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.106735  8389 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:11.112601  8546 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:27:11.119705 11273 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.004s	sys 0.007s
I20260709 12:27:11.121220 10985 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:10.986753 11366 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260709 12:27:10.905938 10970 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.090485 11345 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:11.102021 11328 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:11.128144 11358 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:27:11.075824  8393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50338 (request call id 386) took 1308 ms (client timeout 1699 ms). Trace:
I20260709 12:27:11.123308 11156 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:11.150516  8394 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:27:11.152235  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61189.3us
W20260709 12:27:11.154982 10913 consensus_meta.cc:287] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.000s
I20260709 12:27:11.111964 11362 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.127992 11082 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.134966 11347 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.170895  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:11.092803 11025 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.141324 11334 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:11.073303 11352 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.131738 11290 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:11.139636 11122 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:11.139894 11385 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 12:27:11.390787  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 289459us
W20260709 12:27:11.366400  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.420142  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:11.410751  9015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.008s	sys 0.000s
W20260709 12:27:11.436474  9015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.008s	sys 0.000s
I20260709 12:27:11.436678  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:11.437256  8392 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:11.170637 11273 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.004s	sys 0.008s
W20260709 12:27:11.438956  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.435660  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 324) took 1665 ms. Trace:
I20260709 12:27:11.444983  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:11.451682  9045 raft_consensus.cc:2368] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10.
W20260709 12:27:11.427686  8393 rpcz_store.cc:269] 0709 12:27:09.759428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.759596 (+   168us) service_pool.cc:224] Handling call
0709 12:27:11.036720 (+1277124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:11.449826  8512 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:11.454416  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:11.444917  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:11.452773  8469 rpcz_store.cc:276] 0709 12:27:09.769891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.770416 (+   525us) service_pool.cc:224] Handling call
0709 12:27:09.999724 (+229308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:10.109464 (+109740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:10.109515 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.117165 (+  7650us) log.cc:844] Serialized 26 byte log entry
0709 12:27:10.196219 (+ 79054us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:10.196257 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.196322 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:11.187470 (+991148us) raft_consensus.cc:1685] finished
0709 12:27:11.187488 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.435599 (+248111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7684,"raft.queue_time_us":19447,"raft.run_cpu_time_us":8616,"raft.run_wall_time_us":88401,"spinlock_wait_cycles":1553280,"thread_start_us":59334,"threads_started":1,"wal-append.queue_time_us":246159}
W20260709 12:27:11.213558 11379 log.cc:927] Time spent T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:27:11.214062 11370 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
W20260709 12:27:11.212385 11369 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.307s	user 0.000s	sys 0.000s
I20260709 12:27:11.166103 10979 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:27:11.211864 11376 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:27:11.212952 11377 log.cc:927] Time spent T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:27:11.194641 11356 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:11.423759 11340 consensus_meta.cc:287] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.418s	user 0.011s	sys 0.000s
I20260709 12:27:11.177013 11306 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:11.435643 11343 consensus_meta.cc:287] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.615s	user 0.011s	sys 0.000s
I20260709 12:27:11.181857 11345 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.421041 11368 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.420169 11249 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:11.424968 11346 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.455271 10913 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:11.396575 11262 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:11.272676 11178 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6.
I20260709 12:27:11.451490 11281 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:11.419943 11404 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:11.518679  8464 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.005s	sys 0.008s
W20260709 12:27:11.578519  8464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.005s	sys 0.008s
I20260709 12:27:11.195103 11381 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.384s
I20260709 12:27:11.533524 11345 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:11.523000  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:11.466351 11334 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:11.529780  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 80110.7us
I20260709 12:27:11.176045 10985 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:11.535624  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 386214us
I20260709 12:27:11.479475 11328 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:11.537890  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.475394 11359 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.560848 11343 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.156083 11384 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:11.212267 11378 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.312s
I20260709 12:27:11.176524 11179 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.450591 11148 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:11.534634 11082 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:11.572506 11385 raft_consensus.cc:3055] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:11.194795 11387 consensus_queue.cc:1048] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.362s
I20260709 12:27:11.593194  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:11.548316 11368 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.480334 10979 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.567231 11249 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:11.578220 11277 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:11.620065  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:11.584162 11262 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:11.527092 11340 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.641916 11335 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:11.596680 10914 consensus_meta.cc:287] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.721s	user 0.005s	sys 0.005s
I20260709 12:27:11.630582  8471 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:11.624449  8468 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
W20260709 12:27:11.640895  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 185604us
I20260709 12:27:11.590451 11298 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.595263 11178 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.642941  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 387) took 1883 ms. Trace:
W20260709 12:27:11.523730 11333 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.014s
I20260709 12:27:11.646040  8396 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:11.594805 11265 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.531673 11356 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.601588 11392 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:11.648168  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 203311us
I20260709 12:27:11.648114  8472 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:11.658207 11265 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:11.659564 11265 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:11.662576 11321 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.601663 10805 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.666354  9015 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:11.653090  8395 rpcz_store.cc:276] 0709 12:27:09.759740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.822852 (+ 63112us) service_pool.cc:224] Handling call
0709 12:27:09.823244 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:09.874659 (+ 51415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:09.874693 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.084072 (+209379us) log.cc:844] Serialized 26 byte log entry
0709 12:27:10.467340 (+383268us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:10.467383 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.467472 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:11.642738 (+1175266us) raft_consensus.cc:1685] finished
0709 12:27:11.642760 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.642884 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51013,"raft.run_cpu_time_us":9034,"raft.run_wall_time_us":120461,"thread_start_us":282563,"threads_started":1,"wal-append.queue_time_us":715536}
I20260709 12:27:11.621814 11385 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:11.669235  8472 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:11.671473  8392 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
W20260709 12:27:11.672325  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 79204.1us
I20260709 12:27:11.629454 11299 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.674615  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:11.642359 10979 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:11.630738 11381 consensus_queue.cc:1243] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Peer 21c151c99bcf4cbeb819de06e68d95bf log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:11.630244 11406 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:11.678151  9015 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:11.648543 11272 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.652733 11400 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.617836 11334 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.608312 11328 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.595587 11404 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.654105 11363 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.646618 11306 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:11.656139 11277 raft_consensus.cc:697] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:11.691960 11362 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.692396 11334 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.673291 11262 raft_consensus.cc:697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:11.646855 11368 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.651484 11249 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:11.656433 10914 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:11.671608 11178 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.717149  8512 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:11.726541 11413 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:11.728271 11347 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.728572 11368 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.729353 11262 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:11.735713 11407 raft_consensus.cc:2764] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:11.713070 11025 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:11.745177  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 87330us
I20260709 12:27:11.693857 11400 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.757294 11406 raft_consensus.cc:697] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:11.759814  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:11.767161  8392 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:11.735797 11419 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:11.761263  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 83673.7us
I20260709 12:27:11.764542  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:11.764741  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:11.764991  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:11.768672  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:11.769029  8464 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 2.
I20260709 12:27:11.769196  8470 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:11.765794  9050 raft_consensus.cc:2368] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7.
I20260709 12:27:11.743050 11413 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.771374 11419 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:11.773954 11419 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:11.735980 11409 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:27:11.772545  8510 leader_election.cc:400] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10.
I20260709 12:27:11.781126  8510 leader_election.cc:403] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:11.784126  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 683006us
I20260709 12:27:11.786116  8361 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:11.789091  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:11.766397 11337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.010s	sys 0.031s
W20260709 12:27:11.802248  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 85190.4us
W20260709 12:27:11.825199  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 45799.5us
I20260709 12:27:11.825987  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:11.767248 11340 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.773906 11406 consensus_queue.cc:237] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.827191  8512 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:11.909603  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:11.767913 11385 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:11.979609  8543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.016s	sys 0.013s
I20260709 12:27:11.836596  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:12.588311  8543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.023s	sys 0.064s
W20260709 12:27:11.826349  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 56163.5us
W20260709 12:27:11.953104  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 184487us
I20260709 12:27:11.906070  8469 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 12:27:11.835668  8436 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:11.773573 11413 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:12.608592  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:11.772853 11246 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:12.631691 11447 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.632380 11447 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:12.636818  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1771) took 1735 ms. Trace:
I20260709 12:27:12.637310  8543 rpcz_store.cc:276] 0709 12:27:10.901742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.902200 (+   458us) service_pool.cc:224] Handling call
0709 12:27:10.902948 (+   748us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:11.073563 (+170615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.073596 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:11.133408 (+ 59812us) log.cc:844] Serialized 52 byte log entry
0709 12:27:12.588768 (+1455360us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:12.588808 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.588876 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.636579 (+ 47703us) raft_consensus.cc:1685] finished
0709 12:27:12.636599 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.636754 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":268786,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9416,"spinlock_wait_cycles":996096,"thread_start_us":1466905,"threads_started":2,"wal-append.queue_time_us":1392062}
I20260709 12:27:12.635242 11447 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:12.639528 11447 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:11.775918 11421 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:11.982686 11405 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.780300 11363 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.834692 11407 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:27:11.800448 11337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.010s	sys 0.031s
I20260709 12:27:12.053165 11428 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:12.726955  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:12.655994  9016 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:12.669788  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:11.883953 11378 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:11.844871 11067 consensus_meta.cc:287] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.007s	user 0.010s	sys 0.000s
I20260709 12:27:11.784938 11025 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.776499  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 120590us
W20260709 12:27:12.155555 11424 log.cc:927] Time spent T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:27:12.114944 11319 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.281s	user 0.004s	sys 0.028s
W20260709 12:27:12.538636 11427 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.654s	user 0.001s	sys 0.000s
W20260709 12:27:12.538271 11345 consensus_meta.cc:287] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.928s	user 0.007s	sys 0.000s
W20260709 12:27:12.550087 11281 consensus_meta.cc:287] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.966s	user 0.009s	sys 0.000s
W20260709 12:27:12.362673 11290 consensus_meta.cc:287] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.887s	user 0.009s	sys 0.001s
W20260709 12:27:12.243199 11332 consensus_meta.cc:287] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.145s	user 0.010s	sys 0.001s
W20260709 12:27:12.568326 11082 consensus_meta.cc:287] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.947s	user 0.006s	sys 0.003s
I20260709 12:27:11.835223 10985 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.961512 11409 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.864447 11362 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:11.905514 11383 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.002s	sys 0.024s
I20260709 12:27:11.825133 11387 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:12.655383  9015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.001s	sys 0.010s
I20260709 12:27:11.935014 11356 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:11.997972 11328 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.858318 11179 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:12.117969 11429 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:11.835049 11384 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:12.017063 11416 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.371229 11249 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:12.318054 11410 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:12.327473 11298 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:11.906800 11420 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:11.880069 11306 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:27:12.702212  8511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.000s	sys 0.026s
I20260709 12:27:11.827670 11368 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:12.756609  8392 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:12.757022  8469 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:12.757699 11449 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:12.016876 11433 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.616990 11400 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:11.857775 11426 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.616453 10914 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:11.842650 11347 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.913s
I20260709 12:27:11.880820 11156 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:11.780201 11277 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:11.846524 11434 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:13.074951  9015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.004s	sys 0.032s
W20260709 12:27:13.111104  8395 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.051s	sys 0.072s
I20260709 12:27:12.920594  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:12.784759  9014 leader_election.cc:336] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.788s (SENT)
W20260709 12:27:12.731519 11432 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.777s	user 0.001s	sys 0.000s
W20260709 12:27:13.074851  8511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.000s	sys 0.036s
I20260709 12:27:13.084758  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1953) took 2294 ms. Trace:
I20260709 12:27:13.099323 11435 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.104641 11332 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:11.840119 11423 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:27:12.971429 11430 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.035s	sys 0.077s
I20260709 12:27:12.758520 11405 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:12.755298 11340 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:13.110639  8392 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:12.777033 11428 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:12.758380  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:13.081557 11352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.063s	sys 0.084s
I20260709 12:27:12.949806 11178 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:13.076820 11319 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.249s	user 0.012s	sys 0.043s
I20260709 12:27:12.715927 11447 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:13.112624  8510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.001s	sys 0.014s
W20260709 12:27:13.159098 11352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.063s	sys 0.085s
I20260709 12:27:13.159381 11428 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.081032 11290 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.097159 11368 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:12.920367 11337 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:13.120566  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 335808us
I20260709 12:27:13.097674 11384 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.137759 11356 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:13.126434  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.127121  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.127748  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.128016  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:12.923208  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 143991us
I20260709 12:27:12.730664 11425 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.123543  8467 rpcz_store.cc:276] 0709 12:27:10.718696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.718804 (+   108us) service_pool.cc:224] Handling call
0709 12:27:10.741751 (+ 22947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.134436 (+392685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.134464 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.153751 (+ 19287us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.648888 (+495137us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:11.648928 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.010429 (+1361501us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b5400024ed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:13.010483 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:13.010534 (+    51us) raft_consensus.cc:1685] finished
0709 12:27:13.010547 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.012878 (+  2331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":285381,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":49,"spinlock_wait_cycles":902352640,"thread_start_us":404550,"threads_started":1,"wal-append.queue_time_us":541351,"wal-append.run_cpu_time_us":1602,"wal-append.run_wall_time_us":1003237}
W20260709 12:27:13.113011 11419 consensus_meta.cc:287] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 1.335s	user 0.008s	sys 0.002s
I20260709 12:27:13.137167  8469 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:13.211470  8540 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:13.104944 11306 raft_consensus.cc:697] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:12.755990 11363 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.159853 11352 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:12.729044 10979 consensus_meta.cc:287] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 1.042s	user 0.007s	sys 0.002s
W20260709 12:27:13.130539 11367 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.291s	user 0.007s	sys 0.039s
I20260709 12:27:13.139871  9046 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:13.156267  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.112514 11444 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.078271 11362 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:12.865248 11025 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:12.729741 11385 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.098659 11345 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:12.783095 11067 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:13.117660  8395 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.051s	sys 0.072s
I20260709 12:27:13.102630 11298 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.199384  8542 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:27:13.108443 11429 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:13.142123 11383 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.907s	user 0.023s	sys 0.048s
I20260709 12:27:13.214190 11458 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:13.085320 11409 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:12.786857 11378 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.125828  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:13.160115 11430 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.040s	sys 0.099s
I20260709 12:27:13.210192  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:13.211553  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59088 (request call id 337) took 1213 ms. Trace:
W20260709 12:27:13.138752  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 1.30304e+06us
I20260709 12:27:13.265573  8393 raft_consensus.cc:2393] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:13.111336 11410 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:13.132114  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.039s	sys 0.099s
W20260709 12:27:13.213089  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.211207  8537 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:13.139283 11246 raft_consensus.cc:697] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:13.199831 11387 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.204061 11337 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.113839 11281 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.217610  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:13.205140 11443 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:13.215648 11367 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.376s	user 0.007s	sys 0.040s
I20260709 12:27:13.159857 11447 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.210045 11384 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.212982 10896 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.231763  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1579) took 2084 ms. Trace:
I20260709 12:27:13.122519 11426 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:13.203464  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 1.37624e+06us
I20260709 12:27:13.225338 11323 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.236418  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.239912 11067 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.241284  8397 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:13.117885 11433 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.101418 11420 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.224622 11356 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:13.101111 11449 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.289089  9014 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:13.216883 11425 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.265517  8469 rpcz_store.cc:276] 0709 12:27:11.998514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.664651 (+666137us) service_pool.cc:224] Handling call
0709 12:27:13.211495 (+546844us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.160331 11340 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.108520 11416 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:13.269372  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 59273.8us
W20260709 12:27:13.268697  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.039s	sys 0.100s
W20260709 12:27:13.294770  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 1.45812e+06us
I20260709 12:27:13.295842  8463 raft_consensus.cc:2410] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:13.217078 10979 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.240258 11025 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.273898  8543 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:13.297978  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:13.272619  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.218353 11352 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.214365 11419 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.281275 10896 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.282812 11405 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:13.281666  8388 rpcz_store.cc:276] 0709 12:27:11.147197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.156482 (+  9285us) service_pool.cc:224] Handling call
0709 12:27:11.156802 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.439251 (+282449us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:11.439283 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.468241 (+ 28958us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.827041 (+358800us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:11.827083 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.827145 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:13.231580 (+1404435us) raft_consensus.cc:1685] finished
0709 12:27:13.231597 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.231710 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20484,"raft.queue_time_us":378518,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":19491,"thread_start_us":288157,"threads_started":1,"wal-append.queue_time_us":434111}
I20260709 12:27:13.284276  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:13.284737  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:13.139338 11435 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.274871 11337 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.272187 11319 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:13.266577 11428 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:27:13.266494  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:13.293187  9045 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
W20260709 12:27:13.314075  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 47642.2us
I20260709 12:27:13.297508  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:13.299295  8537 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:27:13.315207  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:13.286996 11156 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.279964 11281 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.304526  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:13.305780  8361 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:13.306876  8538 raft_consensus.cc:2376] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9. Re-sending same reply.
I20260709 12:27:13.310097  8539 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:13.295539 11340 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:13.275024 11387 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.280085 11306 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.301946 11262 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:13.315922  9014 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:13.315255  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.328262  8467 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:27:13.316624 11386 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.321099  8469 raft_consensus.cc:2410] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:27:13.228127 11444 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.320948  8512 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:13.316565 11450 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:27:13.308701 11290 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.274993 11453 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:27:13.328926  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:13.313833  9042 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:13.312670 11383 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:13.243448 11458 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.331984  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1754) took 1425 ms. Trace:
I20260709 12:27:13.333091  8469 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:13.325783 11447 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.318202 11405 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:27:13.319482 11025 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:13.318806 11332 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:13.342268  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:13.280011 11443 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.346792  8542 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:13.328670  8537 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:13.346726  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:13.327170 11274 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:13.337707 11082 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:13.319612 11367 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:27:13.312985 11246 consensus_queue.cc:237] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.444247  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:13.438580  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:13.444449 11445 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:13.444252  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1755) took 1536 ms. Trace:
I20260709 12:27:13.449605  8469 rpcz_store.cc:276] 0709 12:27:11.908282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.332692 (+1424410us) service_pool.cc:224] Handling call
0709 12:27:13.332938 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.444012 (+111074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.444196 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.446198  8392 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.329021 11423 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
W20260709 12:27:13.453267  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 136913us
I20260709 12:27:13.353143  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:13.450594  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:13.401268  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:13.353143  8467 rpcz_store.cc:276] 0709 12:27:11.906381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.312476 (+1406095us) service_pool.cc:224] Handling call
0709 12:27:13.327483 (+ 15007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.331727 (+  4244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.331932 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.456561  8469 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:27:13.344297 11347 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.338441 11319 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:13.452742  9047 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:13.460647  8469 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:13.462046  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1756) took 1542 ms. Trace:
I20260709 12:27:13.463042  8469 rpcz_store.cc:276] 0709 12:27:11.918765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.457227 (+1538462us) service_pool.cc:224] Handling call
0709 12:27:13.457501 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.461044 (+  3543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.461217 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:13.467566  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:13.467901 11451 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.468322  9044 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.470857  8392 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:27:13.471539  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:13.382350 11282 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.653s	user 0.026s	sys 0.028s
I20260709 12:27:13.472282  9016 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:13.475348  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:13.475930  8467 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:13.419925 11345 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.453660 11332 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.398191  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:13.400046 11409 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.351676 11368 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.395892 11298 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.443145 11433 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.355720 11384 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.473829 11383 raft_consensus.cc:2764] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:27:13.474779 11282 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.759s	user 0.031s	sys 0.032s
W20260709 12:27:13.482471 11463 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:27:13.483994  9046 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:13.443353 11459 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:13.464246 11445 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:13.353410 11356 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.497025 11410 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.480129 10979 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:13.498131 11462 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:27:13.498427 11270 raft_consensus.cc:3055] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:13.461404 11082 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.465385 11347 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.488406  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1758) took 1530 ms. Trace:
I20260709 12:27:13.469636 11451 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.410563 11386 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:13.481398 11332 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:13.501745 11262 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:13.549584  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:13.489001 11457 log.cc:927] Time spent T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 12:27:13.554445 11420 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.490864 11277 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:14.020345 11277 raft_consensus.cc:697] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:14.021168 11277 consensus_queue.cc:237] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:13.555895 11426 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:13.501895 11362 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:13.502485 11407 consensus_meta.cc:287] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.742s	user 0.008s	sys 0.001s
I20260709 12:27:13.495216 11281 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.632573 11383 raft_consensus.cc:1064] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:27:13.554627 11449 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.490063 11443 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:13.502765 11363 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:13.553674 11413 consensus_meta.cc:287] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.840s	user 0.000s	sys 0.008s
I20260709 12:27:14.025017  9043 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:14.025272 11407 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10.
I20260709 12:27:13.982152 11270 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:14.026044  8545 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:13.989605 11445 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:14.026348 11270 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.027567 11270 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:13.981832 11429 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:13.496973 11454 consensus_queue.cc:1059] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.533s
I20260709 12:27:14.030227 11454 raft_consensus.cc:3055] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:14.030566 11454 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:13.939674 11361 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.549813 11458 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:14.031299 11454 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.032058 11413 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:14.019011  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 529217us
I20260709 12:27:14.033303  9048 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:14.032508 11454 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:14.034003  8512 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:13.956019 11442 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.893s	user 0.002s	sys 0.004s
I20260709 12:27:14.044652 11458 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:14.044871 11413 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:13.942261 11340 consensus_meta.cc:287] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.000s
W20260709 12:27:13.964864 11337 consensus_meta.cc:287] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.000s
I20260709 12:27:14.031378 11361 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:14.058409  9016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.028s	sys 0.041s
W20260709 12:27:14.071825  9016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.028s	sys 0.041s
W20260709 12:27:14.072122  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 599867us
I20260709 12:27:13.555330 11444 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:14.062079  9044 consensus_meta.cc:287] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.593s	user 0.002s	sys 0.015s
I20260709 12:27:14.058740  8467 rpcz_store.cc:276] 0709 12:27:11.958212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.476349 (+1518137us) service_pool.cc:224] Handling call
0709 12:27:13.487948 (+ 11599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.488177 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.488195 (+    18us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:13.488222 (+    27us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:13.488242 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.488287 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.488360 (+    73us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1857,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6878}
I20260709 12:27:14.078390  9044 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:14.086786  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:14.087746  8467 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:13.607688 11387 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.088472  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1757) took 2133 ms. Trace:
I20260709 12:27:14.089222  8469 rpcz_store.cc:276] 0709 12:27:11.955441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.464416 (+1508975us) service_pool.cc:224] Handling call
0709 12:27:13.489336 (+ 24920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.489525 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:13.628458 (+138933us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.088144 (+459686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.088194 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:14.088245 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.088309 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.088414 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":324,"thread_start_us":542670,"threads_started":2}
I20260709 12:27:14.091214  8392 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:14.065455 11458 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.095129  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:14.095827  8388 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:14.097084  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.103096  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.104619  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1952) took 3386 ms. Trace:
I20260709 12:27:14.106887  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.104970  8465 rpcz_store.cc:276] 0709 12:27:10.717936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.718056 (+   120us) service_pool.cc:224] Handling call
0709 12:27:10.718327 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.097965 (+379638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.098010 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:11.098053 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:11.098083 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.104399 (+3006316us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b5400423954. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:14.104444 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.104551 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872672128}
I20260709 12:27:14.110729  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.114172  8388 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:14.072206 11340 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.090831 11281 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:14.119041  8467 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
W20260709 12:27:14.098299 11306 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.029s	sys 0.021s
I20260709 12:27:13.618655 11319 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.075575 11337 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.123740  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:14.099658 11459 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.124785  8392 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:14.125417 11281 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.132616 11281 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:14.105898 11407 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:14.109640 11443 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.126379  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 338) took 1006 ms. Trace:
I20260709 12:27:14.127345  8469 raft_consensus.cc:1240] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:14.124188 11306 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.029s	sys 0.021s
I20260709 12:27:14.129508  9044 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:27:14.110038 11387 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:14.151571  8465 rpcz_store.cc:276] 0709 12:27:13.120306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.125593 (+1005287us) service_pool.cc:224] Handling call
0709 12:27:14.125897 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.126082 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.126106 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.126147 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:14.126175 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.126222 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.126319 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.115232 11423 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:14.150738  9049 raft_consensus.cc:2393] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:14.151939  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1759) took 2191 ms. Trace:
W20260709 12:27:14.138041 11385 consensus_meta.cc:287] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.899s	user 0.008s	sys 0.003s
I20260709 12:27:14.153842  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 339) took 1029 ms. Trace:
I20260709 12:27:14.156750  8392 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:14.158406 11340 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.158629 11067 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:14.164244 11347 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.166335 11383 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.164280 11361 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.169144  8469 rpcz_store.cc:276] 0709 12:27:11.960339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.121289 (+2160950us) service_pool.cc:224] Handling call
0709 12:27:14.127039 (+  5750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.151707 (+ 24668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.151881 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.168789  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 336) took 2203 ms. Trace:
I20260709 12:27:14.101045 11458 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.170809  8465 rpcz_store.cc:276] 0709 12:27:13.124047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.153089 (+1029042us) service_pool.cc:224] Handling call
0709 12:27:14.153374 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.153541 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.153566 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.153607 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:14.153637 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.153685 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.153779 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.128957 11277 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:27:14.186162  8465 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:14.183257  8467 rpcz_store.cc:276] 0709 12:27:11.965418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.121345 (+2155927us) service_pool.cc:224] Handling call
0709 12:27:14.121619 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.121814 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:14.128365 (+  6551us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.168483 (+ 40118us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.168530 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:14.168578 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.168636 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.168737 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5868,"prepare.queue_time_us":6089,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":84,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6533,"thread_start_us":39747,"threads_started":1}
I20260709 12:27:14.188892  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1761) took 1032 ms. Trace:
I20260709 12:27:14.189145  8465 rpcz_store.cc:276] 0709 12:27:13.156246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.185726 (+1029480us) service_pool.cc:224] Handling call
0709 12:27:14.186012 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.188689 (+  2677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.188847 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.155584 11407 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.178718 11332 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.189975 11082 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.192368  8469 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:14.194339  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.177304 11423 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.170894 11443 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.181836 11387 raft_consensus.cc:697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:14.198009 11387 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.198647 11445 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.200778 11445 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.201572 11337 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.204293 11443 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.139652 11459 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.196964  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1760) took 1049 ms. Trace:
I20260709 12:27:14.195338  8465 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:14.213169  8469 rpcz_store.cc:276] 0709 12:27:13.147835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.183321 (+1035486us) service_pool.cc:224] Handling call
0709 12:27:14.192249 (+  8928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.194617 (+  2368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.196886 (+  2269us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.204231  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.204545  9041 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:14.212391 11451 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.227738  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.228403  8537 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:14.236371  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:14.237046  8388 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:14.237697  8537 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:14.238590  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.243459  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.245015  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.245854  8537 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:14.246254  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 285) took 1016 ms. Trace:
I20260709 12:27:14.246644  8537 rpcz_store.cc:276] 0709 12:27:13.229512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.244708 (+1015196us) service_pool.cc:224] Handling call
0709 12:27:14.246206 (+  1498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.247939  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1762) took 1084 ms. Trace:
I20260709 12:27:14.248421  8467 rpcz_store.cc:276] 0709 12:27:13.163873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.191744 (+1027871us) service_pool.cc:224] Handling call
0709 12:27:14.215172 (+ 23428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.215365 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:14.235797 (+ 20432us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.247620 (+ 11823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.247670 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:14.247712 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.247774 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.247882 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20021,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":11486,"threads_started":1,"wal-append.queue_time_us":8550}
I20260709 12:27:14.253039  8388 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:14.254333  9016 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.257325  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.259912  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.264122 11407 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:14.265439  8463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1753) took 2383 ms (client timeout 2707 ms). Trace:
W20260709 12:27:14.265823  8463 rpcz_store.cc:269] 0709 12:27:11.881592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.881723 (+   131us) service_pool.cc:224] Handling call
0709 12:27:14.265213 (+2383490us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b54003967d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.265354 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627852672}
I20260709 12:27:14.269497  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.270102  8542 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:14.270987  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.271564 11282 raft_consensus.cc:1027] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: attempt to promote peer e3660d999c0a41658a1f1dbe7cc90746: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:27:14.271513  8542 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 3.
I20260709 12:27:14.272972  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 287) took 1040 ms. Trace:
I20260709 12:27:14.273376  8542 rpcz_store.cc:276] 0709 12:27:13.232336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.270737 (+1038401us) service_pool.cc:224] Handling call
0709 12:27:14.272925 (+  2188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.274266  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.275333  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.275875  8542 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:14.311741  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.312642  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 283) took 1083 ms. Trace:
I20260709 12:27:14.312947  8537 rpcz_store.cc:276] 0709 12:27:13.228978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.261571 (+1032593us) service_pool.cc:224] Handling call
0709 12:27:14.312583 (+ 51012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.313810  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.314821  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.261121 11319 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:14.330581  8542 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:14.331518  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.332852  8542 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:27:14.334044 11459 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:14.334514 11319 raft_consensus.cc:697] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:14.335496 11458 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.336845  8388 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:14.357885  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.399982  8537 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:14.401526 11384 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:14.401978 11384 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:14.402773  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.403365  8537 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:14.403825  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1871) took 1066 ms. Trace:
I20260709 12:27:14.404112  8537 rpcz_store.cc:276] 0709 12:27:13.336920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.402504 (+1065584us) service_pool.cc:224] Handling call
0709 12:27:14.403773 (+  1269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:14.409582  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 93155.8us
W20260709 12:27:14.416760  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 98018.4us
I20260709 12:27:14.420061  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.420643  8542 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:14.358973 11451 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:14.422505  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.423218  8537 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:14.395825 11332 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.425925  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.426568  8537 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:14.422343 11474 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.426173 11319 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.427353 11474 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.429350 11474 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:14.418015 11277 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:27:14.450199  8542 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:14.451367  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.454007  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.454438  8542 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:14.452200 11067 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.456955 11067 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:14.458844  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 274) took 1850 ms (client timeout 1919 ms). Trace:
W20260709 12:27:14.459442  8468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59088 (request call id 332) took 3569 ms (client timeout 1898 ms). Trace:
I20260709 12:27:14.460350  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:14.459825  8468 rpcz_store.cc:269] 0709 12:27:10.889702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.897246 (+  7544us) service_pool.cc:224] Handling call
0709 12:27:14.459256 (+3562010us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54003cc3d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.459345 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114153344}
I20260709 12:27:14.402789 11384 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.463645  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.482890  8537 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
W20260709 12:27:14.459273  9045 rpcz_store.cc:269] 0709 12:27:12.608218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.608337 (+   119us) service_pool.cc:224] Handling call
0709 12:27:14.458662 (+1850325us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54004132d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.458771 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553187072}
I20260709 12:27:14.483453  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.433912 11451 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.493976  8392 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:27:14.492290  8472 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 1951) took 4763 ms (client timeout 1567 ms). Trace:
I20260709 12:27:14.492475  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:14.495067  8472 rpcz_store.cc:269] 0709 12:27:09.728620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.728768 (+   148us) service_pool.cc:224] Handling call
0709 12:27:14.492108 (+4763340us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54000d93d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.492201 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4102610688}
I20260709 12:27:14.495815  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1874) took 1157 ms. Trace:
I20260709 12:27:14.496155  8537 rpcz_store.cc:276] 0709 12:27:13.338766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.483555 (+1144789us) service_pool.cc:224] Handling call
0709 12:27:14.495761 (+ 12206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.496541 11384 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:14.496932 11472 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.480s	user 0.002s	sys 0.000s
I20260709 12:27:14.485101 11423 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:14.493759 11485 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:27:14.497129  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.500015  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 342) took 1272 ms. Trace:
W20260709 12:27:14.500711  8393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50338 (request call id 401) took 3035 ms (client timeout 2409 ms). Trace:
I20260709 12:27:14.500928 11337 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:14.501585  8471 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 1959) took 3286 ms (client timeout 3649 ms). Trace:
I20260709 12:27:14.501895  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 274) took 1374 ms. Trace:
I20260709 12:27:14.512895  8542 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 4.
I20260709 12:27:14.527819  8539 rpcz_store.cc:276] 0709 12:27:13.127307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.127454 (+   147us) service_pool.cc:224] Handling call
0709 12:27:14.501718 (+1374264us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b54001f3e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.501833 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198078208}
I20260709 12:27:14.502221  8466 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:27:14.529158  8471 rpcz_store.cc:269] 0709 12:27:11.215308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.215476 (+   168us) service_pool.cc:224] Handling call
0709 12:27:14.501428 (+3285952us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400025dd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.501532 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434214784}
I20260709 12:27:14.455426 11274 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.504771  8537 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:14.531968  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.532629  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.542404  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1866) took 1206 ms. Trace:
I20260709 12:27:14.542403  8542 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:14.543087  8539 rpcz_store.cc:276] 0709 12:27:13.335780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.530462 (+1194682us) service_pool.cc:224] Handling call
0709 12:27:14.542349 (+ 11887us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.465257 11067 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.531358  8465 rpcz_store.cc:276] 0709 12:27:13.227260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.213660 (+986400us) service_pool.cc:224] Handling call
0709 12:27:14.267000 (+ 53340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.267192 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:14.267485 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.395695 (+128210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.395743 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:14.395785 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.395850 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.499849 (+103999us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b54003967d0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.499959 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1345,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":88,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":85,"spinlock_wait_cycles":122050944,"thread_start_us":114946,"threads_started":1,"wal-append.queue_time_us":152044}
W20260709 12:27:14.532608  8393 rpcz_store.cc:269] 0709 12:27:11.465317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.478056 (+ 12739us) service_pool.cc:224] Handling call
0709 12:27:14.500530 (+3022474us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b5400166a54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.500648 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3813427968}
I20260709 12:27:14.554927  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.555768  8539 raft_consensus.cc:2410] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:27:14.556847  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1878) took 1090 ms. Trace:
I20260709 12:27:14.557178  8539 rpcz_store.cc:276] 0709 12:27:13.466449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.543855 (+1077406us) service_pool.cc:224] Handling call
0709 12:27:14.556793 (+ 12938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.453719 11387 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.558817 11451 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.560458  8388 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:14.561168  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.547080 11419 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.533159 11274 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.564543  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.572283  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 277) took 1245 ms. Trace:
I20260709 12:27:14.572711  9041 rpcz_store.cc:276] 0709 12:27:13.326732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.328830 (+  2098us) service_pool.cc:224] Handling call
0709 12:27:13.339584 (+ 10754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.215784 (+876200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.572064 (+356280us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b5400613ad4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:14.572227 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988730240}
W20260709 12:27:14.573869  8397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1575) took 4179 ms (client timeout 2492 ms). Trace:
I20260709 12:27:14.573993  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:14.574303  8397 rpcz_store.cc:269] 0709 12:27:10.394576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.736521 (+341945us) service_pool.cc:224] Handling call
0709 12:27:14.573693 (+3837172us) spinlock_profiling.cc:243] Waited 2.33 s on lock 0x7b5400344254. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.573805 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5360064768}
I20260709 12:27:14.575665  8467 raft_consensus.cc:1275] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:14.576701  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:14.612095  8471 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:14.573817  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:14.621603  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 272) took 3719 ms (client timeout 2102 ms). Trace:
I20260709 12:27:14.597801  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:14.623588  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 268) took 1498 ms (client timeout 1514 ms). Trace:
I20260709 12:27:14.628834  8463 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:27:14.629014  8543 rpcz_store.cc:269] 0709 12:27:13.125451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.125582 (+   131us) service_pool.cc:224] Handling call
0709 12:27:14.623394 (+1497812us) spinlock_profiling.cc:243] Waited 31.2 ms on lock 0x7b54004489d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.623522 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71646464}
W20260709 12:27:14.622105  9050 rpcz_store.cc:269] 0709 12:27:10.902438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.902576 (+   138us) service_pool.cc:224] Handling call
0709 12:27:14.621346 (+3718770us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b540063fbd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.621518 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580655360}
I20260709 12:27:14.629493  8472 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:14.597239  8464 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:14.577402  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:14.631013  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.631788  8543 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:14.631103  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 281) took 1402 ms. Trace:
I20260709 12:27:14.633010  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1570) took 4237 ms. Trace:
I20260709 12:27:14.589481  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.634243  8389 rpcz_store.cc:276] 0709 12:27:10.393389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.393493 (+   104us) service_pool.cc:224] Handling call
0709 12:27:10.393771 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:11.166731 (+772960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.630298 (+3463567us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54003dd6d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:14.630471 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638941952}
I20260709 12:27:14.628162 11274 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.634215  8537 rpcz_store.cc:276] 0709 12:27:13.228468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.552748 (+1324280us) service_pool.cc:224] Handling call
0709 12:27:14.553049 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.553604 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.553633 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.554052 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.630797 (+ 76745us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:14.630834 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.630894 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.630933 (+    39us) raft_consensus.cc:1685] finished
0709 12:27:14.630944 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.631052 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1221,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":1764,"thread_start_us":65540,"threads_started":1,"wal-append.queue_time_us":62014}
I20260709 12:27:14.635356  8465 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:14.562105 11387 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.638832  8537 raft_consensus.cc:1275] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:14.646250  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1861) took 1314 ms. Trace:
I20260709 12:27:14.649044  8472 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:14.646581  8537 rpcz_store.cc:276] 0709 12:27:13.326294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.638298 (+1312004us) service_pool.cc:224] Handling call
0709 12:27:14.638543 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.640470 (+  1927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.640659 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.656061  8469 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:14.656241  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.657269  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.660718  8436 leader_election.cc:400] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7.
I20260709 12:27:14.661049  8436 leader_election.cc:403] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:14.661818  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.662492  8537 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:14.663602  8537 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:14.664158  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1863) took 1333 ms. Trace:
I20260709 12:27:14.664471  8537 rpcz_store.cc:276] 0709 12:27:13.330830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.663090 (+1332260us) service_pool.cc:224] Handling call
0709 12:27:14.663385 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.663926 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.664105 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.665802  8537 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:14.666329  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1864) took 1335 ms. Trace:
I20260709 12:27:14.666633  8537 rpcz_store.cc:276] 0709 12:27:13.331142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.665190 (+1334048us) service_pool.cc:224] Handling call
0709 12:27:14.665466 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.666097 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.666279 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.668066  8537 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:14.668116  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47416 (request call id 317) took 1267 ms. Trace:
I20260709 12:27:14.668751  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1865) took 1337 ms. Trace:
I20260709 12:27:14.670542  8537 rpcz_store.cc:276] 0709 12:27:13.331395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.667309 (+1335914us) service_pool.cc:224] Handling call
0709 12:27:14.667803 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.668486 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.668706 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:14.669565  9043 rpcz_store.cc:276] 0709 12:27:13.400816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.400982 (+   166us) service_pool.cc:224] Handling call
0709 12:27:14.667972 (+1266990us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b54004e0cd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.668064 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307158784}
I20260709 12:27:14.650388 11274 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.682085 10744 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7.
W20260709 12:27:14.682956  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.659036 11340 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:14.684093 11375 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 3.776s	user 0.042s	sys 0.026s
I20260709 12:27:14.685140 10896 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.687323 11122 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.688239  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 269) took 1562 ms. Trace:
I20260709 12:27:14.688822  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.696844  8545 rpcz_store.cc:276] 0709 12:27:13.125769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.126213 (+   444us) service_pool.cc:224] Handling call
0709 12:27:14.688084 (+1561871us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b540006aed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.688181 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1884453248}
I20260709 12:27:14.697898  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.698655  8545 raft_consensus.cc:2410] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:27:14.668917 11410 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.671898 11361 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:14.705317 11396 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 3.232s	user 0.011s	sys 0.023s
I20260709 12:27:14.706724  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 270) took 1580 ms. Trace:
I20260709 12:27:14.673388 11364 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:14.709144  8396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1580) took 3561 ms (client timeout 1846 ms). Trace:
W20260709 12:27:14.710220  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.711189  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.711581  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.711889  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:14.710457  8396 rpcz_store.cc:269] 0709 12:27:11.147501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.148911 (+  1410us) service_pool.cc:224] Handling call
0709 12:27:14.708955 (+3560044us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001c9654. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:14.709060 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479806336}
I20260709 12:27:14.710125  8546 rpcz_store.cc:276] 0709 12:27:13.126035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.126152 (+   117us) service_pool.cc:224] Handling call
0709 12:27:13.156821 (+ 30669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.272958 (+116137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.272990 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:13.273032 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:13.273069 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.706499 (+1433430us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400447fd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:14.706542 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.706666 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266587520}
I20260709 12:27:14.717517  9015 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:14.731949  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.732658  8470 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:14.737352  8541 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:14.737742  8541 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:14.690156 11332 consensus_queue.cc:1059] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:27:14.709314 11361 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.697325 11340 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.694407 11274 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.709669 11410 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.749486  8396 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:14.869338  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.869696  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.870632  9046 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:14.870918  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:14.819815  9014 leader_election.cc:336] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.594s (SENT)
I20260709 12:27:14.871817  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:14.872089  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.872646 11277 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:14.872648  9045 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:14.875161 11361 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:14.716871 11364 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.818121 11451 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:14.766741  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.782253  8541 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:14.864094  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.877336 11299 raft_consensus.cc:3055] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:14.878157  8510 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.880429  8546 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:14.888223  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.885458  8541 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:14.732852 11419 raft_consensus.cc:2764] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:14.889796  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:14.873613  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 53856.9us
I20260709 12:27:14.890108  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.891180  8472 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:14.892204 11451 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.888430  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:14.840348 11496 log.cc:927] Time spent T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:27:14.861979 11497 log.cc:927] Time spent T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:27:14.898375 10896 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:14.898818 10896 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.899163 10896 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:14.887102 11346 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:14.907899  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.907708 11346 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.908475  8546 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:14.909350  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.909868  8546 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:14.910070 11346 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:14.887454 11371 consensus_queue.cc:1175] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" responder_term: 10 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [8.6-9.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:14.910943  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.911881 11459 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.802461 11378 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.896394  8470 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:14.912896 11459 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.896495  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.915062  9043 raft_consensus.cc:2393] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:14.898299  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:14.887029  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.885736 11299 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:14.838723 11465 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 1.167s	user 0.006s	sys 0.014s
I20260709 12:27:14.900568  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 282) took 1671 ms. Trace:
I20260709 12:27:14.919912  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.899878 11383 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.878383 11340 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.896665 11395 consensus_queue.cc:1059] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:27:14.902740 11451 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.903052 11460 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:14.933525  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:14.933710 11346 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.903548 11246 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:14.933431  8470 raft_consensus.cc:1240] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:27:14.907629 10896 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.933995  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.904907 10914 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:14.935338 11246 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:14.935806 11246 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:14.936028  8396 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:14.869088 11274 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.935158  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.886987 11122 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:14.937709 11122 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.938056  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.938800  8470 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:14.939347  8469 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:14.940297 10896 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.937041  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.942436  8467 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:14.912333 11387 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.941385  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.941424 11299 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:14.929894  9050 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:14.944854 11299 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:14.930130  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 50102.7us
I20260709 12:27:14.930073  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.930564  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.946316  8463 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:27:14.946435  8465 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:14.947368  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.947971  8465 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:14.932010  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.919778  8542 rpcz_store.cc:276] 0709 12:27:13.228719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.562002 (+1333283us) service_pool.cc:224] Handling call
0709 12:27:14.564551 (+  2549us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.564877 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.564904 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.583534 (+ 18630us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.635959 (+ 52425us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:14.840891 (+204932us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.841332 (+   441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.841407 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.900375 (+ 58968us) raft_consensus.cc:1685] finished
0709 12:27:14.900393 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.900515 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":175,"spinlock_wait_cycles":19840,"thread_start_us":208987,"threads_started":2,"wal-append.queue_time_us":75034}
I20260709 12:27:14.939654  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:14.934217  8471 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:14.915588  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.940758  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 409) took 1640 ms. Trace:
I20260709 12:27:14.951383  8395 rpcz_store.cc:276] 0709 12:27:13.300605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.300731 (+   126us) service_pool.cc:224] Handling call
0709 12:27:13.300980 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:13.301137 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:13.301151 (+    14us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.305600 (+  4449us) log.cc:844] Serialized 26 byte log entry
0709 12:27:13.476714 (+171114us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:13.476748 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.476812 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:14.803012 (+1326200us) spinlock_profiling.cc:243] Waited 95.7 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:14.940502 (+137490us) raft_consensus.cc:1685] finished
0709 12:27:14.940523 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.940706 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220215168,"thread_start_us":152913,"threads_started":1,"wal-append.queue_time_us":319187}
I20260709 12:27:14.952970  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.943231  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.953743  8467 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:14.880820 11364 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:14.936991 11346 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:14.950294  8470 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:14.933961 11460 consensus_queue.cc:1059] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 12:27:14.894291  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 233685us
W20260709 12:27:14.960575  8436 connection.cc:256] RPC call timeout handler was delayed by -1.5730880480000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:27:14.965257  8436 connection.cc:256] RPC call timeout handler was delayed by -1.5190880479999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:27:14.965689  8436 connection.cc:256] RPC call timeout handler was delayed by -1.4902880479999112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
I20260709 12:27:14.971241  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.971585  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.971276  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.972877  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.973016  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.973496  8395 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:14.973775  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.974241  8544 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:27:14.975159  8465 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:14.973619  8397 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:14.976227  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.976846  8397 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:14.977680  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.976164  8390 raft_consensus.cc:1275] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:14.978685  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.877856 11410 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:14.972342  9015 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.980967  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.981590  9015 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.980604  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.982640  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:14.983523  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.996098  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:14.993615  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:14.997747  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:14.998356  8542 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:14.939742 11122 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:14.985253  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:14.985798  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.004980  8544 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:15.002218  8393 raft_consensus.cc:1240] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:15.001735  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.006132  8390 raft_consensus.cc:2393] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:15.001502  8541 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:27:15.006593  8541 pending_rounds.cc:85] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 6
I20260709 12:27:15.006898  8541 pending_rounds.cc:107] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:27:15.007534  8541 raft_consensus.cc:2889] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:15.004518  8395 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:15.008248  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:15.008862  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.004452  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:15.010357  8395 raft_consensus.cc:2393] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:15.005874  8362 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.011325  8362 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.013322  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.013607  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.014062  8397 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:15.014441  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.015334  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:15.016992  8544 raft_consensus.cc:2368] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:15.017736  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.018435  8544 raft_consensus.cc:2393] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:15.015836  8467 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:15.015671  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:14.983371 11460 consensus_queue.cc:1243] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 12:27:15.019313  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 163316us
I20260709 12:27:15.021066  8469 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:14.934079 11383 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.032629  8390 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:27:15.035116  8362 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.033478  8470 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:15.037092  8362 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:15.041096  8541 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:14.997329 11469 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:15.042452  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.043018  8541 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:15.044471  8390 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:15.043026  8362 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:15.052989  8542 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:15.005256 11262 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:14.971254 10914 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:27:15.055505  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.008193 11445 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:15.057358  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 137006us
I20260709 12:27:14.983599 11419 consensus_queue.cc:1048] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:27:15.019961 11451 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:15.089689  8390 raft_consensus.cc:1240] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:27:15.069957  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.011960 11459 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:14.976454 11319 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:27:15.044840 11384 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:15.061928  8544 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:15.066075  8541 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 3.
I20260709 12:27:14.980690 11474 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:27:15.073024  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:15.131577  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 134175us
I20260709 12:27:15.059922  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.097901  8395 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:15.104305  8390 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:27:15.061663  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 95492.8us
W20260709 12:27:15.138461  8436 connection.cc:256] RPC call timeout handler was delayed by -1.4533880479998516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
W20260709 12:27:15.138823  8436 connection.cc:256] RPC call timeout handler was delayed by -1.4281880479998108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:27:15.139091  8436 connection.cc:256] RPC call timeout handler was delayed by -1.3444880480001302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:27:15.139622  8436 connection.cc:256] RPC call timeout handler was delayed by -1.18968804799988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
I20260709 12:27:15.023476 11410 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:15.044075 11067 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:15.043910 11423 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:15.045915 11122 consensus_queue.cc:1059] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 12:27:15.045475 11469 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.044373  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:15.139911  8436 connection.cc:256] RPC call timeout handler was delayed by -1.1338880479997897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22740000000000002s for a response
I20260709 12:27:15.116532 11513 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:15.093340  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 50379.5us
I20260709 12:27:15.150022  8362 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.144878  8390 raft_consensus.cc:1240] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:15.132627 11384 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.146297  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.152597  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.154565  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.138054 11387 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:15.070272 11395 consensus_queue.cc:1243] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:15.156363 10744 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:15.137521 11451 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.147395 11423 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.159940 10744 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.168946  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.148577 11469 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:15.175521 10744 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.158058 11384 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.144702 11410 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.157994 11387 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:15.160557 11499 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:15.164464 11451 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:15.171252 11423 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.199679  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.198062 11387 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.205576 11361 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:15.209353 11361 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:15.207155 11383 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:15.210273 11383 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.210726 11383 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.212786 11383 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:15.213253 11383 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:15.213423 11500 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:27:15.196712 11122 raft_consensus.cc:3055] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:15.215941 11122 raft_consensus.cc:740] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:15.216774 11122 consensus_queue.cc:260] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.217590 11346 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.217967 11122 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:15.218170 11346 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:15.218616 11346 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.218971 11346 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:15.219681 11383 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.221670 11410 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.221760 11383 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:15.224076  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.224453  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 284) took 1995 ms. Trace:
I20260709 12:27:15.224702  8546 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:15.224992  8539 rpcz_store.cc:276] 0709 12:27:13.229252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.626437 (+1397185us) service_pool.cc:224] Handling call
0709 12:27:14.635312 (+  8875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.636277 (+   965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.636307 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.645198 (+  8891us) log.cc:844] Serialized 26 byte log entry
0709 12:27:14.881179 (+235981us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:15.044300 (+163121us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.168893 (+124593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.168968 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.224264 (+ 55296us) raft_consensus.cc:1685] finished
0709 12:27:15.224281 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.224401 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1995,"prepare.queue_time_us":253826,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":121189,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":16605,"thread_start_us":444827,"threads_started":3,"wal-append.queue_time_us":304925}
W20260709 12:27:15.253577  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 97079.1us
W20260709 12:27:15.255559  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 105593us
I20260709 12:27:15.256379  8362 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.257261  8362 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.243172 11364 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:15.224601 11499 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.446986  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50338 (request call id 426) took 1002 ms. Trace:
I20260709 12:27:15.446430  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47416 (request call id 319) took 1950 ms. Trace:
W20260709 12:27:15.448465  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 175963us
I20260709 12:27:15.447376  8388 rpcz_store.cc:276] 0709 12:27:14.444683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.444842 (+   159us) service_pool.cc:224] Handling call
0709 12:27:15.446800 (+1001958us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b54003de5d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:15.446934 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228322560}
I20260709 12:27:15.449378  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:15.259881  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.450043  8463 raft_consensus.cc:2376] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7. Re-sending same reply.
I20260709 12:27:15.450213  8546 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:15.450793 10970 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:15.451218  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.452113  8546 raft_consensus.cc:2410] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:27:15.413216 11262 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:15.259357 11246 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:15.454039 11262 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:15.455168  8542 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:15.281129  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 276) took 2625 ms (client timeout 1568 ms). Trace:
W20260709 12:27:15.456135  9042 rpcz_store.cc:269] 0709 12:27:12.655634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.670087 (+ 14453us) service_pool.cc:224] Handling call
0709 12:27:15.280921 (+2610834us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b540041f854. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:15.281029 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351445248}
W20260709 12:27:15.447731  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 190524us
I20260709 12:27:15.458192  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:15.313552  8538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58406 (request call id 275) took 2185 ms (client timeout 1788 ms). Trace:
I20260709 12:27:15.458770  8388 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
W20260709 12:27:15.459044  8538 rpcz_store.cc:269] 0709 12:27:13.127710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.127814 (+   104us) service_pool.cc:224] Handling call
0709 12:27:15.313321 (+2185507us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54003fb1d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:15.313450 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":229934336}
I20260709 12:27:15.274473  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.460251  8544 raft_consensus.cc:2410] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:27:15.461300  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.449788  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:15.462411  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.462985  8391 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:15.329493 11384 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:15.428223  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.464128  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:15.456089 11246 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:15.464805  8392 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:15.323807 11425 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:15.465837  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.467368 11499 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.467952  8391 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:15.323199 11387 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:15.468310 11423 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.467015  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:15.395701  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:15.470436  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.448415  9049 rpcz_store.cc:276] 0709 12:27:13.495622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.495747 (+   125us) service_pool.cc:224] Handling call
0709 12:27:15.446208 (+1950461us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540001c054. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:15.446372 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304911232}
W20260709 12:27:15.440775  9048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47412 (request call id 471) took 2098 ms (client timeout 1656 ms). Trace:
I20260709 12:27:15.275372  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:15.471223  9048 rpcz_store.cc:269] 0709 12:27:13.341901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.342019 (+   118us) service_pool.cc:224] Handling call
0709 12:27:15.440539 (+2098520us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400943254. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:15.440702 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333012224}
I20260709 12:27:15.470160 11387 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:15.469579  8438 connection.cc:256] RPC call timeout handler was delayed by -2.8258689350000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2492s for a response
I20260709 12:27:15.323307 10896 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:15.464870 11384 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.472175  8541 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:15.306895 11404 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:15.568593  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 55475.7us
I20260709 12:27:15.569685  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:15.570286  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 50657.1us
W20260709 12:27:15.570067  8438 connection.cc:256] RPC call timeout handler was delayed by -2.7499250860000757s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 12:27:15.322798 11466 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:15.522215  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.571936  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:15.577574  8389 raft_consensus.cc:2368] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:15.267140  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:15.261116  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 201507us
W20260709 12:27:15.571400  8438 connection.cc:256] RPC call timeout handler was delayed by -2.4756118919999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
I20260709 12:27:15.481191  9050 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.576014  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:15.315109  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 276) took 2186 ms. Trace:
W20260709 12:27:15.578964  8438 connection.cc:256] RPC call timeout handler was delayed by -2.4081118919998517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
I20260709 12:27:15.502419  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.577726  8397 raft_consensus.cc:2393] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:15.582043  8394 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:15.318805  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:15.582381  8438 connection.cc:256] RPC call timeout handler was delayed by -2.0814881549999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:27:15.582692  8438 connection.cc:256] RPC call timeout handler was delayed by -1.9983061640000415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
W20260709 12:27:15.582971  8438 connection.cc:256] RPC call timeout handler was delayed by -1.9950151269999878s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15610000000000002s for a response
I20260709 12:27:15.583124  9016 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:15.495213  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 363974us
I20260709 12:27:15.472151  8392 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
W20260709 12:27:15.583261  8438 connection.cc:256] RPC call timeout handler was delayed by -1.9650061639999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:27:15.585601  8438 connection.cc:256] RPC call timeout handler was delayed by -1.9621036870003081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:27:15.586934  8438 connection.cc:256] RPC call timeout handler was delayed by -1.8606061640002736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:27:15.587347  8438 connection.cc:256] RPC call timeout handler was delayed by -1.7778061640001397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:27:15.587692  8438 connection.cc:256] RPC call timeout handler was delayed by -1.6614788510000835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 12:27:15.588014  8438 connection.cc:256] RPC call timeout handler was delayed by -1.4214061640000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22740000000000002s for a response
W20260709 12:27:15.588414  8438 connection.cc:256] RPC call timeout handler was delayed by -1.3859097179997661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.261s for a response
W20260709 12:27:15.588726  8438 connection.cc:256] RPC call timeout handler was delayed by -1.2018626630001563s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2379s for a response
W20260709 12:27:15.392691 11501 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:27:15.593657  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.594528  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.581533  8540 rpcz_store.cc:276] 0709 12:27:13.128667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.212250 (+ 83583us) service_pool.cc:224] Handling call
0709 12:27:15.313721 (+2101471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.314055 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.314082 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:15.314138 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:15.314168 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.314226 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.314922 (+   696us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b54003fb1d0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:15.315025 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2560,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"spinlock_wait_cycles":4832172416}
I20260709 12:27:15.272960 11504 raft_consensus.cc:3055] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:15.600703  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1879) took 2126 ms. Trace:
I20260709 12:27:15.439831 11435 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.604094 10744 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:15.520468 11434 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:15.601531  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:15.602368  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:15.581835  8361 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.773s (SENT) [suppressed 20 similar messages]
I20260709 12:27:15.283314 11241 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:15.519644 11122 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:15.467928 11499 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:15.367470 11445 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:15.559659 11386 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:15.570327 10896 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:15.470182 11423 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.577342 11466 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:15.646222  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 46252.8us
I20260709 12:27:15.585585 11343 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:27:15.655010  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 44311.5us
I20260709 12:27:15.444418 11346 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.650075  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.333483 11451 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.601420 11511 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:15.602420 11504 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:15.655763  8510 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:15.658146  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.609185 11434 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.609539 11122 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.608486 11241 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:15.666224  8543 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:15.646674 11499 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.679143  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:15.705821  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.679962  8392 raft_consensus.cc:2393] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:15.706421  8542 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:15.680135 10896 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.659854 11466 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:15.599021 11404 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:27:15.682808 11416 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:15.684145  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1876) took 2335 ms. Trace:
W20260709 12:27:15.699074 11469 consensus_meta.cc:287] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.005s
I20260709 12:27:15.684953  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.728848  8537 rpcz_store.cc:276] 0709 12:27:13.348831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.672383 (+1323552us) service_pool.cc:224] Handling call
0709 12:27:14.672740 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:14.684654 (+ 11914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.684683 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:14.685125 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.041864 (+356739us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:15.132641 (+ 90777us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.435994 (+303353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.436080 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.683912 (+247832us) raft_consensus.cc:1685] finished
0709 12:27:15.683934 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.684084 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":101085,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":78372,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":157,"thread_start_us":659426,"threads_started":2,"wal-append.queue_time_us":500602}
I20260709 12:27:15.689033  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1752) took 3830 ms. Trace:
W20260709 12:27:15.715801 11465 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:15.693121  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:15.693540  8395 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:15.706445  8470 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:15.748332  8393 raft_consensus.cc:2410] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:15.698088  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:15.705026  8510 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:15.681500  9050 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:15.721395  8391 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:15.721894  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.749464  8389 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:15.685019 11364 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:15.730195  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:15.753777  8472 raft_consensus.cc:2410] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:27:15.687739 11352 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:15.731451  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:15.652230 11378 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:27:15.647457 11525 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 12:27:15.692425 11445 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:15.705495 11434 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:15.705367 11122 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:15.723938 11387 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:27:15.700975 11430 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.699138 11345 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.750715  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.751135  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:15.784719  8469 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:15.710565 11499 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:15.751987  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 47035.6us
I20260709 12:27:15.786913  8510 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:15.788044  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.730753  8466 rpcz_store.cc:276] 0709 12:27:11.858777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.858940 (+   163us) service_pool.cc:224] Handling call
0709 12:27:14.501927 (+2642987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.528879 (+ 26952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.688854 (+1159975us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b5400025dd0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:15.688975 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6028012416}
I20260709 12:27:15.754623  8471 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:15.710420 10970 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:15.758790  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.762775  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.790510  8540 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:15.763113  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.720654 11343 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:15.767690 11241 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.756848 10896 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:15.771224  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:15.771879  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.794445  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.794492  8464 raft_consensus.cc:2376] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8. Re-sending same reply.
I20260709 12:27:15.756026 11416 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:15.757908  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:15.775691 11504 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.762733  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:15.772526  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.805900  8389 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:15.796659  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.798671  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:15.806775  8466 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:15.792599 10970 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.801689  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:15.807094  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.807548  8471 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:15.808461  8396 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:15.809237  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:15.814658  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.815335  8393 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:27:15.797163 11525 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:15.746927 11469 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:15.820479  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.824553  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:15.825024  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.806483 11241 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:15.828514  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.830101  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:15.836141  8464 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.792369 11345 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.838451  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.855844  8537 raft_consensus.cc:2376] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8. Re-sending same reply.
I20260709 12:27:15.835549  8396 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:15.857033  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.858094  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.858642  8396 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:15.810551 10970 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:15.851747  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.859894  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:15.792534 11430 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.861754  8471 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:15.859344  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.829101 11504 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:15.837383 11525 raft_consensus.cc:697] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:15.868682  8397 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:15.871153  8362 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:15.862529 11361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.014s	sys 0.009s
I20260709 12:27:15.854700 11404 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.880609  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.881714  8537 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:27:15.894052  8537 pending_rounds.cc:85] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 3
I20260709 12:27:15.894302  8537 pending_rounds.cc:107] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:27:15.872437  9042 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:15.885637  8464 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:15.889945  8397 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:15.891023  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.891134  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:15.915848  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 220672us
W20260709 12:27:15.916527  9014 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.831s (SENT)
I20260709 12:27:15.916590  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.917294  8542 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:15.860769 11416 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.837407 11364 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:27:15.913442  8537 raft_consensus.cc:2889] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:15.883759 11469 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.918828  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:15.891067 11521 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:15.916023  8395 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
W20260709 12:27:15.905175 11544 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:27:15.891144 11361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.014s	sys 0.009s
I20260709 12:27:15.923456  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:15.924587  8438 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.927855  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.928438  8542 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:15.920218  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.860788 11343 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.930104  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:15.931438  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:15.933102  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:15.934202  8438 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:15.935038  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.914137 11346 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.893311 11404 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.904407 11435 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:27:15.903964 11423 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:27:15.945580  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:15.946768  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.947888  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.949483  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.925635 11521 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.947422  8389 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:15.953903 11361 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:15.954949 10744 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:15.955369 10744 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:15.955804 10744 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:15.904162 11473 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:27:15.957598  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:15.933434 11334 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:15.962285  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:15.971992  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.976028  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:15.931039 11416 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:15.978259  9014 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.139s (SENT)
I20260709 12:27:15.980298  8466 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:15.981437  8471 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:27:15.981832  8389 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:15.952963 11340 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:15.952216 11521 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:15.986274  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:15.955098 11299 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:15.960183 11384 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.001576  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.002336  8466 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:27:15.984341 11547 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:27:15.963040 11334 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:15.967684 11346 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.968123 11361 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:16.002736  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.004221  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:16.007915 11542 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:27:15.992596 11299 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:16.011881  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.081147  8471 raft_consensus.cc:2393] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.017520 10970 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:16.018260 11416 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:16.022007 11122 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.023806 11384 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.025687 11434 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:15.943060 11525 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:16.035776  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.031627 11364 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 12:27:16.040313 11538 log.cc:927] Time spent T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 12:27:16.040982 11540 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:27:16.043565 11537 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 12:27:16.044303 11545 log.cc:927] Time spent T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:27:16.044832 11543 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:27:16.044708  8539 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
W20260709 12:27:16.045532 11546 log.cc:927] Time spent T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:27:16.045965 11536 log.cc:927] Time spent T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:27:16.049832 11404 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.060636 11352 raft_consensus.cc:3055] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:16.070406 10744 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:16.079540  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 118101us
W20260709 12:27:16.087532 11548 log.cc:927] Time spent T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:27:16.061049 11334 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:16.155689  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.088301  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.139076  9014 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:16.150456  8539 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:16.063099 11361 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:16.154569  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.160760  8537 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:16.154954  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.161216  8542 raft_consensus.cc:2376] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9. Re-sending same reply.
I20260709 12:27:16.155334  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.162046  8540 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:16.156980  8466 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:16.151747  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.163766  8389 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:16.089593 11299 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:16.158351  8396 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.110831 11345 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.168040  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1813) took 1138 ms. Trace:
I20260709 12:27:16.171736 10744 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:16.172658  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:16.148176 11352 raft_consensus.cc:740] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:16.062986 11346 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:16.178511  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.174922  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.165747 11361 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.179212  8466 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:16.170593  8544 rpcz_store.cc:276] 0709 12:27:15.029381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.460869 (+431488us) service_pool.cc:224] Handling call
0709 12:27:15.461148 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.461645 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.461747 (+   102us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.462149 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.696861 (+234712us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:15.696902 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.696967 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.167838 (+470871us) raft_consensus.cc:1685] finished
0709 12:27:16.167866 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.167974 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3363,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":234356,"threads_started":1,"wal-append.queue_time_us":401810}
I20260709 12:27:16.177636  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1806) took 1150 ms. Trace:
I20260709 12:27:16.166079 11511 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:16.186837  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.184132  8538 rpcz_store.cc:276] 0709 12:27:15.027633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.459971 (+432338us) service_pool.cc:224] Handling call
0709 12:27:15.460241 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.460542 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.460569 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.460977 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.698863 (+237886us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:15.698898 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.698959 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.177442 (+478483us) raft_consensus.cc:1685] finished
0709 12:27:16.177466 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.177580 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"thread_start_us":234938,"threads_started":1,"wal-append.queue_time_us":390880}
I20260709 12:27:16.187505  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:16.186885  8540 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:16.192421  8389 raft_consensus.cc:2368] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:16.174750 10970 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:16.198052  8466 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:27:16.200104  8512 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.025s	sys 0.010s
W20260709 12:27:16.200649  8512 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.025s	sys 0.010s
W20260709 12:27:16.200909  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 554381us
I20260709 12:27:16.201915  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.200950  8438 leader_election.cc:400] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:16.203780  8438 leader_election.cc:403] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:27:16.206149  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.206525  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.217291  8466 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:16.207581  8512 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:16.222347  8512 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.223331  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.224857  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.197456  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:16.189445 11474 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:27:16.223800  8436 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:16.230875  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:16.281363  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 57641.2us
W20260709 12:27:16.281472  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50696.7us
I20260709 12:27:16.282927  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:15.955840  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:16.285054  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.240574 11346 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:16.243705 11541 log.cc:927] Time spent T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.371s	user 0.000s	sys 0.003s
I20260709 12:27:16.244297 11529 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:16.249692  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.294006  8395 raft_consensus.cc:2393] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.294912  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:16.251856  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.217425 11555 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:16.254915 11434 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.295697  8466 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
W20260709 12:27:16.297986  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 112534us
I20260709 12:27:16.298844  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.298995  9014 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:16.218061 11352 consensus_queue.cc:260] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.299886  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.300462  8466 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
W20260709 12:27:16.255883 11466 consensus_meta.cc:287] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
W20260709 12:27:16.302275 11554 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:27:16.302014 11466 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.256440  9046 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:16.260007 11384 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:16.273200  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.306066  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.274478  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.282764  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.232321 11524 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:16.289882 10744 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.291890 11406 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:16.281643  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.293968 11340 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:16.293581 11529 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:16.301066  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.320663  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.305486  8393 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:16.309217  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 113002us
I20260709 12:27:16.295022  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.299045 11122 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.323550  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:16.324088  8395 raft_consensus.cc:2376] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10. Re-sending same reply.
I20260709 12:27:16.324851  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:16.292474 10970 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:16.311105  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:16.312098 11524 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.312261 11504 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:16.312747 11416 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:16.313978 11451 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.314253  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:16.290434  8436 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:16.293120 11459 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:27:16.331074  8466 raft_consensus.cc:2393] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:16.332659  8468 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:16.333773  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.310632 11406 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:16.334616  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.336470  8468 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:16.337273  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.337877  8468 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:16.338663  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:16.326733 11551 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:27:16.340271  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.341056  8468 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:16.342211  8395 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
W20260709 12:27:16.329483 11499 consensus_meta.cc:287] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.005s
I20260709 12:27:16.314013 11361 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.327167 11340 raft_consensus.cc:697] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:16.345674  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.321907 11529 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:16.347277  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 46895.5us
I20260709 12:27:16.357234  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.343930  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.347249 11560 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:16.353091 11474 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:16.343652 11406 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:16.355242  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.367877  8394 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.357889  8395 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:16.347949  8466 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:16.358520  8468 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:16.359503  8540 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:27:16.362017  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.336040 11343 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.354204 11340 consensus_queue.cc:237] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.335776 11555 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.335803 11466 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.334429 11504 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.385476 11299 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.370855  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.333323 11524 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.410135 11299 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.410319  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:16.411252 11524 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:16.393026  8468 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:16.411474  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.412147  8395 raft_consensus.cc:2393] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.412905  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.413599  8395 raft_consensus.cc:2410] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:16.392226  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.414034 11451 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:16.365598 11334 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.418322  8470 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:27:16.429738  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 147057us
I20260709 12:27:16.412050  8466 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:16.346814 11499 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.433807 11499 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:15.602622  8545 rpcz_store.cc:276] 0709 12:27:13.474243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.700986 (+1226743us) service_pool.cc:224] Handling call
0709 12:27:14.863584 (+162598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:14.863778 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:15.155355 (+291577us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.600369 (+445014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:15.600426 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:15.600473 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.600537 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.600647 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86976,"prepare.queue_time_us":157565,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":11681,"spinlock_wait_cycles":116352,"thread_start_us":706881,"threads_started":2}
I20260709 12:27:16.328773 11511 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:16.434963 11511 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:16.435840  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.438205  8545 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:16.439883  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.426813  8394 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:16.444129  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:16.444805  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:16.445048  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.445497  8395 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:16.438130  8464 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:16.445700  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:16.446455  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 110126us
I20260709 12:27:16.446460  8539 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:16.430495  8512 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.447794  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.431771  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.448557  8541 raft_consensus.cc:2368] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:16.448887  8544 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:16.448392  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.449340  8512 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.449720  8539 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:16.445732  8537 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:16.450536  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.450875  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.451241  8539 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:16.451503  8512 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.430421  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.452246  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.452755  8470 raft_consensus.cc:2410] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:27:16.454250  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.449671  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.455169  8544 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:27:16.455931  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.456492  8544 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:16.462532  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.463750  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.464995  8470 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:16.474313  8466 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:16.475145  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.463201  8394 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:16.476917  8470 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:27:16.477571  8463 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:16.478161  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:16.478885  8397 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.479506  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.482353  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.480578  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.462626 11499 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.487882  8466 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:16.484004  8397 raft_consensus.cc:2393] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.464946 11524 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:16.482981  8537 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:16.490370  8395 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:16.491374  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.473022 11416 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:16.495539  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.497689  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.497836  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.498663  8394 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.464793 11459 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:16.494376  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.465088 11299 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:16.497851  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.499326  8397 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:16.499830  8537 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:16.500114  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.509289  8539 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:16.510335  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.473210 11262 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:27:16.448066 11451 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:16.511919  8394 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:16.517796  8544 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:16.522701  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:16.523234  8544 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:16.473238 11434 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:27:16.512876  8537 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:16.495095 11241 consensus_queue.cc:1059] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:27:16.505300 11521 consensus_meta.cc:287] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.505s	user 0.002s	sys 0.007s
I20260709 12:27:16.524205  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:16.496609 11466 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:16.530438  8544 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:16.501768 11459 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:16.484220 11499 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.494915 10970 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:27:16.495600 11525 consensus_queue.cc:1059] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:27:16.535524  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:16.497428 11524 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:27:16.545297  8537 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:16.540315 11241 raft_consensus.cc:3055] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:16.546489 11334 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.511385 11568 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:16.522115 11299 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:16.550239  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.534293 11459 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.560488  8512 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.571172  8512 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.550794 11241 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:16.534660 11521 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.536127 11511 consensus_queue.cc:1059] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:27:16.561079 11299 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.557447 11565 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:16.539927 11466 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:16.588393 11299 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:16.599332 11566 log.cc:927] Time spent T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:27:16.579231 11361 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.609503  8396 raft_consensus.cc:2393] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:16.584414 11416 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:16.584015 11525 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:16.582553 11564 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:16.563025 11568 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.601768 11504 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:16.624419  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 53344us
I20260709 12:27:16.611065 11416 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.614161 11525 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.615134 11564 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:16.639915  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1588) took 1170 ms. Trace:
I20260709 12:27:16.640342  8391 rpcz_store.cc:276] 0709 12:27:15.469031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.470211 (+  1180us) service_pool.cc:224] Handling call
0709 12:27:16.639729 (+1169518us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400113854. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:16.639857 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555045248}
W20260709 12:27:16.642274 11553 log.cc:927] Time spent T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.439s	user 0.000s	sys 0.003s
W20260709 12:27:16.643843  8422 heartbeater.cc:646] Failed to heartbeat to 127.7.23.126:36193 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.23.126:36193 timed out after 15.000s (SENT)
I20260709 12:27:16.644461  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:16.648398  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.642778 11406 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:16.661582  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.631023 11525 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.630913 11416 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:16.681092 11567 log.cc:927] Time spent T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:27:16.681695 11570 log.cc:927] Time spent T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 12:27:16.681838 11573 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 12:27:16.683487 11569 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:27:16.687886 11451 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:16.632738 11564 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:16.683241  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:16.625857 11241 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.720975 11529 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:16.722189  8541 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:16.676502 11504 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:16.730053 11521 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.731125  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.732328  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.732395 11529 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:16.735281 11451 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:16.735858 11451 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:16.761293 11530 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:27:16.851855  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:16.853317  8362 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:16.856772  9015 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:16.854874  8362 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:16.858968  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 395257us
I20260709 12:27:16.859660  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1859) took 3533 ms. Trace:
I20260709 12:27:16.860162  8543 rpcz_store.cc:276] 0709 12:27:13.325778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.633657 (+1307879us) service_pool.cc:224] Handling call
0709 12:27:14.633915 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.700844 (+1066929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.859367 (+1158523us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540006a9d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:16.859588 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2373346560}
I20260709 12:27:16.860663  8540 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:16.859807  8436 leader_election.cc:400] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:16.862030  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:16.894277  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:16.896068  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:16.759331 11504 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:16.901079  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1594) took 1311 ms. Trace:
I20260709 12:27:16.903515  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.904874  8392 rpcz_store.cc:276] 0709 12:27:15.590079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.594293 (+  4214us) service_pool.cc:224] Handling call
0709 12:27:16.900909 (+1306616us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b54002b5054. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:16.901026 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194520320}
I20260709 12:27:16.909925  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:16.855572 11521 raft_consensus.cc:2764] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:16.853760 11466 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:16.854147 11241 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:16.914485  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:16.892802 11561 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:16.917129  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.958120  8436 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.959013  8436 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:16.960431  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:16.908339 11340 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:16.965224 11340 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:16.900976 11499 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:16.900084 11524 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:27:16.931720 11508 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:16.965400 11555 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:16.962373 11434 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:16.968042 11340 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:16.987655 11434 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:16.980516 11343 consensus_meta.cc:287] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.001s
I20260709 12:27:16.934906  8388 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:16.965517 11419 consensus_queue.cc:1059] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:27:16.915448 11404 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:16.911918 11082 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:16.988273 11406 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:16.932281 11334 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:16.983629 11499 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:17.022066  8391 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:17.038085  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1730) took 1171 ms. Trace:
I20260709 12:27:17.038456  8391 rpcz_store.cc:276] 0709 12:27:15.866619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.995686 (+1129067us) service_pool.cc:224] Handling call
0709 12:27:17.021868 (+ 26182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.037823 (+ 15955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.038026 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:16.983613 11588 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:17.024000 11568 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:17.024363 11416 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.025029  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1628) took 1062 ms. Trace:
I20260709 12:27:16.989360 11555 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.915025 11516 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:16.993724 11434 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:17.027967  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 67608.8us
I20260709 12:27:16.999848 11343 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:17.040007  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 185183us
I20260709 12:27:17.052768  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:17.051110  8396 rpcz_store.cc:276] 0709 12:27:15.963004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.320433 (+357429us) service_pool.cc:224] Handling call
0709 12:27:17.024844 (+704411us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400287b54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:17.024971 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661777792}
I20260709 12:27:17.026254 11404 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:16.999307 11508 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 12:27:17.060905  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.071240  8436 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:17.079782  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.080534  8396 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:17.081570  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1733) took 1210 ms. Trace:
I20260709 12:27:17.037130 11334 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:17.081872  8396 rpcz_store.cc:276] 0709 12:27:15.870909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.078827 (+1207918us) service_pool.cc:224] Handling call
0709 12:27:17.079106 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.081321 (+  2215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.081517 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:17.051877 11082 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:17.029520 11525 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.071697 11588 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:17.098227 11578 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.533s	user 0.000s	sys 0.002s
I20260709 12:27:17.070189 11499 raft_consensus.cc:697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:17.069931 11555 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:17.121956  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.076088  8391 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:17.075433  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:17.115036  8465 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:17.108410 11404 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:17.030011 11451 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:17.115826 11334 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:17.117259  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 216881us
I20260709 12:27:17.154863  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:17.080322 11511 raft_consensus.cc:3055] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:17.118039  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 289) took 1403 ms. Trace:
W20260709 12:27:17.111196 11579 log.cc:927] Time spent T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 12:27:17.111378 11589 log.cc:927] Time spent T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:27:17.113054  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 449) took 1185 ms. Trace:
I20260709 12:27:17.108222 11562 raft_consensus.cc:3055] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:17.106689 11332 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:27:17.125022  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 53414.1us
I20260709 12:27:17.106833 11466 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:17.127537  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1609) took 1452 ms. Trace:
I20260709 12:27:17.172186  8394 rpcz_store.cc:276] 0709 12:27:15.675317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.528121 (+852804us) service_pool.cc:224] Handling call
0709 12:27:16.528401 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.532772 (+  4371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.532798 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.533187 (+   389us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.838108 (+304921us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:16.838153 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.838232 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.127309 (+289077us) raft_consensus.cc:1685] finished
0709 12:27:17.127330 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.127476 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4012,"raft.queue_time_us":4631,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":7047,"thread_start_us":258840,"threads_started":1,"wal-append.queue_time_us":465793}
I20260709 12:27:17.129130  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1732) took 1258 ms. Trace:
I20260709 12:27:17.175521  8391 rpcz_store.cc:276] 0709 12:27:15.870633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.039298 (+1168665us) service_pool.cc:224] Handling call
0709 12:27:17.075857 (+ 36559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.124477 (+ 48620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.129030 (+  4553us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:17.116806  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 183228us
I20260709 12:27:17.131559 11588 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:17.133788 11459 consensus_meta.cc:287] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.555s	user 0.008s	sys 0.001s
I20260709 12:27:17.134407 11499 consensus_queue.cc:237] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.135092 11525 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:17.136381  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1619) took 1458 ms. Trace:
I20260709 12:27:17.137068 11564 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.138612  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 447) took 1487 ms. Trace:
I20260709 12:27:17.139814 11082 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.125888 11504 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:17.141544  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1797) took 2124 ms. Trace:
I20260709 12:27:17.142391 11416 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:17.142560  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1601) took 1469 ms. Trace:
I20260709 12:27:17.197887  8393 rpcz_store.cc:276] 0709 12:27:15.673467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.816559 (+143092us) service_pool.cc:224] Handling call
0709 12:27:17.142379 (+1325820us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b5400164c54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:17.142507 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109474560}
I20260709 12:27:17.199486  8393 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:17.200035  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 450) took 1015 ms. Trace:
I20260709 12:27:17.200343  8393 rpcz_store.cc:276] 0709 12:27:16.185082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.198774 (+1013692us) service_pool.cc:224] Handling call
0709 12:27:17.199132 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.199809 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.199980 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:17.127120 11387 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:17.079085 11568 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:17.169631  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:17.171234 11562 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:17.169198  8396 rpcz_store.cc:276] 0709 12:27:15.927316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.112208 (+1184892us) service_pool.cc:224] Handling call
0709 12:27:17.112501 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.112695 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.112720 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.112774 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:17.112815 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.112866 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.112994 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:17.171630  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1618) took 1494 ms. Trace:
I20260709 12:27:17.181895  8467 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:27:17.188848  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 80457.8us
I20260709 12:27:17.190094  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:17.190018  8397 rpcz_store.cc:276] 0709 12:27:15.651478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.520738 (+869260us) service_pool.cc:224] Handling call
0709 12:27:16.521026 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.540942 (+ 19916us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.540971 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.541011 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:16.541044 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.138412 (+597368us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b540032a354. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:17.138454 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.138561 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45393280}
I20260709 12:27:17.141094 11430 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:17.187000  8390 rpcz_store.cc:276] 0709 12:27:15.677786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.852636 (+1174850us) service_pool.cc:224] Handling call
0709 12:27:16.856840 (+  4204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.857168 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.857194 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.890096 (+ 32902us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.027037 (+136941us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:17.027074 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.027140 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.136180 (+109040us) raft_consensus.cc:1685] finished
0709 12:27:17.136198 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.136327 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":38903,"thread_start_us":66445,"threads_started":1,"wal-append.queue_time_us":209848}
I20260709 12:27:17.227727  8390 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:27:17.193390  8546 rpcz_store.cc:276] 0709 12:27:15.016848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.452621 (+435773us) service_pool.cc:224] Handling call
0709 12:27:15.452937 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.309334 (+856397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.309366 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.309409 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:16.309446 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.141341 (+831895us) spinlock_profiling.cc:243] Waited 851 ms on lock 0x7b540003a7d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:17.141381 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.141492 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4795,"raft.queue_time_us":4429,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"spinlock_wait_cycles":1958395264}
I20260709 12:27:17.195853  8362 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:17.167977 11511 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:17.168303 11451 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:17.205927  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:17.206903  8389 rpcz_store.cc:276] 0709 12:27:15.677558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.742183 (+1064625us) service_pool.cc:224] Handling call
0709 12:27:16.742515 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.742706 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:16.970299 (+227593us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.168368 (+198069us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.171256 (+  2888us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.171309 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:17.171361 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.171448 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.171570 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":294996,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":72,"raft.queue_time_us":2639,"spinlock_wait_cycles":11975936,"thread_start_us":422566,"threads_started":2}
W20260709 12:27:17.207449  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 170061us
I20260709 12:27:17.205289 11568 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.185794 11459 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.216950 11555 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.218499 11434 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.218894 11564 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:17.184338 11603 consensus_queue.cc:1059] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:27:17.191599 11332 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:17.220664  9046 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:17.205672 11387 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.230810  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:17.233000  8537 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:17.230222  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:17.236204  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 451) took 1047 ms. Trace:
I20260709 12:27:17.243973  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:17.196557 11597 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:17.246584  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:17.230506 11416 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:17.184911 11466 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:17.168848  9042 rpcz_store.cc:276] 0709 12:27:15.711587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.720650 (+  9063us) service_pool.cc:224] Handling call
0709 12:27:17.098759 (+1378109us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b54004132d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:17.114441 (+ 15682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42842496}
I20260709 12:27:17.311070  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:17.312996  8546 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:17.313834  8393 rpcz_store.cc:276] 0709 12:27:16.188701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.204783 (+1016082us) service_pool.cc:224] Handling call
0709 12:27:17.235713 (+ 30930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.235887 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.235915 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.235955 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:17.235992 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.236053 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.236150 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:17.316532  8543 raft_consensus.cc:2368] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11.
I20260709 12:27:17.239602 11572 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.246773 11568 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:17.329818  8546 raft_consensus.cc:1275] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:27:17.319025  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 79934us
I20260709 12:27:17.468582  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:17.417843  8539 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:17.226414 11561 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
W20260709 12:27:17.435052  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 191133us
I20260709 12:27:17.435194  8393 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:17.481561  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 485) took 1518 ms. Trace:
I20260709 12:27:17.464802 11332 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.481554  8511 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:17.318413 11387 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:17.244905 11604 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.210s
I20260709 12:27:17.447618 11612 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:17.267376 11596 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:17.454309 11434 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:17.319967 11416 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.455516 11560 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:17.245226 11451 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:17.460907 11340 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.434106 11562 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:17.462493 11241 consensus_meta.cc:287] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.001s
I20260709 12:27:17.463986 11555 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:17.226161 11601 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.227s
I20260709 12:27:17.484262  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1640) took 1203 ms. Trace:
I20260709 12:27:17.240159 11404 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.482096  9049 rpcz_store.cc:276] 0709 12:27:15.963578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.964027 (+   449us) service_pool.cc:224] Handling call
0709 12:27:15.964351 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.964750 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:15.977160 (+ 12410us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.043061 (+ 65901us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b180010a080. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c522 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:16.548897 (+505836us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b180010a080. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646127ee07 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6463f2320b 00007f6463f28d23 00007f6463f2923a 00007f6464393a2a
0709 12:27:16.657905 (+109008us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.712122 (+ 54217us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.712301 (+   179us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:16.712347 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.712418 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.481378 (+768960us) raft_consensus.cc:1685] finished
0709 12:27:17.481399 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.481507 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11249,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":35,"raft.queue_time_us":7302,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":23476,"spinlock_wait_cycles":126643456,"thread_start_us":108226,"threads_started":1,"wal-append.queue_time_us":978558}
W20260709 12:27:17.510246  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.459391 11299 consensus_meta.cc:287] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.861s	user 0.010s	sys 0.000s
W20260709 12:27:17.545126  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.333564 11274 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:18.015075 11274 raft_consensus.cc:697] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:18.014839 11299 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:18.016392  8471 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:18.016216 11274 consensus_queue.cc:237] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:17.701783  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 233239us
W20260709 12:27:17.887084 11577 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 1.323s	user 0.000s	sys 0.003s
I20260709 12:27:18.019078  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1819) took 1577 ms. Trace:
I20260709 12:27:18.018424  8397 rpcz_store.cc:276] 0709 12:27:16.280364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.215753 (+935389us) service_pool.cc:224] Handling call
0709 12:27:17.216041 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.216236 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:17.216489 (+   253us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.483944 (+267455us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.483995 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:17.484046 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.484109 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.484210 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5541,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":706,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":83398,"thread_start_us":267116,"threads_started":1}
I20260709 12:27:18.019511  8545 rpcz_store.cc:276] 0709 12:27:16.441246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.441657 (+   411us) service_pool.cc:224] Handling call
0709 12:27:16.441967 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.442182 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:16.442207 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.442650 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.563823 (+121173us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:16.563861 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.563930 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.509413 (+945483us) spinlock_profiling.cc:243] Waited 9.42 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:18.018766 (+509353us) raft_consensus.cc:1685] finished
0709 12:27:18.018790 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.019014 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21673216,"thread_start_us":120783,"threads_started":1,"wal-append.queue_time_us":121106}
W20260709 12:27:17.995568 11334 consensus_meta.cc:287] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.000s
I20260709 12:27:18.021692 11504 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.996578 11466 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:17.888921 11459 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:18.022307 11504 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.550009 11564 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:17.569603 11416 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:18.025048 11504 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:18.026458  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.702260 11597 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.027393 11597 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:17.481410 11572 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:17.986099  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 504578us
I20260709 12:27:18.030222  8511 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:17.609768 11511 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:18.032097 11340 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:18.034112 11451 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:18.035190 11581 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:18.037091 11562 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.040895 11564 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.041419 11564 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.862843 11596 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:18.043573 11504 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:18.044167 11504 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:17.590834 11434 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:18.046090 11504 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:17.887847 11613 log.cc:927] Time spent T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:27:18.047362 11299 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:17.995905  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 309) took 1131 ms. Trace:
I20260709 12:27:18.048923  8540 rpcz_store.cc:276] 0709 12:27:16.864816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.864932 (+   116us) service_pool.cc:224] Handling call
0709 12:27:16.889610 (+ 24678us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.170938 (+281328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.170967 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.186420 (+ 15453us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.606485 (+420065us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:17.606537 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.606610 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:17.995679 (+389069us) raft_consensus.cc:1685] finished
0709 12:27:17.995701 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.995849 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14266,"raft.queue_time_us":78344,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4858,"thread_start_us":607253,"threads_started":2,"wal-append.queue_time_us":744734}
W20260709 12:27:17.802817  9015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.000s	sys 0.013s
W20260709 12:27:18.093086  9015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.001s	sys 0.017s
W20260709 12:27:18.093480  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 854165us
I20260709 12:27:17.485357 11525 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:18.050845 11504 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:18.053323 11596 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:17.549751 11612 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:18.021826 11334 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:18.078815 11597 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:18.097416  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:18.142094  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 44892.6us
I20260709 12:27:18.029914 11572 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:18.204541 11601 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.205243 11241 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:27:18.251000 11629 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:27:18.243029 11601 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:18.310364 11568 consensus_meta.cc:287] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.801s	user 0.006s	sys 0.001s
I20260709 12:27:18.304034 11404 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:18.322186 11601 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:18.314064 11568 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:18.330695 11568 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:18.331907 11596 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:18.334123 11334 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:18.063231 11387 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:18.370152 11387 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:18.405787 11416 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:17.830618  8362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.003s	sys 0.018s
W20260709 12:27:18.547863  8362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.307s	user 0.006s	sys 0.018s
I20260709 12:27:18.548360  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1736) took 1915 ms. Trace:
I20260709 12:27:18.053056  8511 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:17.803259  8394 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.015s	sys 0.024s
I20260709 12:27:18.549054  8393 rpcz_store.cc:276] 0709 12:27:16.632486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.482419 (+849933us) service_pool.cc:224] Handling call
0709 12:27:17.484762 (+  2343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.513643 (+ 28881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.513673 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.514173 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.008474 (+494301us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:18.008515 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.008583 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.547620 (+539037us) raft_consensus.cc:1685] finished
0709 12:27:18.547700 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.548073 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32236,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":41239,"thread_start_us":343023,"threads_started":1,"wal-append.queue_time_us":380846}
W20260709 12:27:18.551112  8394 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.345s	user 0.018s	sys 0.026s
W20260709 12:27:18.551386  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 498226us
I20260709 12:27:18.552361  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1639) took 2355 ms. Trace:
I20260709 12:27:18.552798  8396 rpcz_store.cc:276] 0709 12:27:16.196583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.206249 (+1009666us) service_pool.cc:224] Handling call
0709 12:27:17.206590 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:17.206918 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.206945 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:17.216043 (+  9098us) log.cc:844] Serialized 52 byte log entry
0709 12:27:17.985623 (+769580us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:17.985673 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.985757 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.551771 (+566014us) raft_consensus.cc:1685] finished
0709 12:27:18.551815 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.552157 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33131,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4501,"thread_start_us":297773,"threads_started":1,"wal-append.queue_time_us":1059695}
W20260709 12:27:18.554361  8436 leader_election.cc:336] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.211s (SENT)
I20260709 12:27:18.557341  8397 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:27:18.558315  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1741) took 1919 ms. Trace:
I20260709 12:27:18.558665  8397 rpcz_store.cc:276] 0709 12:27:16.638987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.555981 (+1916994us) service_pool.cc:224] Handling call
0709 12:27:18.556663 (+   682us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:18.558019 (+  1356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.558224 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:18.548480  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 1.35258e+06us
I20260709 12:27:18.560276  8362 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:18.561261  8469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 1998) took 2738 ms. Trace:
W20260709 12:27:18.548573  8391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.001s	sys 0.000s
W20260709 12:27:18.561969  8391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.002s	sys 0.000s
W20260709 12:27:18.562942  8512 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.582s (SENT)
I20260709 12:27:18.563367  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1636) took 2414 ms. Trace:
I20260709 12:27:18.563803  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:18.564327  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 456) took 1794 ms. Trace:
I20260709 12:27:18.568401  8397 rpcz_store.cc:276] 0709 12:27:16.770434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.563116 (+1792682us) service_pool.cc:224] Handling call
0709 12:27:18.563584 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.563980 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.564007 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.564070 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:18.564107 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.564157 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.564267 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.566334  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 457) took 1591 ms. Trace:
I20260709 12:27:18.561691  8469 rpcz_store.cc:276] 0709 12:27:15.822874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.825372 (+  2498us) service_pool.cc:224] Handling call
0709 12:27:15.860013 (+ 34641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.860213 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:15.997337 (+137124us) log.cc:844] Serialized 14 byte log entry
0709 12:27:18.559952 (+2562615us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b1800493cc0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6463f314bc 00007f646127f48b 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6463f2320b 00007f6463f28d23 00007f6463f2923a
0709 12:27:18.560440 (+   488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.560542 (+   102us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:18.560667 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.560777 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.560969 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2439,"prepare.queue_time_us":296316,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":2867840,"thread_start_us":292323,"threads_started":2,"wal-append.queue_time_us":282508,"wal-append.run_cpu_time_us":1050,"wal-append.run_wall_time_us":1005019}
I20260709 12:27:18.562942  8396 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:27:18.552645  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1635) took 2514 ms. Trace:
I20260709 12:27:18.561483  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 455) took 2011 ms. Trace:
I20260709 12:27:18.563832  8391 rpcz_store.cc:276] 0709 12:27:16.149075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.176354 (+1027279us) service_pool.cc:224] Handling call
0709 12:27:17.190665 (+ 14311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:17.319561 (+128896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.319590 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:17.641955 (+322365us) log.cc:844] Serialized 52 byte log entry
0709 12:27:18.562889 (+920934us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:18.562956 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.563042 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.563103 (+    61us) raft_consensus.cc:1685] finished
0709 12:27:18.563117 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.563296 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48988,"spinlock_wait_cycles":6841088,"thread_start_us":768823,"threads_started":2,"wal-append.queue_time_us":612066}
W20260709 12:27:18.569851  8281 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2d99fb7f1afb4c958cdc302eb8ef165f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:18.570649  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1740) took 1933 ms. Trace:
I20260709 12:27:18.574149  8396 rpcz_store.cc:276] 0709 12:27:16.637712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.554911 (+1917199us) service_pool.cc:224] Handling call
0709 12:27:18.562510 (+  7599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.570388 (+  7878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.570581 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.570487  8394 rpcz_store.cc:276] 0709 12:27:16.037858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.173669 (+1135811us) service_pool.cc:224] Handling call
0709 12:27:17.173988 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.174310 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.174337 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.174791 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:27:18.552017 (+1377226us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:18.552134 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.552300 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.552367 (+    67us) raft_consensus.cc:1685] finished
0709 12:27:18.552381 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.552588 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":678,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":3201,"thread_start_us":1345656,"threads_started":1,"wal-append.queue_time_us":1095417}
W20260709 12:27:18.577353  9013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.573640  8391 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:18.579460  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 458) took 1451 ms. Trace:
I20260709 12:27:18.579242  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:18.579707 11241 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:18.579674  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:18.579926  8391 rpcz_store.cc:276] 0709 12:27:17.128305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.572122 (+1443817us) service_pool.cc:224] Handling call
0709 12:27:18.573375 (+  1253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.579183 (+  5808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.579365 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.580430 11241 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.581022 11241 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:18.582525 11340 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:18.583443 11504 consensus_queue.cc:1059] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:18.583240 11340 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:18.570004  8393 rpcz_store.cc:276] 0709 12:27:16.975056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.565104 (+1590048us) service_pool.cc:224] Handling call
0709 12:27:18.565606 (+   502us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.565985 (+   379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.566015 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:18.566077 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:18.566116 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.566165 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.566268 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:18.585318  8389 rpcz_store.cc:276] 0709 12:27:16.550155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.240343 (+690188us) service_pool.cc:224] Handling call
0709 12:27:17.252517 (+ 12174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.484831 (+232314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.484863 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.484903 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:17.484934 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.560965 (+1076031us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5400102f54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:18.561028 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.561294 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533844224}
I20260709 12:27:18.580624  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:18.601519  8539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 1831) took 2150 ms (client timeout 2211 ms). Trace:
I20260709 12:27:18.602231 11624 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.604990 11624 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:18.605218 11459 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:27:18.601995  8539 rpcz_store.cc:269] 0709 12:27:16.452141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.510070 (+ 57929us) service_pool.cc:224] Handling call
0709 12:27:18.594319 (+2084249us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b5400387054. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:18.601263 (+  6944us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866954624}
I20260709 12:27:18.610777 11597 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:27:18.615661 11596 consensus_queue.cc:1059] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:18.619589 11340 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:18.621155 11459 consensus_queue.cc:1059] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:27:18.628611  8463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1790) took 2352 ms (client timeout 1661 ms). Trace:
W20260709 12:27:18.629101  8463 rpcz_store.cc:269] 0709 12:27:16.276099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.300857 (+ 24758us) service_pool.cc:224] Handling call
0709 12:27:18.628139 (+2327282us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54000d84d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:18.628360 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359029632}
I20260709 12:27:18.632328 11274 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:18.638003 11299 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.639503  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 446) took 2982 ms. Trace:
I20260709 12:27:18.640014  8395 rpcz_store.cc:276] 0709 12:27:15.649137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.515517 (+866380us) service_pool.cc:224] Handling call
0709 12:27:16.515834 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.600398 (+ 84564us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:16.728440 (+128042us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.118852 (+390412us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.118908 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:17.118958 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.143804 (+ 24846us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b18001b03a0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:18.630972 (+1487168us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b5400165b54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:18.631041 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.631261 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38611,"prepare.queue_time_us":364347,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":71726,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5799,"spinlock_wait_cycles":200013952,"thread_start_us":478088,"threads_started":3,"wal-append.queue_time_us":323633,"wal-append.run_cpu_time_us":1208,"wal-append.run_wall_time_us":1123649}
I20260709 12:27:18.643049 11588 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.643971 11588 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:18.644840 11508 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:18.646378 11588 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:18.647979 11624 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:18.649232  8436 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:18.650368  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 88801.7us
I20260709 12:27:18.658068 11334 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.658993 11334 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:18.639263 11299 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:18.706089 11416 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:18.712551 11624 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:18.686378  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 127097us
W20260709 12:27:18.716565  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 67478.2us
I20260709 12:27:18.743501  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 2004) took 2431 ms. Trace:
I20260709 12:27:18.743958  8466 rpcz_store.cc:276] 0709 12:27:16.312009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.490383 (+178374us) service_pool.cc:224] Handling call
0709 12:27:16.504819 (+ 14436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:16.630786 (+125967us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:16.648517 (+ 17731us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.893337 (+244820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.893384 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:16.893443 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.713433 (+1819990us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001a4354. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:18.713485 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.743328 (+ 29843us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17561,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":6540,"raft.queue_time_us":74,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5616,"spinlock_wait_cycles":292425600,"thread_start_us":243716,"threads_started":1,"wal-append.queue_time_us":335157,"wal-append.run_cpu_time_us":1992,"wal-append.run_wall_time_us":1205998}
I20260709 12:27:18.748176 11332 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:18.749223 11332 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:18.750519  8469 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:18.748250 11568 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:18.783461 11340 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:27:18.784380  8464 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 1999) took 2851 ms (client timeout 2929 ms). Trace:
W20260709 12:27:18.784821  8464 rpcz_store.cc:269] 0709 12:27:15.932729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.932886 (+   157us) service_pool.cc:224] Handling call
0709 12:27:18.783980 (+2851094us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540018a954. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:18.784210 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1154820352}
W20260709 12:27:18.782505  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 114529us
I20260709 12:27:18.783160 11568 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:18.791903  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:18.805804 11568 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:18.817615  8468 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:27:18.842840  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 129757us
I20260709 12:27:18.836068 11504 raft_consensus.cc:3055] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:27:18.859192 11609 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 1.250s	user 0.009s	sys 0.012s
I20260709 12:27:18.890260 10744 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:18.896198  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 89108.1us
I20260709 12:27:18.897743 10744 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:18.905297 11614 log.cc:927] Time spent T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 1.223s	user 0.005s	sys 0.014s
I20260709 12:27:18.896952 11387 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:18.867945 11504 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:19.023551  8361 connection.cc:256] RPC call timeout handler was delayed by -1.3587430940001468s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:27:19.033022  8361 connection.cc:256] RPC call timeout handler was delayed by -1.2271986929999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 12:27:19.054026  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 203656us
W20260709 12:27:19.114326  9013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.188532 11596 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:19.189559 11596 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.193184 11332 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:19.255131  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.193511 11528 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:19.264490 11596 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.266263 11650 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:19.269886 11650 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:19.271111 11650 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.272770 11650 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.268425 11082 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:19.283818 11082 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.286125 11082 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:19.193914 11609 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:27:19.400089 11588 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.400995 11588 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.121907 11340 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:19.419871  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:19.416600  8361 connection.cc:256] RPC call timeout handler was delayed by -1.1951366990001588s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3292s for a response
W20260709 12:27:19.414673 11241 consensus_meta.cc:287] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.007s
I20260709 12:27:19.400856 11299 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:19.400309 11334 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:19.421346  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 858603us
W20260709 12:27:19.436311  8361 connection.cc:256] RPC call timeout handler was delayed by -1.0924885780000295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:27:19.436071  8436 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.020s
W20260709 12:27:19.437687  8436 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.008s	sys 0.020s
W20260709 12:27:19.438014  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 595015us
W20260709 12:27:19.437263  8361 connection.cc:256] RPC call timeout handler was delayed by -1.060480521000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1542s for a response
W20260709 12:27:19.441044  8361 connection.cc:256] RPC call timeout handler was delayed by -1.0451859669997248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
I20260709 12:27:19.415843 11340 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:19.412983 11528 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.457456 11596 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:19.458438 11528 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:19.458247 11596 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:19.459471  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 556063us
I20260709 12:27:19.460582 11596 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:19.437218 11241 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.465286 11241 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:19.465999 11640 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.466447 11639 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:19.467334 11639 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.467819 11637 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:19.468497 11637 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.469678 11639 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.470275 11639 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.470961 11637 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.472211 11643 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:19.471577 11597 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.473057 11352 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.466789 11640 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.466805 11241 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.511564  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:19.517540  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:19.519104 11658 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:19.519497  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:19.520200  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1727) took 3684 ms. Trace:
I20260709 12:27:19.521166  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.522805  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.523590 11299 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.524307 11299 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.526995 11299 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.527855  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.535454  8468 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:19.535682  8395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "145eb7997c78480db629215c6acac8ef"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:19.536450  8395 raft_consensus.cc:606] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:19.536867  8395 raft_consensus.cc:614] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:19.536859  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.520576  8388 rpcz_store.cc:276] 0709 12:27:15.836060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.855887 (+1019827us) service_pool.cc:224] Handling call
0709 12:27:16.856323 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:17.015307 (+158984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.519798 (+2504491us) spinlock_profiling.cc:243] Waited 78.4 ms on lock 0x7b54003dead4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:19.520051 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180235136}
I20260709 12:27:19.538646 11638 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.537650  8468 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.527076  8472 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:19.528393 11504 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.523633  8463 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:19.532740 11658 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.532234  8436 leader_election.cc:400] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11.
I20260709 12:27:19.542897  8436 leader_election.cc:403] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:27:19.528792 10970 raft_consensus.cc:3055] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:19.470961 11639 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:19.580531  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48701.5us
I20260709 12:27:19.543241 11588 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.546609 10970 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:19.541360 11528 consensus_queue.cc:1059] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 12:27:19.542192 11387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.024s	sys 0.013s
W20260709 12:27:19.584853  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 89443.7us
W20260709 12:27:19.586025 11387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.024s	sys 0.013s
I20260709 12:27:19.592015  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.577163 11597 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.593637  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.605335  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.606057  8542 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.588352 11643 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.608064  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.593904 11387 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:19.595834 11588 consensus_queue.cc:1048] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:27:19.615605  8463 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:19.617471  8540 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:19.621151  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.621382  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.622102  8543 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:19.623000  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.623617  8543 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:19.624465  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.621485 11299 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11.
I20260709 12:27:19.627303  8539 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:19.617570  8390 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.004s	sys 0.022s
W20260709 12:27:19.628628  8390 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.004s	sys 0.022s
I20260709 12:27:19.630025  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.630631  8540 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:19.631537  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.631981 11416 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:19.632455 11416 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:19.621214  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.633536 11416 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.634087  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.634644 11416 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.634986  8472 raft_consensus.cc:2410] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:27:19.635985  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.636579  8472 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:19.636883  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.637368  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.637674  8466 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:19.593413 11241 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.632239  8540 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:19.633404  8546 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:19.622072  8544 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:27:19.589337 11638 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.643613  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.644080  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.644552  8466 raft_consensus.cc:2410] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:27:19.644922  8540 raft_consensus.cc:2410] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:19.645473  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.646543  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.616159 11340 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.652315 11340 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.654824 11504 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.655728  8543 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:19.656972 11639 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:19.659505 11568 consensus_meta.cc:287] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.842s	user 0.008s	sys 0.004s
I20260709 12:27:19.660871  8472 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:19.660981  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.661978  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.662099  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.662685  8465 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.662703  8472 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:27:19.668275 11643 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:19.668883  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.669163  8472 raft_consensus.cc:1240] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:19.670063  8543 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:19.671535 11639 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.672209 11639 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.675880 11658 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:19.678149 11654 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.093s	user 0.003s	sys 0.000s
I20260709 12:27:19.677420  8468 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
W20260709 12:27:19.682459 11611 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 2.003s	user 0.019s	sys 0.021s
I20260709 12:27:19.684084  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.684885  8538 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:19.685739  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 305) took 2825 ms. Trace:
I20260709 12:27:19.685854 10744 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.683591  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:19.687265  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48198.9us
I20260709 12:27:19.688444 11640 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:19.616169 10970 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.689780 11466 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:19.689775  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50060.6us
I20260709 12:27:19.693506  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:19.691007  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:19.696130  9049 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:27:19.697698  8510 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:19.698786 11404 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:19.695511 11597 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:19.688971  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:19.701643  8546 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:19.704393  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.705765  8540 raft_consensus.cc:1275] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:19.702889  8542 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:19.723794  8465 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:19.695369 11361 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:19.729151 11430 raft_consensus.cc:3055] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:19.729697 11430 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:19.730508 11387 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.731280  8293 catalog_manager.cc:5697] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.733390  8293 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:19.714758 11640 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:19.737990 11466 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:19.739792  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:19.740002 11658 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.739871 11466 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:19.660907 11568 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.730829 11430 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.740702  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:19.777570  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.778482 11642 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:19.780244 11466 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.780939 11352 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.783532 11649 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:19.686118  8541 rpcz_store.cc:276] 0709 12:27:16.859873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.860196 (+   323us) service_pool.cc:224] Handling call
0709 12:27:16.890269 (+ 30073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.029656 (+139387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.029702 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.030144 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.193548 (+163404us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:17.193582 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.193643 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:19.681656 (+2488013us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:19.685298 (+  3642us) raft_consensus.cc:1685] finished
0709 12:27:19.685317 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:19.685561 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12998,"raft.queue_time_us":97807,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7116,"spinlock_wait_cycles":146174336,"thread_start_us":216755,"threads_started":2,"wal-append.queue_time_us":258077}
I20260709 12:27:19.784003  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.786059  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.799154  8468 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:19.787727  8393 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:19.740645  8394 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:19.725541 11361 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:19.795135  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 52285us
W20260709 12:27:19.740406  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.734460 11638 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:19.783557 11459 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.801724  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.807456  8542 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:19.738282 11640 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:19.806383  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 112058us
I20260709 12:27:19.809906  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.810055 11430 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.810950  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.807044  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.800585 11361 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:19.813670  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.740643 11658 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:19.844105  8438 connection.cc:256] RPC call timeout handler was delayed by -2.377178554999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1915s for a response
W20260709 12:27:19.844537  8438 connection.cc:256] RPC call timeout handler was delayed by -2.2435762299996895s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1643s for a response
W20260709 12:27:19.844823  8438 connection.cc:256] RPC call timeout handler was delayed by -2.2192762299996502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
W20260709 12:27:19.845078  8438 connection.cc:256] RPC call timeout handler was delayed by -2.1148762299999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 12:27:19.845331  8438 connection.cc:256] RPC call timeout handler was delayed by -2.1107785549997971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2211s for a response
W20260709 12:27:19.845579  8438 connection.cc:256] RPC call timeout handler was delayed by -2.0608762299998489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:27:19.845839  8438 connection.cc:256] RPC call timeout handler was delayed by -2.0320762299998023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260709 12:27:19.846102  8438 connection.cc:256] RPC call timeout handler was delayed by -1.9699762299997019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 12:27:19.846351  8438 connection.cc:256] RPC call timeout handler was delayed by -1.8862762300000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260709 12:27:19.846607  8438 connection.cc:256] RPC call timeout handler was delayed by -1.8551785549998385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24950000000000003s for a response
W20260709 12:27:19.846868  8438 connection.cc:256] RPC call timeout handler was delayed by -1.731476229999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22120000000000004s for a response
W20260709 12:27:19.847119  8438 connection.cc:256] RPC call timeout handler was delayed by -1.6832785550000153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2686s for a response
W20260709 12:27:19.847693  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 158825us
W20260709 12:27:19.847362  8438 connection.cc:256] RPC call timeout handler was delayed by -1.6756762299996808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22740000000000002s for a response
W20260709 12:27:19.848960  8438 connection.cc:256] RPC call timeout handler was delayed by -1.6283785549999266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2747s for a response
W20260709 12:27:19.849300  8438 connection.cc:256] RPC call timeout handler was delayed by -1.6010458239998115s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 12:27:19.849622  8438 connection.cc:256] RPC call timeout handler was delayed by -1.5811762299999828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2379s for a response
W20260709 12:27:19.849943  8438 connection.cc:256] RPC call timeout handler was delayed by -1.5337853529999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 12:27:19.850255  8438 connection.cc:256] RPC call timeout handler was delayed by -1.528134396999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 12:27:19.850574  8438 connection.cc:256] RPC call timeout handler was delayed by -1.508678554999733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.288s for a response
I20260709 12:27:19.854996 11361 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.857553  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.863482  8539 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:19.811470 11640 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:19.812783  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.816975  8537 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:19.817423  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.818054  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.812908 11352 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.823887 11639 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:19.823585 11459 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.873097  8464 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:19.828145  8545 raft_consensus.cc:2410] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:27:19.831674 11642 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.836591 11568 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:19.823530  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.818100 11657 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.838697  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.819069  8512 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:19.866300  8438 connection.cc:256] RPC call timeout handler was delayed by -1.3732762299996466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.261s for a response
I20260709 12:27:19.814725  8436 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:19.871914  8541 raft_consensus.cc:2376] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7. Re-sending same reply.
I20260709 12:27:19.803656 11649 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.874624  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.875562  8546 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:19.889869  8542 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
W20260709 12:27:19.885247  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:19.879139  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 67339.8us
W20260709 12:27:19.878122  8438 connection.cc:256] RPC call timeout handler was delayed by -1.3544934339997781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 12:27:19.870903 11596 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.880023 11361 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.884888 11352 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.897050 11343 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:19.894318  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:19.931257 11343 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.931617  8469 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:19.899545  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.932166  8468 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:19.902420  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.903081  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.934576  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:19.935322  8542 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:19.935613 11430 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:19.936527  8542 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:27:19.904465  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 86625.3us
I20260709 12:27:19.905530  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:19.891152  8438 connection.cc:256] RPC call timeout handler was delayed by -1.3268785549998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30820000000000003s for a response
I20260709 12:27:19.907650  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.941133  8546 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:19.941366  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.942188  8472 raft_consensus.cc:2393] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:19.942900  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.907680  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.909924  8466 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:27:19.911089 11459 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:19.911226  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:19.945604  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:19.911696 11604 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.141s	user 0.025s	sys 0.053s
I20260709 12:27:19.912113  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:19.912469 11658 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:19.912781  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 93816us
I20260709 12:27:19.917388 11657 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.919641  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:19.906704 11639 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:19.921795  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:19.924098  8543 raft_consensus.cc:2410] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:19.925653 11649 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.930238 11466 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.930931  8467 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:19.931711 11343 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:19.940922  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 64994.3us
W20260709 12:27:19.943878  8438 connection.cc:256] RPC call timeout handler was delayed by -1.3241881339999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 12:27:19.949319  8544 raft_consensus.cc:2410] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:27:19.955380  8466 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:27:19.963667  8438 connection.cc:256] RPC call timeout handler was delayed by -1.3093522189997202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2783s for a response
W20260709 12:27:19.964015  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1050762299996677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2908s for a response
I20260709 12:27:19.944949 11596 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:19.966454  8537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 1843) took 2737 ms (client timeout 1570 ms). Trace:
I20260709 12:27:19.966620  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:19.966893  8537 rpcz_store.cc:269] 0709 12:27:17.229340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.310656 (+ 81316us) service_pool.cc:224] Handling call
0709 12:27:19.966237 (+2655581us) spinlock_profiling.cc:243] Waited 2.46 s on lock 0x7b54001f2f54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:19.966347 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5666988416}
I20260709 12:27:19.967778  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:19.968356 11596 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:19.969115 11649 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:19.969551 11649 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.969940 11649 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:19.947144 11604 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.355s	user 0.025s	sys 0.053s
I20260709 12:27:19.975062 11082 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.975644 11082 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:19.975977  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:19.976547  8393 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:19.977658 11082 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:19.978394  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:19.979036  8394 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:19.968322  8466 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:19.956218  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:19.919425 11642 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:19.954741 11419 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:27:19.954938  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:19.965934 11672 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:19.991319 11672 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:19.993391  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.993676 11672 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:19.993817  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.997745  8293 catalog_manager.cc:5697] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.998247 11640 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:19.999369  8293 catalog_manager.cc:5697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 5 to 6, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.001051 11657 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:20.002594  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.003257  8464 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:20.004124  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.009989  8393 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:20.021410  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.022086  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.023869  8361 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.026255  8393 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.028110  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.028332  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.028903  8396 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:20.029747  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:20.030457  8537 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:20.030817  9016 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.034909  8393 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:20.036451 11343 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.036301 11262 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:20.037416 11262 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:20.038070 11262 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.038964  8472 raft_consensus.cc:2393] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:20.047298  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.048431  9016 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:19.983053 11639 consensus_queue.cc:1059] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:27:20.049835  8393 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.049954  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.051438  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:20.053345  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.053761  8394 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:20.019695 11416 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:27:20.059536  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.060477  8394 raft_consensus.cc:2410] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:27:20.066103  8388 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:20.059638  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.048779 11387 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.071355  8396 raft_consensus.cc:2368] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8.
I20260709 12:27:20.071267  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.071300  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:20.073367  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 83724.2us
I20260709 12:27:20.071575 11639 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:27:20.067817 11657 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:20.077464  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:20.080358  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.080440  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.081193 11404 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:20.068774 11343 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:20.081758 11404 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:20.082767 11404 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.084367 11466 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:20.084407  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:20.087472 11387 raft_consensus.cc:2764] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:27:20.088181 11387 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:20.089056 11612 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:20.090137  8391 raft_consensus.cc:2393] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:20.098722  8436 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.099741  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:20.101528  8464 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:20.101655  8393 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:20.069916 11604 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:20.102864  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.103504  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:20.104637  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 57207.7us
I20260709 12:27:20.105695  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:20.113893  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 60224.7us
I20260709 12:27:20.113300  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.116870  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.117692 11466 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:20.119364 11466 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:20.119585  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.120517 11651 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:20.121543  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:20.123044  9048 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:20.124336  8391 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:20.125003  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.126955  8393 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:20.128752  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.120849  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.130304  8388 raft_consensus.cc:2410] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:20.130719  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.104843 11640 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:20.121155 11421 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:20.135898  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.130293 11604 raft_consensus.cc:697] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:20.138567 11604 consensus_queue.cc:237] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:20.137248  8438 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.643s (SENT)
I20260709 12:27:20.121047 11459 consensus_queue.cc:1059] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:27:20.226758  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.161217  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.161187  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.160182  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.242311  8393 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:20.179174  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.194231  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.160373  8394 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.128319 11648 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:20.158967  8464 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
W20260709 12:27:20.222101  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 59915.5us
I20260709 12:27:20.218971  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.181650  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:20.247110  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.248358  8463 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
W20260709 12:27:20.249212  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 90083us
I20260709 12:27:20.278656  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.292876  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:20.179512  8512 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.558s (SENT)
I20260709 12:27:20.294051  8470 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:20.136435 11082 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:20.295526  8464 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:20.292899  8388 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
W20260709 12:27:20.296836  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.293593  8396 raft_consensus.cc:2376] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9. Re-sending same reply.
W20260709 12:27:20.297550  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.136881 11421 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:20.220252 11678 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:27:20.180692 11508 raft_consensus.cc:3055] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:20.248780  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:20.300490  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:20.301376  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 141780us
I20260709 12:27:20.302901  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.210790 11649 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.303541  8392 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:20.308564  8544 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:20.314400  8394 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:20.316679  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.318300  8470 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:20.179874 11564 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:20.304042 11421 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.318148  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:20.307714  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.330634  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.331220  8393 raft_consensus.cc:2376] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8. Re-sending same reply.
I20260709 12:27:20.331303  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:20.326433  8394 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:20.327168  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.298676 11082 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:20.303330 11648 raft_consensus.cc:697] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:20.308882 11508 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:20.333807  8466 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:27:20.310010 11404 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:20.335983  8470 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:27:20.336197  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 202930us
I20260709 12:27:20.338469  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:20.340121  8537 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:20.340818  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:20.340193  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 367) took 3414 ms. Trace:
I20260709 12:27:20.343184  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.325755 11504 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.346901  8392 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:20.347391  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.343329  8471 rpcz_store.cc:276] 0709 12:27:16.903391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:16.933064 (+ 29673us) service_pool.cc:224] Handling call
0709 12:27:16.965849 (+ 32785us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.016790 (+1050941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.278071 (+2261281us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000267d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:20.317644 (+ 39573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415575808}
I20260709 12:27:20.341454  8538 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:20.350379  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.335453 11082 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:20.351490  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 172016us
I20260709 12:27:20.338472 11655 raft_consensus.cc:2764] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:20.355175  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:20.351329  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.321923 11334 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
W20260709 12:27:20.360183  8438 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.670s (SENT)
I20260709 12:27:20.361467  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.361997  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.363940  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:20.364619  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.365312  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.371526 11504 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.372888 11508 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.348479 11404 raft_consensus.cc:697] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:20.376187  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:20.393760  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 93666.8us
I20260709 12:27:20.376592  9048 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
I20260709 12:27:20.394384  8394 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:20.375837  8438 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.374336 11419 consensus_queue.cc:1059] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:27:20.373332 11648 consensus_queue.cc:237] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.395363  8537 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.397794  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.398890  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.361415 11525 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:20.431092  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 132798us
I20260709 12:27:20.399494  8393 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:20.343310 11564 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:27:20.378700 11686 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
I20260709 12:27:20.390985  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.436517  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:20.437932  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.438000  8511 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.440158  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.440332  8539 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:20.442889  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:20.444361  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49955.9us
I20260709 12:27:20.446746  8464 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:20.431385 11525 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:20.393113 11082 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.436177 11340 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.454475  8394 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:20.441874 11508 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.458593  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.442487 11564 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:20.463487  8510 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:20.468930  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 114516us
I20260709 12:27:20.449632 11597 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:27:20.477437  8438 leader_election.cc:336] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.786s (SENT)
I20260709 12:27:20.478030  8438 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.477602  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.480114 11404 consensus_queue.cc:237] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.481276 11082 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:20.482515 11596 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:20.482993 11596 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:20.486397 10970 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.486960 11564 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.490288 11525 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.491271 11525 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.491860 11504 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:20.492877  8543 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:20.496842 11649 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:20.499771  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 137980us
I20260709 12:27:20.505142  8542 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:20.471401 11563 raft_consensus.cc:3055] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:20.472030 11655 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.504058  8511 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.514376 11504 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:20.514705 11649 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:20.515092 11649 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.515465 11649 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.516141  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.516846 11459 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:20.517204 11459 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.517652 11459 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.518631 11511 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.493484  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:20.517181  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 454) took 4084 ms. Trace:
W20260709 12:27:20.510941  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 143605us
I20260709 12:27:20.472394 11597 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:20.511459  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.475755 11416 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:20.493407 11692 consensus_queue.cc:1059] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:27:20.531523  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.532994  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.539151  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.539278  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:20.512120 11563 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:20.512048 11651 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.523563  8390 rpcz_store.cc:276] 0709 12:27:16.433166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.228456 (+795290us) service_pool.cc:224] Handling call
0709 12:27:17.228702 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:18.549673 (+1320971us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:27:18.599099 (+ 49426us) log.cc:844] Serialized 14 byte log entry
0709 12:27:19.628963 (+1029864us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:19.629017 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:19.629067 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.516967 (+887900us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002bdc54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:20.517005 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.517129 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49205,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":379943,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":182,"spinlock_wait_cycles":3036159872,"thread_start_us":1059770,"threads_started":3,"wal-append.queue_time_us":833882}
I20260709 12:27:20.554234  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.554808  8390 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:20.554876  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:20.555483  8538 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:20.558712 11499 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:20.555687  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.560380  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.561343  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.562245  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.524969 11597 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.563397  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.562877  8390 raft_consensus.cc:2368] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11.
I20260709 12:27:20.562785  8538 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:20.536412 11332 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:20.537209 11604 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.563935  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.567719  8471 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:20.542439 11637 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:20.572872  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.541769 11416 raft_consensus.cc:697] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:20.578148  8393 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:20.559113 11499 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:20.580904  8389 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:20.584026  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.612565  8388 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:20.613123  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.613564  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.614210  8388 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:27:20.584651  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 49455.3us
I20260709 12:27:20.592229  8541 raft_consensus.cc:2410] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:27:20.594069 11416 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:20.597803  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 54175.7us
I20260709 12:27:20.597895 11343 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:20.601578 11597 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:20.602838 11262 consensus_meta.cc:287] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.564s	user 0.009s	sys 0.001s
I20260709 12:27:20.604629 11421 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:20.605507  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 80467.8us
I20260709 12:27:20.574930 11637 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.570994 11332 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.606606 11319 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.609849  8537 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:20.611199 11563 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.625344  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.629562  8362 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:20.623368  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.648402  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.630393  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.631214 11649 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.634016  8388 raft_consensus.cc:2410] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:27:20.643538  8361 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.620674 11352 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:20.655308  8542 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:20.656857  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.657908  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.662313  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.663070  8392 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:20.663854  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.665232  8392 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:27:20.665421  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.665843  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:20.654464 11319 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.666700 11564 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.669863 11299 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:20.670678  9046 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:20.671830 11655 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:20.672214 11655 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.672533 11655 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.673230 11612 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:20.675802  8465 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:20.675685  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 96198.7us
I20260709 12:27:20.675885  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.678683  8512 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:20.644245 11637 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.681159  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.645718 11332 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.683354  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.688876  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:20.601619 11459 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.679479 11340 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:20.657542 11352 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.660364 11343 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:20.675331 11657 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:20.612504 11499 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.693173  8436 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.694638  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.643556 11262 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.672609 11648 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:27:20.701335  8362 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:20.701555  8388 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:27:20.710805  8388 pending_rounds.cc:85] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 5
I20260709 12:27:20.702476  8545 raft_consensus.cc:1240] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:20.667269 11564 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.701267 11651 consensus_queue.cc:1059] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:27:20.719321 11651 raft_consensus.cc:3055] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:20.719717 11651 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:20.720510 11651 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.721657 11651 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.703297  8392 raft_consensus.cc:1275] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:27:20.704177 11421 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:20.715764 11299 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:20.696421 11657 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:20.724071 11299 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:20.724561 11657 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.725030 11299 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.703392 11640 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:20.731611  8392 pending_rounds.cc:85] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 1
I20260709 12:27:20.704607 11262 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:20.705006 11597 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:20.725572 11657 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:20.693812 11082 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:20.713469  8543 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:20.715121 11343 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:20.741107 11343 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:20.742146 11343 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.692396 11639 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:20.695721 11352 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.745304 11596 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.746251 11596 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:20.706212  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62741.7us
I20260709 12:27:20.710839 11563 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.749150  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:20.749747  8391 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.750303 11564 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:20.711153 11642 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:20.731923  8392 pending_rounds.cc:107] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:27:20.711067  8388 pending_rounds.cc:107] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:27:20.751585  8388 raft_consensus.cc:2889] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:20.734438  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:20.754490  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.756588 11459 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:20.751362  8392 raft_consensus.cc:2889] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:20.735809 11675 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.825s	user 0.003s	sys 0.009s
I20260709 12:27:20.739689  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:20.758807  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 64202.3us
W20260709 12:27:20.761597  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 67031.2us
I20260709 12:27:20.762423  8512 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:20.770731  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:20.771494  8293 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 7 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.743327 11343 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.775497  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:20.776800  8292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 293) took 19233 ms (client timeout 15000 ms). Trace:
I20260709 12:27:20.765826 11082 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:20.778987  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.779299  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.779843  8362 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:20.781826  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.782400 11714 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.783977  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:20.784693  8470 raft_consensus.cc:2393] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:20.786208  8470 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:20.796413  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:20.808470 11655 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.811298 11655 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:20.812168 11642 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:20.812605 11642 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:20.812942 11642 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:20.814832 11599 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:27:20.769064 11459 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:20.819897 11459 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:20.820246 11459 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:20.820575 11459 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:20.814486 11332 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.823287  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.823940  8470 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:20.827565  8436 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.828809  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:20.830068  8466 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:20.850068  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1911) took 1071 ms. Trace:
I20260709 12:27:20.850539  8541 rpcz_store.cc:276] 0709 12:27:19.778684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.877907 (+ 99223us) service_pool.cc:224] Handling call
0709 12:27:20.824973 (+947066us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b540003a2d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:20.849996 (+ 25023us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1490843776}
I20260709 12:27:20.853019  8391 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:20.853155  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 465) took 1067 ms. Trace:
I20260709 12:27:20.856106  8395 rpcz_store.cc:276] 0709 12:27:19.785278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.785415 (+   137us) service_pool.cc:224] Handling call
0709 12:27:19.801899 (+ 16484us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:19.854855 (+ 52956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:19.854891 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:19.855495 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:27:19.890224 (+ 34729us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:19.890260 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.890316 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.735254 (+844938us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:20.825083 (+ 89829us) raft_consensus.cc:1685] finished
0709 12:27:20.825103 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.853084 (+ 27981us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54823,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7333,"spinlock_wait_cycles":77000960,"thread_start_us":34378,"threads_started":1,"wal-append.queue_time_us":54500}
I20260709 12:27:20.863802  8543 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:20.855121 11644 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:20.866233  8361 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:20.863569  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 95517us
I20260709 12:27:20.854022 11082 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:20.862346 11343 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:20.863705 11639 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:20.865576 11651 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:27:20.777210  8292 rpcz_store.cc:269] 0709 12:27:01.543641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.547565 (+  3924us) service_pool.cc:224] Handling call
0709 12:27:02.099075 (+551510us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b5400210610. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f64612650b2 00007f646a1de759 00007f646a176a76 00007f646a147d58 00007f646a24604e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc
0709 12:27:03.656190 (+1557115us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f3090 00007f6464391f3a 00007f646a147e9c 00007f646a24604e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc 00007f6468706392 00007f64626c448c 00007f64626c38c6
0709 12:27:20.776503 (+17120313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:08.980743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:08.981278 (+   535us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:08.981313 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:27:08.981331 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:08.982316 (+   985us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:08.982374 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:08.982403 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:27:08.986906 (+  4503us) tablet.cc:701] Row locks acquired
0709 12:27:08.986931 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:27:08.987088 (+   157us) write_op.cc:270] Start()
0709 12:27:08.987197 (+   109us) write_op.cc:276] Timestamp: P: 1783600028987040 usec, L: 0
0709 12:27:08.987218 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:27:09.061815 (+ 74597us) log.cc:844] Serialized 4346 byte log entry
0709 12:27:09.702368 (+640553us) op_driver.cc:464] REPLICATION: finished
0709 12:27:10.844443 (+1142075us) write_op.cc:301] APPLY: starting
0709 12:27:10.851346 (+  6903us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:10.911354 (+ 60008us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:11.036151 (+124797us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:11.186910 (+150759us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:11.187140 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:27:11.187179 (+    39us) write_op.cc:312] APPLY: finished
0709 12:27:11.187506 (+   327us) log.cc:844] Serialized 83 byte log entry
0709 12:27:11.584946 (+397440us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:11.605759 (+ 20813us) write_op.cc:454] Released schema lock
0709 12:27:11.605823 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:11.606251 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:11.606285 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":545908,"reported_tablets":19,"spinlock_wait_cycles":837457024,"child_traces":[["op",{"apply.queue_time_us":1122655,"apply.run_cpu_time_us":40429,"apply.run_wall_time_us":768101,"num_ops":11,"prepare.queue_time_us":154387,"prepare.run_cpu_time_us":4565,"prepare.run_wall_time_us":81395,"replication_time_us":600249,"thread_start_us":1642201,"threads_started":3,"wal-append.queue_time_us":492140,"wal-append.run_cpu_time_us":1226,"wal-append.run_wall_time_us":1035852}]]}
I20260709 12:27:20.872218 11639 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.878592 11639 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:20.874018 11716 log.cc:927] Time spent T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:27:20.875191  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 401833us
I20260709 12:27:20.892585 11082 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.883826 11343 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:20.896430 11343 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:20.902640  8438 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.846s (SENT)
I20260709 12:27:20.903185 11644 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.891546 11651 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:20.904721 11651 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.905800  8465 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:20.907887  8438 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:20.912477  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.920074  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:20.912128  8362 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:20.902853 11459 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.867733 11299 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:27:20.924484  9015 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:20.924561  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:20.926558  9046 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:20.927213  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:20.931689  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 65535us
W20260709 12:27:20.932763  8438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.868s (SENT) [suppressed 52 similar messages]
I20260709 12:27:20.917127 11241 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:20.935997 11714 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:20.949931  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.953507  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:20.952466  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:20.966634  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 101002us
I20260709 12:27:20.963032  9041 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:20.973836  8361 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:20.938675 11599 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:20.910567 11597 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:27:20.963125 11657 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:27:20.980800  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 48078.2us
I20260709 12:27:20.976174 11599 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.963093 11466 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:27:20.988490  8510 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:20.989307 11562 consensus_queue.cc:1059] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:27:20.990116 11563 raft_consensus.cc:3055] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:20.990221 11241 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:20.990495 11563 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:20.991228 11642 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.991377 11563 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:20.992612 11563 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:20.963186 11644 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:27:20.979095 11657 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.968019 11352 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:20.980540 11655 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:20.998826  8438 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.878s (SENT)
I20260709 12:27:20.977665 11262 consensus_queue.cc:1059] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:27:21.001231 11262 raft_consensus.cc:3055] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:21.001549 11262 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:21.002375 11262 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.003610 11644 consensus_queue.cc:1243] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:20.996022 11599 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:21.003867 11525 consensus_queue.cc:1059] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:21.004712 11525 raft_consensus.cc:3055] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:21.005045 11525 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.006276 11262 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:20.997586 11564 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.999501 11657 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:21.014991 11644 raft_consensus.cc:3055] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:21.020783 11644 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:21.021567 11644 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:21.022733  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.024152 11337 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:21.024618 11337 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.025242 11637 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.025843  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 315) took 1198 ms. Trace:
I20260709 12:27:21.026623 11562 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.027108 11562 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.017181  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:20.986367 11724 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:27:21.060839  8395 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:21.075043  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:21.034127  9041 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:21.014528 11082 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.032420  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.084924  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:21.037643 11337 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.033855  9047 raft_consensus.cc:1240] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:21.079175  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:21.027333 11637 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.026185  8546 rpcz_store.cc:276] 0709 12:27:19.827354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.943780 (+116426us) service_pool.cc:224] Handling call
0709 12:27:20.497622 (+553842us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.497807 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:20.497831 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:20.497885 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:20.497918 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.497968 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.025658 (+527690us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54003fb1d0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:21.025765 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1259353984}
I20260709 12:27:21.087232  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:21.087845  8544 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:21.088131  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.071970 11657 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.089764 11525 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.091766  8393 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:21.091874 11657 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:21.085944  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:21.078625 11642 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.094807  8543 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:21.095484  8544 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:21.096634  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:21.097115  8544 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:21.098173  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.098742  8465 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.027283  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:21.100641  8468 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1827) took 1189 ms (client timeout 1572 ms). Trace:
W20260709 12:27:21.101070  8468 rpcz_store.cc:269] 0709 12:27:19.911167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.932761 (+ 21594us) service_pool.cc:224] Handling call
0709 12:27:21.027135 (+1094374us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b58001c7198. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:27:21.100568 (+ 73433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26060672}
I20260709 12:27:21.102838  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.103389  8468 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:21.103623 11725 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:21.100564  8539 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:21.045364  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:21.046352  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:21.110638  8465 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:21.085974  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.091200 11525 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:21.028795  8438 leader_election.cc:336] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.947s (SENT)
I20260709 12:27:21.115052  8469 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:21.115264  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:21.113833  8511 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:21.013128 11459 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:21.000317 11655 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:21.116051  8472 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:21.116847  8395 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:21.121707  8544 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 12.
I20260709 12:27:21.119879  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:21.131032  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 178637us
I20260709 12:27:21.118049 11504 raft_consensus.cc:2804] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:21.040714 11319 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:21.118278  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.086555 11597 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:21.117184  8438 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:21.064911 11719 log.cc:927] Time spent T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:27:21.146643  8471 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:21.081449 11352 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.038772 11649 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:21.121416  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:21.022890 11644 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:21.150635  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.126221 11637 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.144516 11655 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.084954 11562 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:21.160908  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.054349 11639 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.162838  9015 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:21.027921 11564 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:21.163807  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 200227us
I20260709 12:27:21.164961  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.163334 11637 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:21.170795  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.153929 11725 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.153211 11504 raft_consensus.cc:697] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.167312  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.174563  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.174815 11637 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.176578  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:21.185588  8465 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:21.178272 11562 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:21.164342 11262 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:21.204610  8540 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:21.180066 11639 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.070888 11599 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.181392  9016 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.181592  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:21.185521 11726 log.cc:927] Time spent T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 12:27:21.152282 11082 consensus_queue.cc:1059] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:27:21.189288  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 160528us
I20260709 12:27:21.165755 11597 raft_consensus.cc:697] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.219269  8468 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 12.
W20260709 12:27:21.220227  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 52987.5us
I20260709 12:27:21.156582 11387 consensus_queue.cc:1059] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:27:21.173010 11658 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.187392 11713 consensus_queue.cc:1059] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:27:21.207751  8463 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:21.160979 11733 consensus_queue.cc:1059] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:27:21.191227 11562 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.210461 11530 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:21.210594 11690 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.161631 11343 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:27:21.221419  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.186829 11319 consensus_queue.cc:1059] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:27:21.237385  8468 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:21.226179  8393 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:21.210848 11637 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:21.229385  8512 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:21.238932  8438 leader_election.cc:336] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 2.040s (SENT)
I20260709 12:27:21.239089  8512 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.239847  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.230924  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.240622  8392 raft_consensus.cc:2376] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10. Re-sending same reply.
I20260709 12:27:21.241093  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.241349 11655 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.241415 11597 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.243553 11655 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:21.244112 11728 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.243s	user 0.003s	sys 0.000s
I20260709 12:27:21.234885  8397 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:27:21.235657  8394 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:21.239944  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:21.245833  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.234679  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.240784  8389 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:27:21.241427  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.247288  8392 raft_consensus.cc:2393] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:21.245888  8391 raft_consensus.cc:2410] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:21.240228  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.249792  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.252769  8512 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.244141 11655 raft_consensus.cc:3055] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:21.233785 11562 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:21.265158  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 91737.1us
I20260709 12:27:21.232935 11082 consensus_queue.cc:1243] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:21.262919  8463 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:21.254452  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.265313  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.281834  8388 raft_consensus.cc:2376] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7. Re-sending same reply.
I20260709 12:27:21.250900 11530 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:21.286492  8392 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:21.267155  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.267702  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.268170 11642 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:21.269110  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.288305  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.281174  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:21.266965  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.284307  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.287513  8393 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.288901  8391 raft_consensus.cc:3060] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.289541  8389 raft_consensus.cc:2410] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:21.288918  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.291009  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.293574  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.294355  8394 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:21.257786 11459 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:21.256639 11637 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.297670  8390 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:21.298177  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.263818 11655 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:21.318784  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 79871.3us
I20260709 12:27:21.330613  8512 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.313573 11241 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:21.355085  8391 raft_consensus.cc:2468] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:21.354337 11508 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.265861 11504 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.361912 11655 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:21.364307  8438 leader_election.cc:336] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 2.212s (SENT)
I20260709 12:27:21.318066 11459 raft_consensus.cc:697] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.364447  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.312822 11082 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:27:21.367962  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 246608us
I20260709 12:27:21.370042  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:21.363040 11530 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.338873 11596 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:21.338457 11352 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:21.393029  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:21.437397  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.340075 11241 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:21.334828 11723 consensus_queue.cc:1059] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:27:21.486513  8393 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:21.376812 11319 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:21.507615 11508 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.508136 11508 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.510272 11319 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:21.511255 11319 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:21.512683  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 148406us
W20260709 12:27:21.513403  8438 leader_election.cc:336] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 2.274s (SENT)
I20260709 12:27:21.513756  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.514701 11459 consensus_queue.cc:237] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.515477 11637 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.461093 11596 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:21.500253 11599 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:21.537925 11352 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:21.538525 11352 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:21.520879 11730 log.cc:927] Time spent T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:27:21.521653 11564 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.523646 11723 consensus_queue.cc:1243] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:21.492033 11639 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:21.526619  8540 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:21.523561 11644 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:21.531890  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:21.542397  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 178006us
I20260709 12:27:21.479192 11241 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.552124  8469 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:21.540151 11651 raft_consensus.cc:3055] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:21.549377 11733 consensus_queue.cc:1243] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:27:21.535759 11596 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.550942 11564 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.580577  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:21.563365 11713 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:21.593068  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 79738.7us
I20260709 12:27:21.569129 11651 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:21.602056  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 271501us
I20260709 12:27:21.603365  8512 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.630009 11504 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:21.633656  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 55134.7us
W20260709 12:27:21.635589  8438 leader_election.cc:336] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 2.379s (SENT)
I20260709 12:27:21.579460 11562 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.646780  8361 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:21.629642  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:21.656018  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.595950 11564 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:21.661480  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 120991us
I20260709 12:27:21.665355  8512 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.630048 11421 raft_consensus.cc:3055] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:21.666235 11421 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:21.666934 11421 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.667694 11421 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:21.684141  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:21.676203 11525 consensus_meta.cc:287] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
I20260709 12:27:21.674310 11466 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:21.686992  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 59194.7us
W20260709 12:27:21.686755  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.696389  8393 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:21.683781 11658 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.694572 11748 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:21.692343 11745 log.cc:927] Time spent T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:21.703958  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.704742 11082 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.705139  8361 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.705470 11748 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:21.705883 11748 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:21.706410  8361 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.707597  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.708099  8471 raft_consensus.cc:3055] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:21.708494  8471 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:21.709345  8471 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.709703  8361 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.710517  8471 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:21.710948  8361 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.711570 11733 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:21.712124 11733 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:21.712538 11733 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.712908 11733 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:21.713269 11733 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.714901 11748 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.716835 11748 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:21.724229  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.686723 11504 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:21.728428  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.690505 11332 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:21.731964  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 66671.4us
I20260709 12:27:21.690675 11466 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:21.733597  8512 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.694164 11743 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.694989 11352 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:21.737753  8512 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.675275 11651 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.736829 11466 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.752851  8538 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:21.753352  8512 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:21.753767  8438 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 2.610s (SENT)
I20260709 12:27:21.754653  8391 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:21.757442  8438 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.758013  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.739168 11644 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:21.743723 11504 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:21.747588 11750 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:21.765528  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 54650.3us
I20260709 12:27:21.763068 11352 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:21.768416 11352 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.769238 11352 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.759963 11332 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.773387  8512 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.760347 11504 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.774813  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.775292  8391 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.775849 11504 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.777367  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.777958  8465 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:21.761926 11637 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:21.782066  8468 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:21.783169  8467 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:21.785625 11499 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.786710 11508 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:21.788601  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 44325.3us
I20260709 12:27:21.789036  8471 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:21.789996 11564 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.792654 11387 raft_consensus.cc:3055] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:21.793040 11387 raft_consensus.cc:740] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:21.793753  8391 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:21.793917 11387 consensus_queue.cc:260] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.794872 11387 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.796605  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:21.796506  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.773546 11657 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:27:21.779783 11658 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.799718  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.799976  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:21.802325  8471 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:27:21.788278 11562 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.801002  8465 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
I20260709 12:27:21.805927 11508 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.808768  8361 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.800293 11564 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:21.801999 11740 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:21.817582 11758 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:21.817617  8512 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.812893 11740 raft_consensus.cc:697] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:21.820571 11564 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.821020 11740 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.821673  8512 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.823323  8362 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.824978 11504 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.835721 11508 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:21.836282 11564 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:21.836318 11508 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.837934 11508 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.842368  8512 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.844511 11637 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.803694 11644 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.832515  8511 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:21.848255  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:21.846006  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:21.849248  8511 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:21.851987 11241 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:21.855669  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:21.856534 11658 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:21.858677 11658 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:21.845626  8512 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.852994 11640 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:21.853166 11748 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:21.849952  8438 leader_election.cc:336] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 2.908s (SENT)
I20260709 12:27:21.859555 11658 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.860134  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.859647 11640 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.860981 11640 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:21.861474 11596 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.857281  8543 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:21.863456  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.846824  8471 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:21.863937  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.864774  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:21.865629 11759 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:21.866154 11760 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:21.866464 11525 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:21.883791  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:21.884496  9042 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:21.885032  8537 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:21.885947 11755 raft_consensus.cc:3055] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:21.886315 11755 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:21.849831 11352 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:21.888025 11352 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.888375 11352 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.866853 11639 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:21.889098 11639 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:21.867344  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.831616 11758 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:21.870195  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:21.871255  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:21.872915 11466 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.863379  8362 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:21.856108 11241 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:21.857095 11751 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:27:21.877216 11734 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.513s	user 0.000s	sys 0.002s
I20260709 12:27:21.878283 11504 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.864974 11649 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:21.882786  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:21.883267 11741 log.cc:927] Time spent T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.424s	user 0.002s	sys 0.000s
I20260709 12:27:21.890363  8510 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:21.890493  8512 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.891359  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.892308  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.893900  9047 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:21.902762  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:21.903291  8471 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:21.918076  8396 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:21.907128  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.907258  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.905356 11387 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:21.906167  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.888309  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:21.912909  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:21.920176  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:21.923868  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:21.902819  8472 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:27:21.893501 11564 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.934561  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:21.935300  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:21.937702 11713 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:21.919693 11241 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.940613 11241 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.910475 11759 consensus_queue.cc:1243] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:27:21.943789 11725 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:27:21.942600 11241 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.939869  8438 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:21.949150  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 58741.4us
I20260709 12:27:21.951750  8542 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:21.952549  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:21.953131  9049 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:21.955761  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.956264  8391 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:21.957351  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.960614  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.961143  8389 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:21.887130 11755 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.919162 11637 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:21.964823  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.966219 11596 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.967743  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.969516  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.932601 11748 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.970572  8394 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:21.970686  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.976329 11597 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.967785 11759 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.977645  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:21.978305  8388 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:21.978603  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:21.979151  8361 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:21.980645  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:21.981720 11732 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:21.982395 11732 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:21.982929 11732 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:21.983340 11732 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:21.984064  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.977598 11759 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.985991  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:21.986567  8395 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:21.986752  8393 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:21.976858 11597 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:21.988804 11597 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:21.984148 11732 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:21.986405 11759 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:21.951398 11387 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:22.002094  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.002971  9047 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:21.968321 11508 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:22.010854  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:22.013470 11651 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.014465 11525 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:22.014865 11525 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.015177 11525 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.015793 11755 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:22.019474 11466 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:22.005956  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:22.020614  9041 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:22.021832  8540 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:27:22.021987  8544 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:27:22.022254  8542 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:22.024112 11387 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.027266  8545 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:22.028280  8510 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:22.029516 11748 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:22.030103 11649 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.968690 11637 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:22.030579 11649 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.025864 11508 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:22.035640  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.041747 11637 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:22.045822  8464 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:27:22.046043 11508 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.047461 11649 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:22.005766  8391 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:22.007185  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 67384.3us
I20260709 12:27:22.007618  8539 raft_consensus.cc:1240] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 12:27:22.008646  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:22.057196  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 48637.5us
I20260709 12:27:22.011821  8512 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:22.057250  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:22.058709 11743 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:22.062119  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:22.062338  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.058473 11725 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:27:22.062247 11743 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:22.062916  8395 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:22.063891 11743 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.064777  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:22.062916  9046 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:22.064349  8395 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:22.066932  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:22.067682  8539 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:22.003854 11504 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.069080  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.071452  8464 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:22.071574  8389 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:22.060443  8388 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
W20260709 12:27:22.073032  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61289.2us
I20260709 12:27:22.073813  8512 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:22.074810  8395 raft_consensus.cc:3055] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:22.074892 11748 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.075270  8395 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:22.053512 11760 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.076175  8395 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.076434 11760 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.077488  8395 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:22.078754 11760 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:22.011489 11713 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.080194  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:22.090374  8391 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:22.101038  8539 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:27:22.099550  8397 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:22.082414  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:22.082834  9049 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:27:22.084256 11748 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:22.084683 11723 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:22.107695  8438 leader_election.cc:400] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11.
I20260709 12:27:22.108356  8512 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:22.128497  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:22.138542  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.139236  8464 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:22.105017 11725 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.107532 11748 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.084286 11459 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:27:22.133733 11596 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:27:22.131307 11642 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.031s	sys 0.029s
W20260709 12:27:22.147137  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.149899  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 44780.5us
I20260709 12:27:22.150684  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.131582 11241 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:22.149968  8541 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:22.096103 11504 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.139595 11597 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:22.133980 11713 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:27:22.156297  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:22.145738 11748 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:22.154202 11596 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:22.157591  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 70574.6us
I20260709 12:27:22.160858  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:22.166867  8546 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:22.142832 11749 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 12:27:22.154214 11642 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.031s	sys 0.029s
I20260709 12:27:22.171376 11642 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:22.182549  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:22.156795 11725 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:22.203123 11770 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:22.156996 11241 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:22.203472  8361 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.204280  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:22.201122  9014 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:22.206769  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:22.216497  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 65886.4us
I20260709 12:27:22.216602  8394 raft_consensus.cc:606] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:22.217095  8394 raft_consensus.cc:614] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:22.217303  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:22.219070  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:22.208631 11612 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 12:27:22.221000 11766 log.cc:927] Time spent T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:27:22.221467 11612 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:22.221837 11612 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:22.221951  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.223599  8438 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.224265  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.225173  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:22.226125  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:22.226955  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.227864  8470 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:22.223726  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:22.227372  8463 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:22.229559  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.231263  8470 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:22.204813 11511 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.234580  8464 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:22.222622 11612 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.235080  8395 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:22.215171 11715 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:22.208889 11732 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:22.240715 11511 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.241463 11725 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:22.248870  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.200368 11640 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:22.310647  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 87105.8us
I20260709 12:27:22.223618 11723 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:22.218565 11760 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:22.220688 11499 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:22.313323  8542 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:22.315928  8463 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:22.316046  8544 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:22.215344 11713 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:27:22.234387 11332 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.241633 11262 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:22.243009 11715 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:22.333201  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 100964us
W20260709 12:27:22.320586 11776 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:27:22.338568  8392 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:22.340548  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.237933 11597 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:22.341769  8540 raft_consensus.cc:2393] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:22.334069 11770 log.cc:927] Time spent T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:27:22.328116 11612 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:22.328513 11651 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.327699 11499 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:22.372825  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.320204 11563 consensus_queue.cc:1059] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:27:22.374406 11563 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:22.374588  8545 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:22.374866 11563 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:22.375901 11563 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.377647 11563 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.390585  8541 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:22.347769 11262 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:22.396001  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.397351  8391 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:22.399556 11743 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.400044 11715 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.400714  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.401213 11715 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.401422  8391 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:22.384539 11651 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.405431  8541 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:27:22.321183 11642 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.411015  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.324050 11596 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.381347 11499 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:22.427443 11511 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:22.355628 11337 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:27:22.433130 11640 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:22.406592 11651 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:22.411816  8388 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 5: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:22.412174  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.415304  9041 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
I20260709 12:27:22.415697 11504 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:22.450400  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 77657.4us
I20260709 12:27:22.416109 11525 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:22.417155 11775 log.cc:927] Time spent T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:27:22.417423 11761 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:27:22.417682 11762 log.cc:927] Time spent T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:27:22.424974  8463 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:22.390121 11352 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.447896  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.451894  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.402863 11332 consensus_queue.cc:1048] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:27:22.458467  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.459420  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:22.459738 11782 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:27:22.354074 11241 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.473860  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.474556  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.475976  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:22.460667 11783 log.cc:927] Time spent T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:27:22.483011  8393 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:22.483817  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.484748  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.485648  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.486588  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.476328 11332 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.487942 11332 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.489964 11332 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:22.477916 11525 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:22.402675 11725 consensus_queue.cc:1175] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "21c151c99bcf4cbeb819de06e68d95bf" responder_term: 9 status { last_received { term: 8 index: 6 } last_committed_idx: 6 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:22.492070  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.492669  8393 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:22.492883 11748 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.493443  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.493818 11651 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:22.494132  8393 raft_consensus.cc:2368] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:22.494397  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.494951  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.472571 11340 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:27:22.497746  8467 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:22.498680  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:22.499215  8464 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:22.482101 11352 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:22.501510 11743 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:22.502206  8361 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.502890 11743 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:22.503628  8393 raft_consensus.cc:1275] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:27:22.461664 11773 log.cc:927] Time spent T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:27:22.504052 11743 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:22.504063  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:22.505378  8470 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.507941  8361 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:22.509233 11777 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.185s	user 0.004s	sys 0.000s
I20260709 12:27:22.509337  8397 raft_consensus.cc:1275] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:22.462325 11262 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.503692  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:22.513224  8465 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.515002  8391 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:22.516011  8396 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:22.435186 11637 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.354775 11732 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:22.465377 11639 consensus_meta.cc:287] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.001s
I20260709 12:27:22.465631 11597 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.456753 11789 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:27:22.468218  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.469823  8468 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:22.553160  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.482054  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:22.537930  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:22.469202 11781 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.126s	user 0.000s	sys 0.004s
I20260709 12:27:22.553273  8390 raft_consensus.cc:2376] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9. Re-sending same reply.
I20260709 12:27:22.553807  8463 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:22.537532 11759 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.545318  8470 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:22.551653  8465 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:22.542948  8464 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:22.546684 11725 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.597973  8388 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:22.599960  8397 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:22.540467 11740 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 12:27:22.590137 11742 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.052s	sys 0.107s
I20260709 12:27:22.558126 11639 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:22.604493 11742 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.052s	sys 0.107s
I20260709 12:27:22.611276  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.611810  8397 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
W20260709 12:27:22.613404  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 142171us
I20260709 12:27:22.590543 11732 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:27:22.616758  8541 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:22.594844 11725 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.619657  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.620220  8397 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:22.622303  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:22.624588  8464 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:22.624945  8464 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:22.625622  8464 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.628958  8464 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:22.613698 11499 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:22.627455 11774 log.cc:927] Time spent T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.151s	user 0.000s	sys 0.004s
I20260709 12:27:22.647270  8464 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:22.669217  9042 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:22.677587  8464 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:22.667076 11748 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:22.675987 11637 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:22.692044 11795 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:22.695482  8472 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:22.696919  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.697595  8396 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
W20260709 12:27:22.699818 11769 log.cc:927] Time spent T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.375s	user 0.000s	sys 0.003s
I20260709 12:27:22.704164 11499 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:22.714187  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 169215us
I20260709 12:27:22.718792  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:22.719769 11639 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:22.795022 11740 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.797122  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:22.796640  8396 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:22.798468 11740 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.819929  8546 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:27:22.823819 11740 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:22.827020  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.827771  8469 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:27:22.798751 11725 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:22.828966  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:22.818092 11796 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:22.829737  8546 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 5.
I20260709 12:27:22.830130 11796 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.832855 11796 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:22.834662  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.835461  8396 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:22.837448 11599 raft_consensus.cc:3055] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:22.799613 11803 log.cc:927] Time spent T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.111s	user 0.004s	sys 0.000s
I20260709 12:27:22.837843 11599 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:22.841303 11599 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:22.842707 11599 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:22.846225 11499 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:27:22.850342  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.852094  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.853499 11740 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:22.853621  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:22.858480  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.860211 11796 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:22.861510  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:22.863018  8438 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.864038  8438 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.860018 11262 consensus_queue.cc:1059] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:22.865156 11262 raft_consensus.cc:3055] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:22.865549 11262 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:22.822685 11655 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:22.865675  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:22.866074 11499 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:22.886029 11796 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.871421 11725 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:22.886029 11340 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:22.871222 11793 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:22.908066  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 44074.1us
I20260709 12:27:22.909963  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:22.935618 11806 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:27:22.939875  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:22.940533  8394 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:22.947227  8438 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:22.948298  8469 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:22.951035  8394 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:27:22.970213 11810 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:22.970559 11725 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:27:22.905561 11262 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:22.975029 11815 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:22.981021 11797 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.289s	user 0.000s	sys 0.004s
I20260709 12:27:22.983613 11740 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:22.979658 11715 consensus_meta.cc:287] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.005s
I20260709 12:27:22.986279  8389 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:27:22.987815  8438 leader_election.cc:400] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:23.021057  8438 leader_election.cc:403] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:22.926949 11340 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:22.999694 11640 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.008296  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:23.032521  9014 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:23.034170  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 46485.1us
I20260709 12:27:23.041250  8438 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:23.049065  8469 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:23.029313 11725 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8.
I20260709 12:27:23.039552 11563 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:23.021101 11815 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:23.025590 11640 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.040728 11262 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:23.067950  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:23.066485  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:23.069070  8464 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:27:23.070130  8469 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 6: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:23.046180 11340 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:23.068421  8438 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:23.078752  8465 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:23.081609  8392 raft_consensus.cc:2410] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:23.081614  8470 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:23.065466 11563 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.090481  8464 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:23.091105  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:23.092288  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 51537.3us
W20260709 12:27:23.096297  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 57065.7us
I20260709 12:27:23.084146 11715 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:23.083395 11651 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.093847 11819 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.094640 11563 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.106628 11640 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:23.107930  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:23.104895 11340 consensus_queue.cc:1048] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:27:23.119444  8464 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:23.118208  8438 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:23.101145 11651 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.151611  8512 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:23.153990  8393 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:27:23.154389  8393 pending_rounds.cc:85] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 4
I20260709 12:27:23.154613  8393 pending_rounds.cc:107] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:27:23.154838  8393 raft_consensus.cc:2889] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.155723 11564 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:27:23.161478 11805 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:23.161933 11805 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:23.162263 11805 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:23.174345  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47412 (request call id 495) took 1249 ms. Trace:
I20260709 12:27:23.174831  9042 rpcz_store.cc:276] 0709 12:27:21.925381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:21.934285 (+  8904us) service_pool.cc:224] Handling call
0709 12:27:23.174158 (+1239873us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b540063fbd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:23.174262 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269973248}
W20260709 12:27:23.181216  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 70314.9us
I20260709 12:27:23.118302 11723 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:27:23.121991 11725 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:27:23.184600  8438 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:23.192149  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:23.150040 11459 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.150116 11340 raft_consensus.cc:2764] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:27:23.195013  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:23.156773 11821 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.119232 11819 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.194511 11715 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:23.212546  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:23.211292  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.194303 11649 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:23.197029 11564 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:27:23.220428  8511 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:23.222383  8511 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:23.223201  8511 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:23.212807 11715 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.214366 11352 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:27:23.200816 11639 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:27:23.215888 11649 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.215579 11340 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:23.202836 11459 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.203297 11821 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.223976 11749 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:23.271632 11715 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.274823 11340 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.272691 11525 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:23.274674 11597 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:23.272540 11649 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.298339 11750 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:23.303992 11749 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.298689 11642 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:27:23.321046 11597 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:23.310410 11340 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:23.332669  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.332767 11597 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:23.297710  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 185797us
I20260709 12:27:23.318265 11525 raft_consensus.cc:697] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:23.344863  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.380081 11525 consensus_queue.cc:237] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.380683 11459 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:23.340538 11815 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:23.348624  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:23.342227 11530 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.389020 11530 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:23.390293  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:23.390677  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:23.391040  8542 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:23.324481 11749 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.355934  8361 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:23.394953 11815 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:23.395437 11815 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:23.395804  9042 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:27:23.396250 11815 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:23.397334  9044 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:27:23.356568 11821 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:23.357411 11819 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:23.334591 11750 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:23.398046 11749 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:23.399441  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 170659us
I20260709 12:27:23.391124 11530 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:23.412593  8389 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:23.417351  8389 raft_consensus.cc:606] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:23.417689  8389 raft_consensus.cc:614] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:23.413357 11820 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:23.414053 11733 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:23.416776  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:23.419023  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:23.419703  9044 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:23.423623  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:23.433094  8472 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:23.436797  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:23.436910  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:23.437553  8464 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:23.408407 11796 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:23.379490  9041 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
W20260709 12:27:23.439064  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 102664us
I20260709 12:27:23.437783  8472 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:23.445611  8465 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:23.447208  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:23.450801  8466 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:23.448923  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:23.448446  8465 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:23.448648  8469 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:23.457423  9044 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:23.453058  8465 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.468914  8397 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:23.471464  8362 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:23.473023  8465 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.474997  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:23.476341  8471 raft_consensus.cc:2410] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:27:23.477748  8436 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:23.421190 11819 consensus_queue.cc:1059] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:27:23.420967 11459 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:27:23.415390 11805 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.424314 11241 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:27:23.424840 11508 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:27:23.450995 11658 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:23.434602 11816 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:27:23.457808 11499 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:27:23.514544 11658 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.518175 11725 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:27:23.522503 11658 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.514575  8465 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:23.509204  8362 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:23.448159 11838 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:23.547827 11525 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:23.549744 11525 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.508180 11563 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:23.563077  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1679) took 1127 ms. Trace:
I20260709 12:27:23.563462  8393 rpcz_store.cc:276] 0709 12:27:22.435507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.504339 (+ 68832us) service_pool.cc:224] Handling call
0709 12:27:23.083595 (+579256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:23.155231 (+ 71636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.562234 (+407003us) spinlock_profiling.cc:243] Waited 70 ms on lock 0x7b5400288054. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:23.562895 (+   661us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400288050. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:23.563022 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1492587776}
I20260709 12:27:23.564230 11563 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:23.574014 11651 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:23.581787  8293 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 253) took 22305 ms (client timeout 15000 ms). Trace:
W20260709 12:27:23.582278  8293 rpcz_store.cc:269] 0709 12:27:01.265534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.265650 (+   116us) service_pool.cc:224] Handling call
0709 12:27:23.571326 (+22305676us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:20.788779 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:20.789452 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:20.789498 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:27:20.789530 (+    32us) tablet.cc:662] Decoding operations
0709 12:27:20.790236 (+   706us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:20.790451 (+   215us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:20.790474 (+    23us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:20.791117 (+   643us) tablet.cc:701] Row locks acquired
0709 12:27:20.791160 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:27:20.791329 (+   169us) write_op.cc:270] Start()
0709 12:27:20.791498 (+   169us) write_op.cc:276] Timestamp: P: 1783600040791267 usec, L: 0
0709 12:27:20.791517 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:27:20.792145 (+   628us) log.cc:844] Serialized 2059 byte log entry
0709 12:27:21.523036 (+730891us) op_driver.cc:464] REPLICATION: finished
0709 12:27:22.341480 (+818444us) spinlock_profiling.cc:243] Waited 8.58 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f646127f0ac 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6467dbfef0
0709 12:27:22.610432 (+268952us) write_op.cc:301] APPLY: starting
0709 12:27:22.618112 (+  7680us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:22.630330 (+ 12218us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:22.639726 (+  9396us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:22.794929 (+155203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:22.795792 (+   863us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:27:22.797360 (+  1568us) write_op.cc:312] APPLY: finished
0709 12:27:22.837498 (+ 40138us) log.cc:844] Serialized 47 byte log entry
0709 12:27:22.921777 (+ 84279us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.924047 (+  2270us) write_op.cc:454] Released schema lock
0709 12:27:22.927905 (+  3858us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:22.976825 (+ 48920us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.976871 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3531641,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":1081660,"apply.run_cpu_time_us":29362,"apply.run_wall_time_us":371806,"num_ops":5,"prepare.queue_time_us":11691,"prepare.run_cpu_time_us":35607,"prepare.run_wall_time_us":74277,"raft.queue_time_us":189907,"raft.run_cpu_time_us":159680,"raft.run_wall_time_us":1155619,"replication_time_us":705361,"spinlock_wait_cycles":19728128,"thread_start_us":1331397,"threads_started":5,"wal-append.queue_time_us":244357,"wal-append.run_cpu_time_us":22717,"wal-append.run_wall_time_us":1377529}]]}
W20260709 12:27:23.587852  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 144298us
W20260709 12:27:23.450243  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:23.450675 11796 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:23.591427  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 65765.1us
I20260709 12:27:23.457484 11340 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.472730 11644 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:27:23.513356  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:23.607471  8390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:23.544418 11838 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:23.590406 11821 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:23.611742  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 102620us
I20260709 12:27:23.610922  8390 raft_consensus.cc:606] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:23.616211  8390 raft_consensus.cc:614] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:27:23.615715  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 173996us
I20260709 12:27:23.599296 11723 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:23.593523 11840 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:27:23.629240  8464 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:23.634079  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:23.606933 11262 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:23.610137 11819 consensus_queue.cc:1243] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:27:23.604166  8282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 156356us
I20260709 12:27:23.612680 11815 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:23.615903 11820 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:23.486088 11750 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.619668 11821 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.647464 11827 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:27:23.648196 11778 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:27:23.649515 11796 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:23.649883 11848 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:23.660413  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:23.633896 11387 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.681839  8465 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.651041 11723 consensus_queue.cc:1059] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:27:23.680742  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:23.688489  8471 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
W20260709 12:27:23.689361  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 50804.9us
I20260709 12:27:23.690135  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:23.629281 11715 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.648124 11749 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:23.654592 11820 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.676584 11821 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:23.605823 11658 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.692864 11848 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.643683 11262 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:23.708015  9041 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:23.723574  8362 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:23.729887 11845 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:27:23.717326 11644 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.674585 11815 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:23.718344 11820 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.713546  8465 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:23.752079  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:23.761773  8390 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:23.765159  8388 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:23.724893 11740 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.802827  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:23.792740  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:23.813488  8544 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:23.817186  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:23.846127  8538 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:27:23.846704  8538 pending_rounds.cc:85] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 3
I20260709 12:27:23.846999  8538 pending_rounds.cc:107] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:27:23.847285  8538 raft_consensus.cc:2889] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.882445  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:23.883347  8537 raft_consensus.cc:2393] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:23.887084  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:23.908938  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:23.909663  8388 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.910665  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:23.720443 11759 consensus_queue.cc:1059] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:27:23.935520  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:23.936190  8538 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.936283  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:23.937006  8465 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.733016 11848 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:23.727752 11760 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:27:23.942410  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:23.943071  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:23.958899  8395 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:23.945693  8388 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:23.710578 11387 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:23.960493  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:23.961022  8388 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:23.736904 11499 raft_consensus.cc:3055] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:23.964583  8465 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:23.762403 11819 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:23.978212  8393 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:23.813517  8390 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:23.777182 11651 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:23.982586  8466 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:27:23.982955  8466 pending_rounds.cc:85] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 6
I20260709 12:27:23.983165  8466 pending_rounds.cc:107] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:27:23.974905  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:23.979534  8538 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6.
I20260709 12:27:23.983383  8466 raft_consensus.cc:2889] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.988847  8388 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:23.983852  8541 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:23.998076  8510 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:24.000546  8466 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:27:23.712065 11838 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:23.976028 11842 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 12:27:24.022750  8395 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:24.033130  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:24.035799 11836 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.036384 11836 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.038371 11836 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:23.812072 11823 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.237s
I20260709 12:27:23.766788 11644 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.060606 11644 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:23.979331 11499 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:24.062431 11499 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.063553 11499 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:24.058269 11332 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:24.064507 11332 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.066401 11332 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.049558  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:24.067761  8396 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:24.068956 11846 log.cc:927] Time spent T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.420s	user 0.001s	sys 0.006s
I20260709 12:27:24.058350 11857 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:24.071801 11857 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.074023 11857 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:24.003019 11651 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.082234 11651 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.081988  8396 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:24.086719  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:24.091573  8396 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:24.098623 11262 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:24.049191 11749 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:24.100639 11749 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.102751 11749 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:24.104300 11815 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.107302  8394 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:24.109306 11658 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:24.107596  8396 raft_consensus.cc:3055] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:24.112388 11715 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.028687 11851 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.114363 11851 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.112546  8396 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:24.116690 11851 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:24.028328 11459 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:24.117735 11459 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:24.118657 11459 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:23.985417 11805 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:23.821640 11740 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:23.995393 11854 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.003386 11596 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:24.030571 11844 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.420s	user 0.000s	sys 0.001s
I20260709 12:27:24.122457  8396 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.090183 11864 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.030375 11340 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.044772  9042 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:27:24.143347  8396 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:24.139562  8391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.051s	sys 0.081s
I20260709 12:27:23.978768 11819 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:24.184227  8391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.051s	sys 0.085s
W20260709 12:27:24.142676 11649 consensus_meta.cc:287] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.822s	user 0.007s	sys 0.002s
I20260709 12:27:24.200033  8396 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:27:24.204049 11649 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.152021 11499 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:27:24.204739  8396 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:24.207121 11760 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:24.207335 11732 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:24.207780 11760 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.207944 11732 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.209910 11760 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.210202 11732 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.212008  8396 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:24.213335 11732 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:24.214151 11732 consensus_queue.cc:1243] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:27:24.214604 11760 raft_consensus.cc:3055] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:24.214986 11760 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:24.215631  8470 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:24.215884 11760 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.215029  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:24.235479  8436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.011s	sys 0.004s
W20260709 12:27:24.244422  8436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.004s
W20260709 12:27:24.244737  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 602159us
I20260709 12:27:24.183053 11241 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:24.283123  8390 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:24.278338  8436 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:24.288028  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:24.288640  8538 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:24.292795  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:24.294735  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:24.291692  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:24.298099  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:24.295040  8542 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:24.151782 11864 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.145646 11596 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.145834 11854 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.278868  8392 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.000s	sys 0.023s
I20260709 12:27:24.189761 11819 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:24.390677  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 455817us
W20260709 12:27:24.385349  8463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.049s	sys 0.074s
W20260709 12:27:24.546293  8392 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.000s	sys 0.023s
W20260709 12:27:24.543540  8463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.813s	user 0.049s	sys 0.074s
I20260709 12:27:24.216814 11649 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.342237  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:24.591502  8465 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.026s	sys 0.037s
W20260709 12:27:24.592654  8465 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.026s	sys 0.037s
W20260709 12:27:24.279304 11640 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.005s	sys 0.015s
I20260709 12:27:24.278137 11644 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.277886 11815 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:24.494427 11821 consensus_meta.cc:287] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.000s
I20260709 12:27:24.653177  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 503) took 1044 ms. Trace:
I20260709 12:27:24.457623 11743 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:24.353932 11843 log.cc:927] Time spent T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.559s	user 0.000s	sys 0.001s
I20260709 12:27:24.338447 11723 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.362180 11760 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:24.300072 11851 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:24.341454 11715 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:24.362349 11820 consensus_meta.cc:287] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.546s	user 0.002s	sys 0.004s
I20260709 12:27:24.385783 11808 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:24.495967 11839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.937s	user 0.022s	sys 0.024s
I20260709 12:27:24.281248 11651 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.348s
W20260709 12:27:24.626410  8472 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.015s	sys 0.007s
W20260709 12:27:24.686293  8472 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.015s	sys 0.007s
I20260709 12:27:24.457638 11332 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.574934 11822 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:24.575047 11856 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:24.449263 11655 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:24.619901 11640 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.005s	sys 0.015s
I20260709 12:27:24.653976  9044 rpcz_store.cc:276] 0709 12:27:23.609220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.609374 (+   154us) service_pool.cc:224] Handling call
0709 12:27:23.609662 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.609995 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.610022 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.615538 (+  5516us) log.cc:844] Serialized 26 byte log entry
0709 12:27:23.816143 (+200605us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:23.816183 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:23.816248 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:24.652934 (+836686us) raft_consensus.cc:1685] finished
0709 12:27:24.652953 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.653105 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":464,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4236,"thread_start_us":141090,"threads_started":1,"wal-append.queue_time_us":702884}
I20260709 12:27:24.363862 11740 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.588762 11836 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.366765 11387 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.591113 11530 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:24.591344 11825 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:24.591547 11870 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.625504 11649 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.300587 11241 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.482930 11848 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.591854 11823 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 12:27:24.684980  9016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.017s	sys 0.067s
I20260709 12:27:24.687851 11820 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:24.687161  8471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.025s	sys 0.060s
I20260709 12:27:24.674742 11352 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.677676 11642 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.656567 11644 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:24.684194 11839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.026s	sys 0.028s
I20260709 12:27:24.656736 11815 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.661291 11821 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.676258 11743 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.700481 11871 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:24.678424 11723 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.749094  9016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.017s	sys 0.068s
I20260709 12:27:24.686391 11808 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:24.769451  8471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.027s	sys 0.067s
W20260709 12:27:24.771073  8362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.004s	sys 0.014s
I20260709 12:27:24.700839 11332 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.683811 11715 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.792539  8394 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:27:24.792816  8362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.005s	sys 0.015s
I20260709 12:27:24.793243  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1704) took 1348 ms. Trace:
W20260709 12:27:24.795255  8467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.006s	sys 0.017s
I20260709 12:27:24.747637 11740 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.798573  8389 raft_consensus.cc:2393] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:24.798739  8468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.004s	sys 0.017s
W20260709 12:27:24.798856  8467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.006s	sys 0.017s
I20260709 12:27:24.714371 11655 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.752766 11838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.006s	sys 0.025s
W20260709 12:27:24.752640 11750 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.017s	sys 0.011s
W20260709 12:27:24.799324  8544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.007s	sys 0.014s
I20260709 12:27:24.749251 11840 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.793644  8391 rpcz_store.cc:276] 0709 12:27:23.444731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.444831 (+   100us) service_pool.cc:224] Handling call
0709 12:27:23.445080 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.445394 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.445420 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.451485 (+  6065us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.191134 (+739649us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:24.351696 (+160562us) spinlock_profiling.cc:243] Waited 2.51 ms on lock 0x7b48002a0258. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64692b2aa1 00007f64692a9b37 00007f64692a99ca 00007f64693a126f 00007f64693a0f37 00007f64693b555c 00007f64693b5508 00007f64693b5488 00007f64693b5443 00007f64693b46ec 00007f64682dea96
0709 12:27:24.770838 (+419142us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.789113 (+ 18275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.789191 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:24.789235 (+    44us) raft_consensus.cc:1685] finished
0709 12:27:24.789319 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.793180 (+  3861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21418,"prepare.queue_time_us":167819,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":386,"raft.run_cpu_time_us":7611,"raft.run_wall_time_us":904337,"spinlock_wait_cycles":5770496,"thread_start_us":1182014,"threads_started":2,"wal-append.queue_time_us":1010553}
W20260709 12:27:24.799106  8468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.004s	sys 0.017s
W20260709 12:27:24.801694  8464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.014s	sys 0.013s
W20260709 12:27:24.802070  8464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.014s	sys 0.013s
I20260709 12:27:24.749251 11649 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.721639 11530 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.800653  8544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.007s	sys 0.014s
W20260709 12:27:24.799599 11838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.006s	sys 0.025s
W20260709 12:27:24.799984 11847 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.003s	sys 0.024s
I20260709 12:27:24.724015 11836 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.808010  8537 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.014s	sys 0.008s
I20260709 12:27:24.703236 11856 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:24.743654 11825 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.809324  8466 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.019s	sys 0.008s
W20260709 12:27:24.801841 11750 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.019s	sys 0.012s
W20260709 12:27:24.805047 11793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.003s	sys 0.017s
I20260709 12:27:24.784989 11352 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.788012 11642 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.743737 11870 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:24.796207 11871 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.888535  8541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.008s	sys 0.032s
W20260709 12:27:24.991281  8537 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.025s	sys 0.022s
W20260709 12:27:24.991657  8466 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.022s	sys 0.014s
I20260709 12:27:24.992717  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1814) took 1239 ms. Trace:
I20260709 12:27:24.799974 11865 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:25.037233  8393 rpcz_store.cc:276] 0709 12:27:23.752823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.752959 (+   136us) service_pool.cc:224] Handling call
0709 12:27:23.753263 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:23.978573 (+225310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.992457 (+1013884us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54001428d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:24.992650 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516583168}
W20260709 12:27:25.032441  8390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.018s	sys 0.029s
I20260709 12:27:25.038669 11823 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:25.065220 11823 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:24.838934 11599 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.004s	sys 0.030s
W20260709 12:27:25.066121 11599 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.010s	sys 0.056s
W20260709 12:27:24.810058 11847 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.080s	user 0.003s	sys 0.024s
W20260709 12:27:25.063469  8390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.018s	sys 0.029s
W20260709 12:27:24.989851 11860 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.312s	user 0.002s	sys 0.000s
W20260709 12:27:24.987089 11796 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.253s	user 0.020s	sys 0.021s
I20260709 12:27:24.813463 11596 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:24.838898 11651 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:24.808502 11835 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:25.072779 11530 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.073383 11836 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.074155 11821 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.074959 11854 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.076615 11871 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.077106 11715 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:24.805049 11840 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:25.036525 11793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.005s	sys 0.024s
I20260709 12:27:24.806845 11740 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:25.067314 11823 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:25.080075 11796 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.350s	user 0.022s	sys 0.021s
W20260709 12:27:25.090328  8512 connection.cc:256] RPC call timeout handler was delayed by -1.2759913210002196s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
I20260709 12:27:25.094028  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:25.069890 11865 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:25.122130 11868 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.290s	user 0.000s	sys 0.001s
I20260709 12:27:25.069337 11340 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:25.099697 11875 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 12:27:25.094524 11241 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:25.094892 11864 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.091892 11651 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:25.324110  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1896) took 1388 ms. Trace:
I20260709 12:27:25.323457  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:25.293910  9016 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.027s	sys 0.035s
I20260709 12:27:25.193222  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 2058) took 1180 ms. Trace:
I20260709 12:27:25.335739  8466 rpcz_store.cc:276] 0709 12:27:23.935637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.001944 (+ 66307us) service_pool.cc:224] Handling call
0709 12:27:24.007002 (+  5058us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:24.055109 (+ 48107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.055143 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:24.055716 (+   573us) log.cc:844] Serialized 52 byte log entry
0709 12:27:25.063292 (+1007576us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:25.063333 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.063403 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.323891 (+260488us) raft_consensus.cc:1685] finished
0709 12:27:25.323911 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.324049 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47387,"raft.queue_time_us":72726,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"thread_start_us":843355,"threads_started":1,"wal-append.queue_time_us":1120643}
I20260709 12:27:25.184700  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1888) took 1736 ms. Trace:
W20260709 12:27:25.313922  8362 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.020s	sys 0.014s
W20260709 12:27:25.338863  8362 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.020s	sys 0.014s
I20260709 12:27:25.201218  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1707) took 1231 ms. Trace:
W20260709 12:27:25.186823  8389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1817) took 1433 ms (client timeout 1804 ms). Trace:
I20260709 12:27:25.201786  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 1945) took 1387 ms. Trace:
W20260709 12:27:25.338090  9016 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.028s	sys 0.037s
W20260709 12:27:25.337131  8512 connection.cc:256] RPC call timeout handler was delayed by -1.1058913210003993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
I20260709 12:27:25.341002  8467 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1893) took 1406 ms. Trace:
W20260709 12:27:25.345510  8512 connection.cc:256] RPC call timeout handler was delayed by -1.0410913210002946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1876s for a response
I20260709 12:27:25.334698  8436 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:25.347846 11352 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.348253 11793 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:25.284070 11655 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.348734 11793 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:25.346313 11340 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:25.349720 11793 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:25.342568 11733 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.351392 11340 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.351840 11733 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:25.341050  8389 rpcz_store.cc:269] 0709 12:27:23.753775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.753870 (+    95us) service_pool.cc:224] Handling call
0709 12:27:25.186600 (+1432730us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54003dead4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:25.186738 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255120128}
I20260709 12:27:25.354635 11733 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.355211  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.356467  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.357406 11793 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:25.358762  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1887) took 1912 ms. Trace:
I20260709 12:27:25.345379  8467 rpcz_store.cc:276] 0709 12:27:23.934859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.936255 (+  1396us) service_pool.cc:224] Handling call
0709 12:27:23.984652 (+ 48397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.132543 (+147891us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.132577 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.149050 (+ 16473us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.799250 (+650200us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:24.799291 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.799355 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.340793 (+541438us) raft_consensus.cc:1685] finished
0709 12:27:25.340815 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.340949 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66667,"raft.queue_time_us":95049,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":526713,"threads_started":1,"wal-append.queue_time_us":944273}
I20260709 12:27:25.341533  8544 rpcz_store.cc:276] 0709 12:27:23.814270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.815971 (+  1701us) service_pool.cc:224] Handling call
0709 12:27:23.845771 (+ 29800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.986779 (+141008us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.986811 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.026540 (+ 39729us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.805821 (+779281us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:24.805860 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.805927 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.201603 (+395676us) raft_consensus.cc:1685] finished
0709 12:27:25.201620 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.201731 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":140621,"raft.queue_time_us":149103,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":39788,"spinlock_wait_cycles":66176,"thread_start_us":659675,"threads_started":1,"wal-append.queue_time_us":956474}
W20260709 12:27:25.351315 11760 consensus_meta.cc:287] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.002s
I20260709 12:27:25.198510 11332 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.197242 11649 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.338429  8468 rpcz_store.cc:276] 0709 12:27:23.448774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.448880 (+   106us) service_pool.cc:224] Handling call
0709 12:27:23.474333 (+ 25453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.736445 (+262112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.736475 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.764185 (+ 27710us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.801169 (+1036984us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:24.801209 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.801274 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.184489 (+383215us) raft_consensus.cc:1685] finished
0709 12:27:25.184509 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.184640 (+   131us) inbound_call.cc:177] Queueing success response
0709 12:27:25.190086 (+  5446us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b4800231e58. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64692b2aa1 00007f64692a9b37 00007f64692a99ca 00007f64693a126f 00007f64693a0f37 00007f64693b555c 00007f64693b5508 00007f64693b5488 00007f64693b5443 00007f64693b46ec 00007f64682dea96
Metrics: {"mutex_wait_us":47818,"raft.queue_time_us":115370,"raft.run_cpu_time_us":17426,"raft.run_wall_time_us":1596456,"spinlock_wait_cycles":11100544,"thread_start_us":1059047,"threads_started":2,"wal-append.queue_time_us":1186123}
I20260709 12:27:25.123363 11644 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.341202  8390 rpcz_store.cc:276] 0709 12:27:23.969937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.283937 (+314000us) service_pool.cc:224] Handling call
0709 12:27:24.284277 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.284689 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.284718 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.285186 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:27:25.068155 (+782969us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:25.068194 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.068257 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.201010 (+132753us) raft_consensus.cc:1685] finished
0709 12:27:25.201029 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.201155 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3566,"raft.queue_time_us":96,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":38318,"thread_start_us":582814,"threads_started":1,"wal-append.queue_time_us":861917}
W20260709 12:27:25.363348  8512 connection.cc:256] RPC call timeout handler was delayed by -1.0050913210002363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
I20260709 12:27:25.382222 11750 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.382875 11750 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:25.379072  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:25.383704  8512 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:25.384539 11755 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:25.115950 11854 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.368078  8466 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:27:25.199201 11881 log.cc:927] Time spent T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:25.376379  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:25.187884 11838 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
I20260709 12:27:25.123669 11715 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.374805  8463 rpcz_store.cc:276] 0709 12:27:23.446226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.446331 (+   105us) service_pool.cc:224] Handling call
0709 12:27:23.468811 (+ 22480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.712964 (+244153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.712997 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.713480 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.554415 (+840935us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:24.554460 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.554541 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.358589 (+804048us) raft_consensus.cc:1685] finished
0709 12:27:25.358608 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.358712 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30622,"raft.queue_time_us":120192,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":3944,"thread_start_us":1047146,"threads_started":2,"wal-append.queue_time_us":1072596}
I20260709 12:27:25.339573  8464 rpcz_store.cc:276] 0709 12:27:24.012934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.063629 (+ 50695us) service_pool.cc:224] Handling call
0709 12:27:24.063904 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.124550 (+ 60646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.124583 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.125049 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.802502 (+677453us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:24.802542 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.802612 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.192983 (+390371us) raft_consensus.cc:1685] finished
0709 12:27:25.193004 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.193160 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60274,"raft.queue_time_us":67228,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":11655,"thread_start_us":606150,"threads_started":1,"wal-append.queue_time_us":945456}
I20260709 12:27:25.182526 11740 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:25.381475  8395 raft_consensus.cc:2410] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:25.382256 11596 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:25.383061 11564 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:25.381016 11829 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.196076 11808 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.193943 11870 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.185487  8294 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 5 to 7, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:25.313609 11387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.024s
I20260709 12:27:25.115526 11820 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.092114 11835 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:25.272500 11743 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.203135 11840 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:25.391803  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:25.385669  8512 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:25.396101  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.387483  9015 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:25.395576  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:25.385578 11778 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.656s	user 0.002s	sys 0.020s
I20260709 12:27:25.401544  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.453966  8464 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:25.454859  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.330443 11825 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.409758  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.411646  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1890) took 1956 ms. Trace:
I20260709 12:27:25.416707  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.380679 11340 consensus_queue.cc:1059] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:27:25.463688  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:25.389320 11755 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:25.464632  8539 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:25.396947 11352 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:25.455544 11241 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:25.389878 11459 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:27:25.467384 11820 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.468480 11820 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:25.469110 11865 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.412866 11596 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:25.417318 11387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.000s	sys 0.025s
I20260709 12:27:25.439254 11793 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.401625 11649 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.389799 11642 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:25.446198  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 61518.6us
I20260709 12:27:25.446684 11839 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:25.443361  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:25.443358  8294 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 3 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 5 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:25.451824  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 66221.2us
I20260709 12:27:25.452939  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:25.395745 11854 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:25.458151  8467 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:25.458130  8472 rpcz_store.cc:276] 0709 12:27:23.455674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.455824 (+   150us) service_pool.cc:224] Handling call
0709 12:27:23.456121 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.728971 (+272850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.729002 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.797639 (+ 68637us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.686677 (+889038us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:24.686718 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.686793 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.411455 (+724662us) raft_consensus.cc:1685] finished
0709 12:27:25.411472 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:25.411592 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14542,"raft.queue_time_us":104089,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5678,"thread_start_us":973032,"threads_started":2,"wal-append.queue_time_us":868507}
W20260709 12:27:25.409257  8435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.004s	sys 0.020s
I20260709 12:27:25.465595  8362 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:25.467666  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:25.453646 11778 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.724s	user 0.002s	sys 0.021s
I20260709 12:27:25.468000  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:25.411605 11715 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:25.473762  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:25.475684  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 189746us
I20260709 12:27:25.467329  8469 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:25.456074 11750 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.467507 11352 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:25.415845 11829 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:25.539057  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 213019us
I20260709 12:27:25.502573  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:25.998697  9049 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:25.999023  8543 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:25.999802 11332 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.000403 11332 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:25.815179 11759 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:26.002496 11332 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.002983 11525 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:25.577478 11909 log.cc:927] Time spent T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:27:26.003796 11839 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:26.004400  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:25.467847 11241 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:25.999313  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:25.498847 11835 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.499894 11651 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.467471 11755 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:26.008118 11649 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.011253  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.014429 11649 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:25.529577 11564 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:26.001610 11759 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:25.999765  9041 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:27:25.834882 11905 log.cc:927] Time spent T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
I20260709 12:27:26.018329 11715 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:25.501890  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:26.019894  8540 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:26.019178  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:25.467775 11743 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:26.023607  8541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.010s	sys 0.011s
I20260709 12:27:25.997767  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:25.476291  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.006300  8294 catalog_manager.cc:5697] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 5 to 7, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:26.032235  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 566678us
I20260709 12:27:26.032685  8294 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 4 to 6, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 6 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.039602  8390 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:26.040603  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:25.998121 11829 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.031670  8538 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:27:26.030719  8541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.010s	sys 0.011s
I20260709 12:27:26.047260  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1917) took 1760 ms. Trace:
I20260709 12:27:26.049475  8541 rpcz_store.cc:276] 0709 12:27:24.287002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.287145 (+   143us) service_pool.cc:224] Handling call
0709 12:27:24.341661 (+ 54516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.341879 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:25.032849 (+690970us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.046934 (+1014085us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.046993 (+    59us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:26.047042 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.047108 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.047214 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26652,"prepare.queue_time_us":137697,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":35168,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":20755,"spinlock_wait_cycles":33348096,"thread_start_us":1653094,"threads_started":3,"wal-append.queue_time_us":441917}
I20260709 12:27:26.054100  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.031090  8539 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:26.085601  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:25.988873 11819 consensus_meta.cc:287] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.400s	user 0.010s	sys 0.000s
W20260709 12:27:25.587860 11858 log.cc:927] Time spent T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.839s	user 0.003s	sys 0.000s
I20260709 12:27:26.088387  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.091116  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.091714  8393 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:26.092494  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.089797  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.023164 11332 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:26.127529  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:25.966213 11900 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.031281 11870 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.039692 11854 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.129359  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.093593  8397 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:26.130805  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:25.989449 11856 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.030606 11820 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.087424 11649 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.084252 11796 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.031068 11387 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.084306 11651 raft_consensus.cc:2764] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:27:26.086814 11743 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.045928 11599 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:26.148459  8390 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:26.182507  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:26.128448  8510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.019s	sys 0.029s
I20260709 12:27:26.144323  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.128193 11596 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:26.132666 11715 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:26.155769 11466 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:27:26.156929 11851 consensus_meta.cc:287] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.475s	user 0.009s	sys 0.002s
I20260709 12:27:26.004765 11839 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.127892 11819 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.152155 11337 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:26.333858  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.153084 11900 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.341718  8393 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:26.336709  9016 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.342655  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.157060 11870 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.296489 11241 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:26.204934  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.174397 11796 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.345499  8389 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:26.149770 11332 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.333909  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.302249  8540 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:26.242102  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.347537  9041 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:26.204208 11599 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.172933 11387 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.350929 11599 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.354233  9049 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 4.
I20260709 12:27:26.354740  8393 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
W20260709 12:27:26.355296  8510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.020s	sys 0.034s
I20260709 12:27:26.346441  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:26.356365 11715 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.356902  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.260915 11474 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.358088  8390 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:26.166872 11649 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.355825 11387 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:26.152529  8537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.031s	sys 0.032s
I20260709 12:27:26.220060  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1703) took 2776 ms. Trace:
I20260709 12:27:26.341444 11337 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.369207  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:26.370270 11913 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:27:26.371210  8436 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.396232  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.397266  8393 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:26.399893 11337 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:26.391780  8537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.031s	sys 0.033s
W20260709 12:27:26.341425 11885 log.cc:927] Time spent T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 1.351s	user 0.014s	sys 0.030s
I20260709 12:27:26.391942  8392 rpcz_store.cc:276] 0709 12:27:23.443323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.443452 (+   129us) service_pool.cc:224] Handling call
0709 12:27:23.443718 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.444006 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.444033 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.448822 (+  4789us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.546842 (+1098020us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:24.546889 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.546967 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.587543 (+1040576us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b240011e598. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611229c4 00007f6461120acb 00007f64612dbdc9 00007f64612dba55 00007f64612db09d 00007f6463f0d10e 00007f6463f2488c 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221
0709 12:27:26.206837 (+619294us) raft_consensus.cc:1685] finished
0709 12:27:26.206860 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.219981 (+ 13121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4892,"raft.queue_time_us":489,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":9753,"spinlock_wait_cycles":4621568,"thread_start_us":1041843,"threads_started":1,"wal-append.queue_time_us":1214335}
W20260709 12:27:26.370558 11915 log.cc:927] Time spent T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:27:26.402287  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1920) took 2113 ms. Trace:
I20260709 12:27:26.414954  8537 rpcz_store.cc:276] 0709 12:27:24.288848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.289409 (+   561us) service_pool.cc:224] Handling call
0709 12:27:24.289688 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:24.289892 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:25.032920 (+743028us) log.cc:844] Serialized 14 byte log entry
0709 12:27:25.442901 (+409981us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.318688 (+875787us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18002f62c0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:26.401952 (+ 83264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:26.402005 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:26.402054 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.402114 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.402220 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100372,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":1057,"raft.queue_time_us":52595,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8705,"spinlock_wait_cycles":39899520,"thread_start_us":2083569,"threads_started":3,"wal-append.queue_time_us":441777}
I20260709 12:27:26.392374  9049 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:26.402997 11847 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:26.417490 11847 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:26.417900 11847 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:26.419167  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.420408 11929 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:26.406929 11912 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:27:26.422425  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.396138  8436 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.423242  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 310) took 1027 ms. Trace:
I20260709 12:27:26.423599  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.420915 11929 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.424633  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 415) took 1227 ms. Trace:
I20260709 12:27:26.425002  8465 rpcz_store.cc:276] 0709 12:27:25.196880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.197629 (+   749us) service_pool.cc:224] Handling call
0709 12:27:25.327916 (+130287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:25.344033 (+ 16117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:25.344063 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:25.352293 (+  8230us) log.cc:844] Serialized 26 byte log entry
0709 12:27:25.615660 (+263367us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:25.712508 (+ 96848us) log.cc:844] Serialized 14 byte log entry
0709 12:27:26.002378 (+289870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.002447 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.424436 (+421989us) raft_consensus.cc:1685] finished
0709 12:27:26.424457 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.424574 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":289566,"prepare.queue_time_us":98502,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":63,"raft.queue_time_us":306239,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":2418,"thread_start_us":262980,"threads_started":1,"wal-append.queue_time_us":876417}
I20260709 12:27:26.427199 11929 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.427713 11929 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.428159  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1826) took 2627 ms. Trace:
I20260709 12:27:26.428566  8394 rpcz_store.cc:276] 0709 12:27:23.800275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.108044 (+307769us) service_pool.cc:224] Handling call
0709 12:27:24.108344 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.793006 (+684662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.427932 (+1634926us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400287654. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:26.428102 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1572844416}
I20260709 12:27:26.428162 11929 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.412345  8470 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 2065) took 1040 ms. Trace:
I20260709 12:27:26.431638 11929 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.432178 11929 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:26.432485 11929 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:26.430996  8470 rpcz_store.cc:276] 0709 12:27:25.372325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.000573 (+628248us) service_pool.cc:224] Handling call
0709 12:27:26.000880 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.127242 (+126362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.127274 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.142105 (+ 14831us) log.cc:844] Serialized 26 byte log entry
0709 12:27:26.411892 (+269787us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:26.411935 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.412073 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.412121 (+    48us) raft_consensus.cc:1685] finished
0709 12:27:26.412134 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.412281 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87008,"raft.queue_time_us":87232,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":43446,"thread_start_us":217581,"threads_started":1,"wal-append.queue_time_us":232902}
I20260709 12:27:26.436262  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.432870 11929 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:26.438520 11387 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.439064 11387 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.438486 11847 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.446226 11847 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.451160 11929 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.452664  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.454910  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:26.455462  9047 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:26.456300 11929 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.423640  9044 rpcz_store.cc:276] 0709 12:27:25.396359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.396497 (+   138us) service_pool.cc:224] Handling call
0709 12:27:26.422262 (+1025765us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264e9c 00007f6461264a5b 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:27:26.423178 (+   916us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7255296}
I20260709 12:27:26.463039  9047 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:26.465374  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.465642  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.465936  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.466881  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.467185  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.467741  9046 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:26.468248  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.469976  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.470672  9046 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:26.473120  9044 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:26.441664 11848 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.476536  8436 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.479027 11929 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:26.479543 11929 raft_consensus.cc:697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:26.480422 11929 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.476665  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:26.481418  9044 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:26.492853  9014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.944s (SENT) [suppressed 14 similar messages]
I20260709 12:27:26.411770 11352 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.496480 11793 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:26.370865 11856 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.385725 11851 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:26.385918 11530 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:26.449368 11847 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:26.502144  9049 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:26.502296  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.395694 11835 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:26.394781 11903 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.509004  9044 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:26.513208  8464 raft_consensus.cc:2410] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:26.513442  8436 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.514544  9047 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 12:27:26.516458  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.517681  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.518755  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.521150  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.521826  8389 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:26.523391  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:26.524024  8389 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:26.533905  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 1930) took 1153 ms. Trace:
I20260709 12:27:26.534597  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:26.534384  8543 rpcz_store.cc:276] 0709 12:27:25.380556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.381210 (+   654us) service_pool.cc:224] Handling call
0709 12:27:26.533702 (+1152492us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54001f3e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:26.533832 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271966592}
I20260709 12:27:26.506527 11530 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.504259 11466 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.395390 11474 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.531832 11851 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:27:26.558380  8395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1825) took 2746 ms (client timeout 2594 ms). Trace:
W20260709 12:27:26.558825  8395 rpcz_store.cc:269] 0709 12:27:23.800059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.214736 (+414677us) service_pool.cc:224] Handling call
0709 12:27:26.546282 (+2331546us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400343854. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:26.546427 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2650480896}
I20260709 12:27:26.556814  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1706) took 2587 ms. Trace:
I20260709 12:27:26.560470  8396 rpcz_store.cc:276] 0709 12:27:23.969676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:24.217542 (+247866us) service_pool.cc:224] Handling call
0709 12:27:24.217885 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:24.218241 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:24.218269 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:24.280635 (+ 62366us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.790053 (+509418us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:24.790090 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.790152 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.340869 (+1550717us) spinlock_profiling.cc:243] Waited 4.38 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:26.544252 (+203383us) raft_consensus.cc:1685] finished
0709 12:27:26.544277 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.556728 (+ 12451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37996,"raft.queue_time_us":86,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":40905,"spinlock_wait_cycles":10077952,"thread_start_us":440754,"threads_started":1,"wal-append.queue_time_us":579606}
I20260709 12:27:26.562337  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.510133 11835 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:26.500878 11793 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.562952  8396 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:26.534107 11599 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:26.545945 11466 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.535892 11932 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.579080  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 2064) took 1211 ms. Trace:
I20260709 12:27:26.551333 11651 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.533849 11929 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.510550 11856 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.540881 11530 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:26.572399 11851 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:26.572693  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:26.589471  8395 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:27:26.530862 11903 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.573975 11822 consensus_queue.cc:1059] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:26.570674 11924 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:26.557947 11820 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:27:26.576292 11649 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.597363 11903 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.597787  8395 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:26.588950 11932 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.598786  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.599761 11932 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.590760 11929 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.602327 11332 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.602798 11929 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:26.578408  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 43885.8us
I20260709 12:27:26.569526  8389 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:26.580242  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.579463  8463 rpcz_store.cc:276] 0709 12:27:25.367321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.489236 (+121915us) service_pool.cc:224] Handling call
0709 12:27:25.504357 (+ 15121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.015947 (+511590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.015974 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.016424 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:27:26.357923 (+341499us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:26.357962 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.576812 (+218850us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54001a4d54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:26.576856 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.576900 (+    44us) raft_consensus.cc:1685] finished
0709 12:27:26.576911 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.579024 (+  2113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2988,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"spinlock_wait_cycles":1175790336,"thread_start_us":341138,"threads_started":1,"wal-append.queue_time_us":335941}
I20260709 12:27:26.604506  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.607898  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:26.608670  8389 raft_consensus.cc:2410] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:27:26.608857  9047 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:26.599337  8395 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:26.580236  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.531355 11847 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.582646  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.586263 11474 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.590106  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.628937  8388 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:26.571169 11835 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:26.576712 11870 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.629879 11870 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:26.630350 11870 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:26.588570 11755 consensus_meta.cc:287] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.002s
I20260709 12:27:26.593111 11466 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.632339 11743 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.593601 11796 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.633414  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 2068) took 1257 ms. Trace:
I20260709 12:27:26.633772  8464 rpcz_store.cc:276] 0709 12:27:25.375939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.454618 (+ 78679us) service_pool.cc:224] Handling call
0709 12:27:26.633211 (+1178593us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003962d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:26.633356 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432104320}
I20260709 12:27:26.595140  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.611922  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:26.635713  9042 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:26.636404  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 308) took 1257 ms. Trace:
I20260709 12:27:26.636729  9042 rpcz_store.cc:276] 0709 12:27:25.379347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.380770 (+  1423us) service_pool.cc:224] Handling call
0709 12:27:26.595055 (+1214285us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264f8c 00007f6461264ef6 000000000036eb39 00007f64692d81e0 00007f64693a10c4 00007f64693a1131 00007f646934f0a0 00007f646934e984 00007f64628c96d4 00007f64628c9662
0709 12:27:26.636343 (+ 41288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5678208}
I20260709 12:27:26.639717  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 414) took 2911 ms. Trace:
I20260709 12:27:26.640084  8471 rpcz_store.cc:276] 0709 12:27:23.728332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.728490 (+   158us) service_pool.cc:224] Handling call
0709 12:27:23.739654 (+ 11164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:23.739952 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:23.739980 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:23.782790 (+ 42810us) log.cc:844] Serialized 26 byte log entry
0709 12:27:24.791989 (+1009199us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:24.809307 (+ 17318us) log.cc:844] Serialized 14 byte log entry
0709 12:27:24.809476 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.809542 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:25.357092 (+547550us) spinlock_profiling.cc:243] Waited 33.5 ms on lock 0x7b1800495520. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c522 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:26.021364 (+664272us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b1800495520. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646126a2a6 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1
0709 12:27:26.630267 (+608903us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b1800495520. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:26.639530 (+  9263us) raft_consensus.cc:1685] finished
0709 12:27:26.639551 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.639663 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49038,"prepare.queue_time_us":16494,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":258509,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":23734,"spinlock_wait_cycles":102997120,"thread_start_us":816999,"threads_started":1,"wal-append.queue_time_us":920147}
I20260709 12:27:26.641731 11847 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:26.590451 11651 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.643833 11793 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.612799 11778 raft_consensus.cc:3055] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:26.644369 11778 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:26.613576 11723 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.613940 11759 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.614753 11564 raft_consensus.cc:697] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:26.645213 11778 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.645900 11564 consensus_queue.cc:237] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.646718 11835 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.615314  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:26.615952  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 595482us
I20260709 12:27:26.646659  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:27:26.651290  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.616508 11815 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.616820  8511 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:26.616935 11838 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:26.617092  8438 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:26.620112  8510 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.623898 11715 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.625315 11856 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.578830 11599 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.626636 11851 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.597597 11819 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.628273  8392 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:26.779654  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.728004  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.783365  8395 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:26.612473 11924 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:26.697615  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 51036us
W20260709 12:27:26.705470  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:26.704246  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.712136  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.791057  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.792649  8537 raft_consensus.cc:2410] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:27:26.794185  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:26.706447  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 89700.2us
I20260709 12:27:26.657788  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:26.707717  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 87671.8us
I20260709 12:27:26.700409  8512 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:26.780308  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:26.797775  8471 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:26.779265  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.780014  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.732366  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.635783  8396 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:26.784389  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.727602  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:26.728451  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.798959  8463 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:26.800189  8472 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:26.800333  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.733182  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.796582  9015 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:26.800845  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.801112  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:26.800832  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 100499us
I20260709 12:27:26.801661  8472 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
W20260709 12:27:26.786430  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 235921us
W20260709 12:27:26.799784  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 182739us
I20260709 12:27:26.802592  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.802348  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:26.800935  8467 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:26.802843  8438 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:26.803048  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.803390  8464 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:26.648591 11900 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.804967  8464 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:26.807109  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.807951  8470 raft_consensus.cc:2393] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:26.696938 11796 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:26.810122  8465 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:26.781747 11241 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:27:26.785498 11642 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:26.821731 11642 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.822131 11642 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:26.787428 11873 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:26.823526 11564 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:26.823982 11564 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:26.806543 11723 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:26.802610 11778 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:26.824069  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:26.782480 11856 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.814675  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:26.815948  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 158253us
I20260709 12:27:26.837235  8467 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:26.838680  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.839325  8537 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:26.812219  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.789928 11793 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.845510  8539 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:26.846551  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.838497  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:26.847360  8537 raft_consensus.cc:2410] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:27:26.819003 11835 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.819519 11932 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:26.848282 11932 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.848644 11932 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:26.848810 11530 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.849160 11848 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:26.851012 11530 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.851639 11651 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.851487 11856 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.852201 11854 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:26.852720 11854 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:26.853513 11856 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.854598 11854 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:26.854439 11924 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:26.786752 11918 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
I20260709 12:27:26.855095 11819 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:26.855309  8362 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:26.856096 11466 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:26.786654 11919 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.145s
I20260709 12:27:26.809834 11872 raft_consensus.cc:2764] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:26.857506 11916 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:26.813619 11459 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:26.820117  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:26.813951  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:26.632364 11870 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.811875  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.786392 11864 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.711285 11596 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.136s
I20260709 12:27:26.856446 11466 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:26.824419 11873 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.847623  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:26.971701  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 124145us
I20260709 12:27:26.972657  8436 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:26.785132 11525 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:27:26.824378 11564 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:26.866928  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.871767  8362 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:26.809816 11715 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:26.711526 11352 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:27:26.804922  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:26.834895 11759 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 12:27:27.008882  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 203996us
I20260709 12:27:27.010102  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:26.708864 11755 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.013080 11755 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:26.971124 11466 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:26.900934  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.013653 11835 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:26.890736  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:26.936115  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.874898  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:27.014071 11835 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.014559 11835 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:27.015664 11903 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:27.016083 11903 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:27.016441 11903 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:26.936484  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:27.017611  8468 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:26.874428  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 60559.6us
I20260709 12:27:27.014096  8470 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:27.020084  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.020632  8470 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:26.888497  8538 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:27.021373  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.968294  8467 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:27.022297  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:27.022630  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.023386  8467 raft_consensus.cc:2410] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:27.022794  8470 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:26.887036  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:26.966881  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:26.712880 11917 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:27.024749  8466 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:26.859671 11459 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:26.973937  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:27.026687 11459 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:26.878237 11822 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:27.027309  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 53457us
I20260709 12:27:27.027959 11649 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:26.887758  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:27.006196  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 52072.9us
I20260709 12:27:26.874503  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:26.864529 11332 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:27.024143  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.040247  8467 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:26.835426 11796 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.030617  8543 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:27.033533  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:27.034106  8390 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d12c64e413ad46968034a527b5290316"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "aef8c9f023564378a04e3e1e6171930d"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:27.048012  8390 raft_consensus.cc:606] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Received request to transfer leadership to TS aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:27.048379  8390 raft_consensus.cc:614] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:27.027585 11822 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:26.859598 11793 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:27.036623  8542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.057s	sys 0.092s
I20260709 12:27:27.011397  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:27.028362 11649 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:26.951785  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:26.885946  8282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 65876.6us
W20260709 12:27:27.050678  8542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.057s	sys 0.092s
I20260709 12:27:27.051218  8544 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:27.044902  9041 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:27.047565 11815 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:27.008037 11854 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:27.003137 11723 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:27.049589 11743 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:27.008203 11352 consensus_queue.cc:1243] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer 21c151c99bcf4cbeb819de06e68d95bf log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:27:26.977602 11873 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:27.039709 11332 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:27.066756  8469 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
W20260709 12:27:27.069569  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 267262us
W20260709 12:27:27.076866  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 65529.2us
I20260709 12:27:27.053189 11822 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:27.077023  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 205345us
I20260709 12:27:27.077199  8466 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:26.977519 11864 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:27.163506  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 81678.8us
I20260709 12:27:26.881493  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.053393 11649 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.056047 11815 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:27.164851  8438 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:27.062500 11715 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:27.171746  8362 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:27.179785  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:27.166743  8467 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:27:27.170032  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 148953us
I20260709 12:27:27.167717  8468 raft_consensus.cc:2410] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:27:27.168385  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 87343.5us
I20260709 12:27:27.051820 11932 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.063962 11723 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:27.082352 11332 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:27.180747  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 152487us
I20260709 12:27:27.180994  9047 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:27.189172  8470 raft_consensus.cc:2410] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:27.185551 11715 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.237634 11743 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:27.238005  9049 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:27.241219  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:27.235030  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1938) took 1729 ms. Trace:
I20260709 12:27:27.257445 11819 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:27.256963  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 85306.6us
I20260709 12:27:27.262809 11459 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.242388 11387 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:27.237644  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51562.7us
I20260709 12:27:27.255971 11856 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:27.314486 11474 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:27:27.166152 11854 raft_consensus.cc:697] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:27.289794 11919 consensus_queue.cc:1059] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:27.290980 11848 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:27.291401 11864 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:27.196693 11723 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.295759  8544 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:27.421240  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1712) took 1383 ms. Trace:
I20260709 12:27:27.435899  8391 rpcz_store.cc:276] 0709 12:27:26.037944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.611907 (+573963us) service_pool.cc:224] Handling call
0709 12:27:26.612221 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.612536 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:26.612562 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.612985 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:27:26.864079 (+251094us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:26.864118 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:26.864181 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:27.421042 (+556861us) raft_consensus.cc:1685] finished
0709 12:27:27.421067 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.421187 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20229,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":250819,"threads_started":1,"wal-append.queue_time_us":740932}
I20260709 12:27:27.182137 11596 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:27:27.384910  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.081236 11927 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.204s
W20260709 12:27:27.386633  8511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.005s
I20260709 12:27:27.334514 11715 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:27.314775 11599 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:27.234745  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50140.3us
I20260709 12:27:27.397495  8362 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:27.394969  8542 rpcz_store.cc:276] 0709 12:27:25.505938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.026884 (+520946us) service_pool.cc:224] Handling call
0709 12:27:26.027141 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.027335 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:26.499383 (+472048us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.169862 (+670479us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.234676 (+ 64814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:27.234723 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:27.234769 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.234832 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.234970 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17694,"prepare.queue_time_us":587984,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":69,"raft.queue_time_us":55680,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":15652,"thread_start_us":1074426,"threads_started":3,"wal-append.queue_time_us":789541}
I20260709 12:27:27.277534  8471 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:27.412808  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:27.412539 11332 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.415194 11796 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:27.406840 11743 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.428889 11854 consensus_queue.cc:237] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.449995 11743 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:27.366246 11815 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:27.235347  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 70564.9us
I20260709 12:27:27.452373  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:27.421691  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:27.405974 11642 consensus_meta.cc:287] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.583s	user 0.022s	sys 0.000s
I20260709 12:27:27.453719 11642 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.454970  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:27.421100 11847 consensus_meta.cc:287] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.779s	user 0.009s	sys 0.000s
I20260709 12:27:27.447033  8512 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:27.455950 11642 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:27.395267 11870 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.453181 11796 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:27.456576 11642 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:27.456887 11796 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.457293 11796 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.457878 11642 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.458300 11642 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:27.401297 11943 log.cc:927] Time spent T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:27:27.459810 11596 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:27.455718 11847 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:27.444155  8511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.005s	sys 0.005s
W20260709 12:27:27.461422  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 664462us
I20260709 12:27:27.462576 11847 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:27.463311  8463 raft_consensus.cc:2393] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:27.456581 11870 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.464586 11956 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:27.465386 11956 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:27.465751 11870 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:27.463840 11917 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:27.466246 11916 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:27.466598 11642 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.467224  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:27.469676 11642 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:27.472993 11352 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:27.473364 11352 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:27.474103 11352 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.475196 11352 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:27.478144 11847 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:27.478817 11847 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:27.479691 11847 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.485149  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:27.485998 11931 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:27.486394 11931 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.486722 11931 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:27.498842  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:27.499791 11864 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:27.500172 11864 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.500494 11864 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:27.508074 11864 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.510093 11931 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:27.514762  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 117315us
I20260709 12:27:27.429282 11919 raft_consensus.cc:3055] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:27.436998 11459 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:27.429631 11848 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:27.445906 11948 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:27.567190  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 332500us
I20260709 12:27:27.547086  8362 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:27.423339 11820 raft_consensus.cc:3055] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:27.423094 11932 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:27.568082  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:27.586866  8436 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:27.419250 11835 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.575342  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:27.589507  8362 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:27.548497 11743 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:27.439132 11819 consensus_queue.cc:1059] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 12:27:27.552455 11919 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:27.587952 11387 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:27.554258 11793 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:27.595835  8436 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:27.600993  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 129359us
I20260709 12:27:27.566860 11948 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:27.564431 11939 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:27.575457 11820 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:27.415386 11649 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.590497  8362 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:27.596335 11870 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:27.597303 11599 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:27:27.601291 11564 consensus_meta.cc:287] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.565s	user 0.008s	sys 0.000s
I20260709 12:27:27.608700  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:27.609671  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:27.596916 11743 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:27.607659 11903 consensus_meta.cc:287] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.591s	user 0.001s	sys 0.010s
I20260709 12:27:27.599529 11932 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:27.602123 11951 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:27.615235  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.719355  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.550908 11796 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:27.676275  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:27.737249  8466 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:27.605664 11387 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:27.633420  8469 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:27.624890 11924 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:27.628135 11941 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:27.632608 11932 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:27.626479 11870 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.628216 11599 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:27.626299 11939 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.632408 11743 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:27.801718  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 172547us
I20260709 12:27:27.890268  8362 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:27.634202 11564 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.873031  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:27.633834 11759 consensus_queue.cc:1059] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.243s
W20260709 12:27:27.885131 11466 consensus_meta.cc:287] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.870s	user 0.002s	sys 0.010s
W20260709 12:27:27.857089 11955 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
W20260709 12:27:27.861007 11945 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 12:27:27.784163 11387 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:27.917944  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 309292us
I20260709 12:27:27.786317 11956 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:27.777135 11924 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.885818 11941 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.895975 11599 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:27.921059  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:27.718937 11903 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.886004 11963 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.799738 11864 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:27.719941 11848 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.754343 11919 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.860005 11820 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.887768 11948 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:28.171682 11352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.010s	sys 0.026s
W20260709 12:27:28.156941  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 266736us
I20260709 12:27:27.922700  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:28.005877  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 430) took 1058 ms. Trace:
I20260709 12:27:28.190434  8469 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:28.190586  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:27.894188 11870 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:27.887974 11932 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:28.002205  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:28.001379  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:28.193198  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:27.978032  9014 leader_election.cc:336] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.734s (SENT)
I20260709 12:27:28.001183  9049 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:27:28.196245  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 218239us
I20260709 12:27:28.196803  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:28.197374  8467 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:28.190322  8466 rpcz_store.cc:276] 0709 12:27:26.947303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.172003 (+224700us) service_pool.cc:224] Handling call
0709 12:27:27.172307 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:27.741389 (+569082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.005618 (+264229us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54003cd2d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:28.005807 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298783616}
I20260709 12:27:28.198874  8466 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:27:28.201768  8466 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:28.202998  8466 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:27:28.204766  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 283768us
W20260709 12:27:28.143102  8361 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.891s (SENT)
I20260709 12:27:28.206808  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:28.195222  8362 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:27.885514 11931 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:28.214485  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:28.215759  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:28.184096 11970 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 12:27:28.131910 11945 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 12:27:28.216523  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 73452.1us
I20260709 12:27:28.223237  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:28.216945  8463 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:27.915692 11965 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:27.918471 11954 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:28.212772  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:28.158838 11969 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:27:27.985610 11960 log.cc:927] Time spent T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
W20260709 12:27:28.140720 11955 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:27:28.225093  8463 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:27:28.217672  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:28.214249 11847 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:28.003093 11241 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:28.221380  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:28.223858 11919 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:28.204177 11941 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.204278 11924 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:27.975602 11459 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.239789  8465 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:28.203752 11530 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.132143 11835 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.241966  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:28.291435  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 49533us
I20260709 12:27:28.291796 11835 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:28.292332 11835 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:28.293205 11835 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.296286  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.251310 11847 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.247027  8463 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:27.919940 11793 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:28.296850 11847 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:28.271829  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 47093us
I20260709 12:27:28.300127  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.234920 11596 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:28.306788  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:27.922094 11332 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.203917 11819 consensus_queue.cc:1059] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:27:28.219573 11262 consensus_queue.cc:1059] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:27:28.212087 11963 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:27.964316 11956 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:27.917873 11466 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.301019  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.302464  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.302902  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.303351  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.305017  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.243616 11968 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.322810  8544 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:28.306636  8467 raft_consensus.cc:2410] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:27:28.234119 11964 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 12:27:28.240417 11856 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:28.234006 11973 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:28.308250 11975 raft_consensus.cc:3055] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:28.291280 11978 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:28.316936  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.338502  8538 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:28.314092  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.253660 11241 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:28.250155 11948 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:28.289286 11723 consensus_meta.cc:287] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.000s
W20260709 12:27:28.279119 11873 consensus_meta.cc:287] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 1.194s	user 0.007s	sys 0.002s
I20260709 12:27:28.285386 11796 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.309708 11564 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:28.326277  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.351878  8539 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.243086 11931 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:28.309657 11939 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.333619  8545 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:28.334414  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.320827 11808 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:28.346426  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 530) took 1460 ms. Trace:
I20260709 12:27:28.350209 11819 consensus_queue.cc:1243] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:27:28.333053 11979 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:28.354018  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 136400us
I20260709 12:27:28.375860  8362 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:28.330588 11973 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.308470 11459 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.310863 11530 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.332926 11649 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:28.359196  8396 rpcz_store.cc:276] 0709 12:27:26.886051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.886231 (+   180us) service_pool.cc:224] Handling call
0709 12:27:26.886800 (+   569us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:26.945968 (+ 59168us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:27.069416 (+123448us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.435671 (+366255us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:27.548546 (+112875us) log.cc:844] Serialized 574 byte log entry
0709 12:27:27.548697 (+   151us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:27.548728 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.548793 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:28.346185 (+797392us) raft_consensus.cc:1685] finished
0709 12:27:28.346209 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:28.346360 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":203815,"prepare.queue_time_us":58698,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":60352,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":18476,"thread_start_us":369352,"threads_started":2,"wal-append.queue_time_us":423977}
I20260709 12:27:28.312846 11596 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.363063  8538 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:28.333796 11975 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:28.389760  8541 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:27:28.390202  8541 pending_rounds.cc:85] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 5
I20260709 12:27:28.390486  8541 pending_rounds.cc:107] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:27:28.390874  8541 raft_consensus.cc:2889] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:28.391588  8537 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:27:28.366575 11903 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:28.366964 11564 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:28.369134 11967 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 12:27:28.354687 11983 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:28.347211 11723 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.354429 11987 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:28.337010 11982 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:28.378638  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:28.406899  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.345340 11981 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:28.366629 11715 consensus_meta.cc:287] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.823s	user 0.009s	sys 0.001s
I20260709 12:27:28.386806  8544 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:27:28.369158 11822 consensus_meta.cc:287] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.191s	user 0.008s	sys 0.000s
I20260709 12:27:28.361807 11931 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:28.372437 11778 consensus_meta.cc:287] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.547s	user 0.010s	sys 0.011s
I20260709 12:27:28.380677 11973 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:28.398814  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.332890 11856 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.392037 11352 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.347675 11873 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.407706  8546 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:28.408522  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.408812  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.409248  8539 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:28.452423  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.412503  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.413389  8464 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:28.450191  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.453593  8389 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:28.453912  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:28.455331  8464 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:28.412541  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:28.411523  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:28.387279 11980 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:28.417289  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:28.416626  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.366433 11241 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:28.430528 11743 consensus_meta.cc:287] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.524s	user 0.006s	sys 0.002s
I20260709 12:27:28.417512  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:28.433552  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:28.429710 11976 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:28.437779  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.481753  8388 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:28.441525  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.442026  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.319825 11977 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:27:28.449543  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.450541  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.411465  8467 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:28.415468 11981 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.475553  8396 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:28.248960 11954 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.345636 11978 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.434185 11715 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:28.478549  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 45047us
W20260709 12:27:28.478747  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 218564us
I20260709 12:27:28.479773  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.438442 11931 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.482223  8390 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:28.240520 11965 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:28.507193  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.508469  8436 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:28.483697  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.397953 11564 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.517035  8545 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:28.483289  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.517967  8389 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:28.487998  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.489377  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:28.489744  8397 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:28.494871  8471 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:28.490103  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:28.330094 11968 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.505452  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:28.483311 11778 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:28.380246 11979 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.475303 11980 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:28.481448 11976 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:28.486279 11963 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:28.536043  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:28.390313 11975 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.413508 11987 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.417738 11982 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:28.556687 11947 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.010s	sys 0.008s
I20260709 12:27:28.559471 11976 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:28.539920  8466 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:27:28.476224 11352 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.438261 11822 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.483749 11743 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:29.049564 11932 consensus_meta.cc:287] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.829s	user 0.008s	sys 0.000s
I20260709 12:27:29.058388  8389 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:29.051002  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.058568  8394 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:29.033983 11996 log.cc:927] Time spent T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 12:27:29.059147  9041 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 7: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:29.052796 11793 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:29.051209  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.059809 11793 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:28.813349 11459 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:28.610769  8537 raft_consensus.cc:2410] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:28.994920  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1899) took 1385 ms. Trace:
I20260709 12:27:29.061632  8544 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:27:28.561086  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59088 (request call id 434) took 1273 ms. Trace:
I20260709 12:27:29.054459  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:28.826391  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.052357  8540 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:27:28.560273  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:28.561733  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:28.966171  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.605640  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.827762  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:28.954823  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.061611  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:28.497356 11981 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:29.065660  8545 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
W20260709 12:27:29.064541  8436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.005s	sys 0.004s
I20260709 12:27:29.064456  8390 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
W20260709 12:27:29.073464  8436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.005s	sys 0.004s
W20260709 12:27:29.073791  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 549079us
W20260709 12:27:29.059967  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.064318  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.057178  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:28.686542  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 488725us
I20260709 12:27:29.066973  8465 rpcz_store.cc:276] 0709 12:27:27.288071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.289202 (+  1131us) service_pool.cc:224] Handling call
0709 12:27:27.386477 (+ 97275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:28.291384 (+904907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:28.560849 (+269465us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54000f2dd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:28.561027 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937251584}
I20260709 12:27:29.057484  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.066614  8388 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:28.520181 11929 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.072146  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.072542  8394 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:29.101409  8466 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1915) took 1215 ms. Trace:
I20260709 12:27:29.124240  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.062927  8471 rpcz_store.cc:276] 0709 12:27:27.609258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.609421 (+   163us) service_pool.cc:224] Handling call
0709 12:27:28.994702 (+1385281us) spinlock_profiling.cc:243] Waited 814 ms on lock 0x7b5400423954. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:28.994852 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1871186816}
I20260709 12:27:28.716594  8542 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:29.087033  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.074040  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.081082  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:29.104962  9015 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.007s	sys 0.019s
W20260709 12:27:29.136842  9015 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.009s	sys 0.019s
I20260709 12:27:29.136806  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:29.137282  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 827605us
I20260709 12:27:29.132849  8544 raft_consensus.cc:2393] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:29.131951  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.133347  8466 rpcz_store.cc:276] 0709 12:27:27.885706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.210140 (+324434us) service_pool.cc:224] Handling call
0709 12:27:28.210473 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:29.066183 (+855710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.101106 (+ 34923us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540018a454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:29.101337 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757075712}
I20260709 12:27:29.138135  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:28.538818  9042 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:27:29.162474  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:29.187920  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49793.4us
I20260709 12:27:29.213415  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.170957  8539 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:29.144451  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.216084  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.151831  8546 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:28.825213 11820 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:28.541980 11778 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:29.069692 11947 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.490s	user 0.013s	sys 0.014s
W20260709 12:27:28.885998 11870 consensus_meta.cc:287] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.669s	user 0.007s	sys 0.002s
W20260709 12:27:29.001592 11847 consensus_meta.cc:287] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.000s
W20260709 12:27:28.824401 11993 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:27:28.520805 11649 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.623s
I20260709 12:27:28.959267 11965 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:29.217728  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.058897 11932 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:28.538525 11864 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.693s
W20260709 12:27:28.812294 11989 log.cc:927] Time spent T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.366s	user 0.000s	sys 0.000s
I20260709 12:27:28.954830 11968 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:28.927901 11948 consensus_meta.cc:287] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.000s
I20260709 12:27:29.420269  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:28.681135 11951 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:28.964872 11825 raft_consensus.cc:3055] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:29.212687 11808 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.003s	sys 0.010s
I20260709 12:27:29.328510  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:28.811601 11974 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.061241 11241 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:28.601110 11963 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:28.813571 11985 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:28.552554 11980 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:29.064644 11835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.000s	sys 0.009s
I20260709 12:27:29.219868  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:29.147541 11851 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:29.456348 11985 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:29.457285 11985 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.423169 11743 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.968449 11873 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:28.814167 11723 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.560491 11856 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.048713 11956 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:29.061362 11979 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.125012 11815 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:29.124780 11941 consensus_meta.cc:287] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.838s	user 0.008s	sys 0.000s
I20260709 12:27:29.468811 11941 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.400611 11992 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:29.470959 11941 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.816756 11954 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:29.279876 11996 log.cc:927] Time spent T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 12:27:29.282508 11973 consensus_meta.cc:287] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.806s	user 0.003s	sys 0.005s
I20260709 12:27:29.472632 11973 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.474716 11973 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.114662 11991 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.146373 11978 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:29.404543 11931 consensus_meta.cc:287] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.883s	user 0.009s	sys 0.000s
I20260709 12:27:29.403983 11793 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:29.396402 11924 consensus_meta.cc:287] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 1.085s	user 0.007s	sys 0.002s
I20260709 12:27:29.215545 11872 consensus_queue.cc:1059] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.234s
I20260709 12:27:29.475458 11991 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.475998 11924 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.434408 11825 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:29.476758 11931 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.477526 11991 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.399400 11976 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.280328 11822 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.479837 11924 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.449738 11987 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.445410 11951 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.480928 11931 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.481547 11976 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.481824 11951 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:29.437376 11808 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.005s	sys 0.015s
I20260709 12:27:29.279695 11990 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.483116 11990 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.483848 11981 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.485767 11981 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.485569 11980 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.423166 11982 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:29.423826 11778 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:29.434939 11847 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.488912 11847 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.436643 11870 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.485495 11990 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:29.453500 11974 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.494468 11974 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:29.494297 11778 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.496377 11778 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.491493 11870 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.501299 11939 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.501837 11939 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.584008  8362 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 547) took 1075 ms. Trace:
I20260709 12:27:29.584748  8362 rpcz_store.cc:276] 0709 12:27:28.508851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.583826 (+1074975us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:29.586367  8362 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50338 dropped due to backpressure: service queue is full with 50 items
I20260709 12:27:29.588768  8397 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:29.588650  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:29.589257  8394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50338 (request call id 529) took 2715 ms (client timeout 2065 ms). Trace:
W20260709 12:27:29.589797  8394 rpcz_store.cc:269] 0709 12:27:26.874092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.874248 (+   156us) service_pool.cc:224] Handling call
0709 12:27:29.588721 (+2714473us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5400165154. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.588985 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4651733888}
I20260709 12:27:29.590173  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1760) took 1068 ms. Trace:
I20260709 12:27:29.591212  8395 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:29.590206  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1746) took 1151 ms. Trace:
I20260709 12:27:29.591725  8390 rpcz_store.cc:276] 0709 12:27:28.438700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.121793 (+683093us) service_pool.cc:224] Handling call
0709 12:27:29.590122 (+468329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:29.590655  8397 rpcz_store.cc:276] 0709 12:27:28.521615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.523500 (+  1885us) service_pool.cc:224] Handling call
0709 12:27:29.589921 (+1066421us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b540029ccd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.590103 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1194218368}
I20260709 12:27:29.592337  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1738) took 1155 ms. Trace:
I20260709 12:27:29.592713  8395 rpcz_store.cc:276] 0709 12:27:28.436608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.436696 (+    88us) service_pool.cc:224] Handling call
0709 12:27:29.592121 (+1155425us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400287154. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.592291 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542433664}
I20260709 12:27:29.594444  8396 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:29.590297  8393 raft_consensus.cc:2368] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9.
I20260709 12:27:29.383677  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:29.328168  9050 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:29.218797  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:29.636142  9049 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:29.636442  8470 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:29.279699  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:29.308760 11387 consensus_meta.cc:287] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.344s	user 0.009s	sys 0.000s
I20260709 12:27:29.640791 11387 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.646057  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.647531  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.643182  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.648240  8540 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:29.649320  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.650166  8540 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:29.652763  8539 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:29.654668  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.220670  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.655825  9046 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:29.656288  8544 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:29.657907  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.659122  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.639238  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:28.815649 11530 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:28.948460 11596 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:29.295176  9014 leader_election.cc:336] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.615s (SENT)
I20260709 12:27:29.146739 11564 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:29.307834 11599 consensus_meta.cc:287] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 1.090s	user 0.010s	sys 0.000s
I20260709 12:27:29.661279  9014 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:29.661985 11599 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:29.662791  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 367633us
I20260709 12:27:29.664489 11599 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:28.562584 11715 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.477324 11825 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:29.455238 11835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.005s	sys 0.021s
I20260709 12:27:29.639892 11525 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.669248  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.670001 11525 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.670759  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.465085 11851 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.672099  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:29.672348  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.673375  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.476470 11872 raft_consensus.cc:3055] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:29.215507 11929 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.479657 11932 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.454700 11963 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.621023 11951 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:28.565157 11466 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.660931  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 1960) took 1365 ms. Trace:
I20260709 12:27:29.687553  8546 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 6: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:29.825979  8468 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:29.827682  8545 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:29.586643  8362 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50338 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1846)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1863)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1842)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50338 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1848)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1843)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1867)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1860)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1868)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1861)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50338 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1743)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1748)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1751)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 545)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1763)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1764)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 551)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1769)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1849)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1850)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1851)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1852)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1853)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1855)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1856)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1859)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1862)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1864)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1865)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1866)
I20260709 12:27:29.707690 11825 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:29.674290 11851 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.848695 11963 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.849561  8543 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:29.850298  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.851394  8388 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:29.851145 11951 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.852097  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1753) took 1411 ms. Trace:
I20260709 12:27:29.852506  8388 rpcz_store.cc:276] 0709 12:27:28.440558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.534510 (+ 93952us) service_pool.cc:224] Handling call
0709 12:27:29.852028 (+1317518us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:29.716130  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47412 (request call id 517) took 2684 ms. Trace:
I20260709 12:27:29.853614  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:29.836515  8542 rpcz_store.cc:276] 0709 12:27:28.295850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.296022 (+   172us) service_pool.cc:224] Handling call
0709 12:27:29.660543 (+1364521us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400447fd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.660749 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965102848}
I20260709 12:27:29.664783 12007 raft_consensus.cc:3055] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:29.854745  8388 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:29.854940 12007 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:29.855650  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:29.856490  8388 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:29.856261 12007 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.857326  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:29.857561 12007 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:29.858585  8397 raft_consensus.cc:2410] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:27:29.690631  8389 consensus_meta.cc:287] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.002s
I20260709 12:27:29.703356  8471 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:27:29.695399  8393 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1747) took 1256 ms (client timeout 1659 ms). Trace:
I20260709 12:27:29.695706  8541 raft_consensus.cc:2410] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:29.857589  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:29.854010  9048 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:29.695051  8463 raft_consensus.cc:2368] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:29.859388  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1745) took 1420 ms. Trace:
I20260709 12:27:29.863020  8397 rpcz_store.cc:276] 0709 12:27:28.438468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.856973 (+1418505us) service_pool.cc:224] Handling call
0709 12:27:29.859313 (+  2340us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:29.834690  9014 leader_election.cc:336] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.869s (SENT)
I20260709 12:27:29.870380 11525 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:29.832120 11980 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.871798  8389 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:29.872064  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1972) took 1045 ms. Trace:
I20260709 12:27:29.872488  8545 rpcz_store.cc:276] 0709 12:27:28.814920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.279977 (+465057us) service_pool.cc:224] Handling call
0709 12:27:29.839261 (+559284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2816}
I20260709 12:27:29.873544  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.874166  8545 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:29.874915  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:29.875474  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48614.8us
I20260709 12:27:29.875672  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.876320  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:29.876703  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.877043  8546 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:29.879669 11980 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:29.880416 11980 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.881244 11951 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:29.861197  8393 rpcz_store.cc:269] 0709 12:27:28.438933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.481208 (+ 42275us) service_pool.cc:224] Handling call
0709 12:27:29.695127 (+1213919us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002bd254. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.695336 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2461013248}
I20260709 12:27:29.882839 11985 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:29.870419 12009 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
I20260709 12:27:29.883589 11985 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.885766  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.886303  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:29.886502  8472 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:29.889619 11387 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.830667  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.891464  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.892374  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.892827  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.893266  8542 raft_consensus.cc:2393] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:29.893524  8540 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:29.894099  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.894995 11835 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:29.895615 11835 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:29.896443  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:29.898123 11835 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.898809 11835 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:29.902505 11564 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.903154 11564 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.903628 11835 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:29.904150 11835 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:29.899585 11872 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:29.699326  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:29.699985  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.712324 11530 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:29.895022  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1754) took 1454 ms. Trace:
I20260709 12:27:29.901336  8391 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:29.901222  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:29.895306  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.902066  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1967) took 1088 ms. Trace:
I20260709 12:27:29.902302  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:29.877178  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.907981  8469 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:29.909957  9050 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:29.909404  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1735) took 1492 ms. Trace:
I20260709 12:27:29.907198  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:29.910073  8546 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
W20260709 12:27:29.710775  8470 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 1919) took 1677 ms (client timeout 1537 ms). Trace:
I20260709 12:27:29.908527  8389 rpcz_store.cc:276] 0709 12:27:28.440790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.535770 (+ 94980us) service_pool.cc:224] Handling call
0709 12:27:29.894939 (+1359169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:29.907598  9014 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:29.912493  8541 rpcz_store.cc:276] 0709 12:27:28.813683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.827502 (+ 13819us) service_pool.cc:224] Handling call
0709 12:27:29.901834 (+1074332us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54001f3454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.902011 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262991232}
I20260709 12:27:29.882870  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:29.914212  8391 rpcz_store.cc:276] 0709 12:27:28.417193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.417309 (+   116us) service_pool.cc:224] Handling call
0709 12:27:29.909207 (+1491898us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003de5d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.909334 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2552225664}
I20260709 12:27:29.904484  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:29.894457  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.918081  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.905318 11835 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:29.924085  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.924705  8537 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:29.925279  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.926097  8541 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:29.926333 11980 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:29.906155 11872 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.928243 11825 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:29.928274  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 288822us
I20260709 12:27:29.929675  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:29.930455  8391 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:29.923282  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:29.932518  8389 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:29.932518  8393 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:29.933816  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:29.933897  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:29.917328  8470 rpcz_store.cc:269] 0709 12:27:28.033505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.048023 (+ 14518us) service_pool.cc:224] Handling call
0709 12:27:29.710493 (+1662470us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54000d7fd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:29.710680 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3277943680}
I20260709 12:27:29.933609  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:29.936625  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 102047us
I20260709 12:27:29.937979 11835 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:29.853518  9042 rpcz_store.cc:276] 0709 12:27:27.032316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.032785 (+   469us) service_pool.cc:224] Handling call
0709 12:27:27.033117 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:29.226259 (+2193142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:29.715495 (+489236us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540063fbd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:29.715920 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3363458944}
I20260709 12:27:29.906833 11564 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:29.940958  8472 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:29.942312  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.933718 11872 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:29.942034  8392 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:29.944700  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.948726  8540 raft_consensus.cc:2410] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:29.948611 11983 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.950109 11983 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:29.938033 11985 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:29.951697  8388 raft_consensus.cc:2393] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:29.951810  8545 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
W20260709 12:27:29.949113  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 299750us
I20260709 12:27:29.949796  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.956888  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:29.957442  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.957580  8465 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:29.958482  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.958707  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.959506  8470 raft_consensus.cc:1240] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:29.959928  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.960661  8465 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:29.960801  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:29.959220  8464 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:29.951661  9014 leader_election.cc:336] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.944s (SENT)
I20260709 12:27:29.964331  8468 raft_consensus.cc:2393] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:29.962052  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 57861.6us
I20260709 12:27:29.965214  8544 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:29.966604  8471 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:29.961194  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.968045  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.968768  8389 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:29.969360  8541 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:29.979595  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.969915  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:29.981935  8465 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:27:29.952939 11241 consensus_meta.cc:287] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.502s	user 0.006s	sys 0.005s
I20260709 12:27:29.968257  8397 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 3.
I20260709 12:27:29.969264  8542 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:29.984180  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.984532  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:29.981412  8393 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:29.984107  8545 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:29.986950  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.987529  8545 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:29.987869 12000 raft_consensus.cc:2764] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:27:29.988297  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:29.988984  8545 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:29.989677  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.990635  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.990831  8537 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:29.991104  8469 raft_consensus.cc:2410] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:29.991343  8545 raft_consensus.cc:2410] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:29.998982  8389 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:29.999056  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:29.999351  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.002274  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:30.005878  8467 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:30.008610  8472 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:30.009263  8397 raft_consensus.cc:2410] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:27:30.015938  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 73019.4us
W20260709 12:27:30.018316  9014 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.062s (SENT)
I20260709 12:27:30.018772  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.020551  8538 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:27:30.020912  8538 pending_rounds.cc:85] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 7
I20260709 12:27:30.021150  8538 pending_rounds.cc:107] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:27:30.021421  8538 raft_consensus.cc:2889] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:30.022293 11642 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.022738 11642 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:30.023871  8541 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:30.018807  9014 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:30.033425  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.030181  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:30.038537  8537 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:30.042366  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:30.044754  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:30.045361 11985 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:30.045992  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:30.050194  8391 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:30.052788  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:30.057947  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:30.059037  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:30.060403 11985 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:30.064795  8544 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:30.059998  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:30.069061  8397 raft_consensus.cc:2410] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:30.070250 11929 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:30.070724 11332 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:30.072454 11332 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:30.072978  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:30.075068  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:30.076575  8396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1756) took 1633 ms (client timeout 2136 ms). Trace:
W20260709 12:27:30.077025  8396 rpcz_store.cc:269] 0709 12:27:28.443576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.533042 (+ 89466us) service_pool.cc:224] Handling call
0709 12:27:30.076338 (+1543296us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54000ca654. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:30.076512 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061065984}
W20260709 12:27:30.079254  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 61015.7us
W20260709 12:27:30.080442  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.082540 11872 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.083087 11872 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:30.085361 11872 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:30.088503  8541 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:30.093951  8388 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:30.100243  8540 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:30.104445  8464 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:30.103878  9049 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:30.100662  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:30.293157  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:30.127939  8463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 2099) took 1716 ms (client timeout 1784 ms). Trace:
W20260709 12:27:30.293810  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 74837.7us
W20260709 12:27:30.137974  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.228241  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:30.221552  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:30.237443  9013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:30.243219  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 144085us
W20260709 12:27:30.375326  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.376159  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:30.357357  8463 rpcz_store.cc:269] 0709 12:27:28.411167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.411277 (+   110us) service_pool.cc:224] Handling call
0709 12:27:30.127662 (+1716385us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540018a954. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:30.127866 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664719104}
I20260709 12:27:30.382030  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1734) took 1965 ms. Trace:
I20260709 12:27:30.382350  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 324) took 1160 ms. Trace:
I20260709 12:27:30.380280  9050 raft_consensus.cc:2368] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:30.382949  9049 rpcz_store.cc:276] 0709 12:27:29.218420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.218552 (+   132us) service_pool.cc:224] Handling call
0709 12:27:30.356275 (+1137723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.385535  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:30.382438  8392 rpcz_store.cc:276] 0709 12:27:28.416900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.417041 (+   141us) service_pool.cc:224] Handling call
0709 12:27:30.356250 (+1939209us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400166a54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:30.381973 (+ 25723us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542066048}
W20260709 12:27:30.387761  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49355us
I20260709 12:27:30.388775  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:30.389331  8468 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:30.394152  8464 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:30.390302  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:30.403024  9041 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:27:30.399523 11873 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:30.407011  8392 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:30.411908  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1751) took 1967 ms. Trace:
I20260709 12:27:30.412222  8392 rpcz_store.cc:276] 0709 12:27:28.440087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.391751 (+1951664us) service_pool.cc:224] Handling call
0709 12:27:30.406086 (+ 14335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.407369 (+  1283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.407554 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.412331  8539 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:30.421864  8391 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:30.441001 11474 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:27:30.444300  8392 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:30.444953  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1752) took 2004 ms. Trace:
I20260709 12:27:30.445254  8392 rpcz_store.cc:276] 0709 12:27:28.440327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.443510 (+2003183us) service_pool.cc:224] Handling call
0709 12:27:30.443907 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.444720 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.444898 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.446728  8392 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:30.456593  8465 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:30.465916  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1757) took 1985 ms. Trace:
I20260709 12:27:30.466346  8391 rpcz_store.cc:276] 0709 12:27:28.481402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.423917 (+1942515us) service_pool.cc:224] Handling call
0709 12:27:30.465387 (+ 41470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.465553 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.465584 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.465627 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:30.465691 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.465745 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.465841 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.478384 11466 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.479120 11466 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:30.447233  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1759) took 1943 ms. Trace:
I20260709 12:27:30.486076  8392 rpcz_store.cc:276] 0709 12:27:28.504060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.446028 (+1941968us) service_pool.cc:224] Handling call
0709 12:27:30.446386 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.447025 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.447166 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.493822  8391 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:30.494553  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 545) took 1986 ms. Trace:
I20260709 12:27:30.494863  8391 rpcz_store.cc:276] 0709 12:27:28.508309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.467235 (+1958926us) service_pool.cc:224] Handling call
0709 12:27:30.493658 (+ 26423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.494319 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.494501 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.495805  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:30.497388  8468 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
W20260709 12:27:30.505509  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.512560  8395 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:30.520574  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 80410.9us
I20260709 12:27:30.521571  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 546) took 2013 ms. Trace:
I20260709 12:27:30.521942  8392 rpcz_store.cc:276] 0709 12:27:28.508611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.507156 (+1998545us) service_pool.cc:224] Handling call
0709 12:27:30.512787 (+  5631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.513057 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.513080 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.520273 (+  7193us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:30.521354 (+  1081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.521418 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.521521 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:30.519825  8395 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1766) took 1427 ms (client timeout 1599 ms). Trace:
W20260709 12:27:30.522976  8395 rpcz_store.cc:269] 0709 12:27:29.092183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.403970 (+1311787us) service_pool.cc:224] Handling call
0709 12:27:30.519762 (+115792us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.547197  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 548) took 2038 ms. Trace:
I20260709 12:27:30.547708  8391 rpcz_store.cc:276] 0709 12:27:28.509074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.507486 (+1998412us) service_pool.cc:224] Handling call
0709 12:27:30.523975 (+ 16489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.546834 (+ 22859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.546864 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.546914 (+    50us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:30.546948 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.547013 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.547134 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.551689  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 1978) took 2163 ms. Trace:
I20260709 12:27:30.552139  8538 rpcz_store.cc:276] 0709 12:27:28.388713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.393622 (+  4909us) service_pool.cc:224] Handling call
0709 12:27:28.403426 (+  9804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.021897 (+1618471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.545602 (+523705us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54003fb6d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:30.551610 (+  6008us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3701639040}
I20260709 12:27:30.555949 11466 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:30.558497  8392 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:30.559192  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1761) took 2022 ms. Trace:
I20260709 12:27:30.559520  8392 rpcz_store.cc:276] 0709 12:27:28.537064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.531307 (+1994243us) service_pool.cc:224] Handling call
0709 12:27:30.558294 (+ 26987us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.558942 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.559138 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.561172  8392 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:30.567103  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1763) took 1512 ms. Trace:
I20260709 12:27:30.567545  8395 rpcz_store.cc:276] 0709 12:27:29.055099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.533746 (+1478647us) service_pool.cc:224] Handling call
0709 12:27:30.566576 (+ 32830us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.566809 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.566832 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.566872 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:30.566899 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.566951 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.567046 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.589298  8391 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:30.591636  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1764) took 1536 ms. Trace:
I20260709 12:27:30.591993  8391 rpcz_store.cc:276] 0709 12:27:29.055365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.548718 (+1493353us) service_pool.cc:224] Handling call
0709 12:27:30.589108 (+ 40390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.589790 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.591568 (+  1778us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.561371  8360 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50338 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1769)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1845)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1849)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1850)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1851)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1852)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1853)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1854)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1855)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1856)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1857)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1858)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1859)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1862)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1864)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1865)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1866)
Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60370 (request call id 90)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1869)
W20260709 12:27:30.640681  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 1976) took 1735 ms (client timeout 1891 ms). Trace:
W20260709 12:27:30.641114  8543 rpcz_store.cc:269] 0709 12:27:28.905056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.137885 (+232829us) service_pool.cc:224] Handling call
0709 12:27:30.640489 (+1502604us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b54000393d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:30.640617 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633753344}
I20260709 12:27:30.641588 11352 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:30.673053  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 114676us
I20260709 12:27:30.677295  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:30.683244  8362 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:30.686509  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 249650us
I20260709 12:27:30.690865  9015 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:30.694980 11872 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:30.698285  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 147826us
W20260709 12:27:30.698649  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 217734us
I20260709 12:27:30.708880  8469 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:30.726343  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:30.728556  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1748) took 2287 ms. Trace:
I20260709 12:27:30.731832  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1743) took 2288 ms. Trace:
I20260709 12:27:30.718642 12000 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:30.738518 12000 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:30.739564 12000 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:30.741091 11939 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:30.741686 11939 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:30.732631 12035 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:30.733116 12029 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:27:30.733958 12038 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:27:30.746579  8394 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1762) took 1691 ms (client timeout 1675 ms). Trace:
I20260709 12:27:30.729200  8388 rpcz_store.cc:276] 0709 12:27:28.439160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.374639 (+1935479us) service_pool.cc:224] Handling call
0709 12:27:30.398728 (+ 24089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.464110 (+ 65382us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:30.464403 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 12:27:30.726467 (+262064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.726536 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:30.726576 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.726635 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.726729 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":589,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":45267,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":251899,"threads_started":2,"wal-append.queue_time_us":257648}
W20260709 12:27:30.747012  8394 rpcz_store.cc:269] 0709 12:27:29.054764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.746317 (+1691553us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:30.746487 (+   170us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:30.734861 11642 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:30.735293 12033 consensus_queue.cc:1059] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:27:30.743383  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:30.749742  8388 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:30.754853 12033 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:30.754940  8438 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:30.756088 11903 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:30.756508 11903 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:30.756837 11903 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:30.757654  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:30.758379  8393 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:30.760006  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1849) took 1173 ms. Trace:
I20260709 12:27:30.760310  8393 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:27:30.760957  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 88577.5us
I20260709 12:27:30.761518  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:30.763630  8389 raft_consensus.cc:1240] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:27:30.764285  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1852) took 1186 ms. Trace:
I20260709 12:27:30.764585  8389 rpcz_store.cc:276] 0709 12:27:29.578228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.762352 (+1184124us) service_pool.cc:224] Handling call
0709 12:27:30.763352 (+  1000us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.764028 (+   676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.764219 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.765142  8394 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:27:30.761729  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1744) took 2323 ms. Trace:
I20260709 12:27:30.749826 12029 raft_consensus.cc:3055] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:27:30.772135  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 94874.2us
I20260709 12:27:30.772660  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1851) took 1192 ms. Trace:
I20260709 12:27:30.760612  8388 rpcz_store.cc:276] 0709 12:27:29.577310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.747313 (+1170003us) service_pool.cc:224] Handling call
0709 12:27:30.747643 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.750434 (+  2791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.750609 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.773062  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1850) took 1188 ms. Trace:
I20260709 12:27:30.773617  8393 rpcz_store.cc:276] 0709 12:27:29.577914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.758973 (+1181059us) service_pool.cc:224] Handling call
0709 12:27:30.759286 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.770272 (+ 10986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.770497 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.774180  8394 rpcz_store.cc:276] 0709 12:27:29.577592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.749301 (+1171709us) service_pool.cc:224] Handling call
0709 12:27:30.761409 (+ 12108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.765461 (+  4052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.765617 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.748643 12038 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:30.779079 12038 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:30.782325  8389 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:27:30.782991  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1853) took 1204 ms. Trace:
I20260709 12:27:30.783285  8389 rpcz_store.cc:276] 0709 12:27:29.578494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.765308 (+1186814us) service_pool.cc:224] Handling call
0709 12:27:30.782101 (+ 16793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.782750 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.782938 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:29.890178  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:30.760087 12033 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:30.787883 12039 raft_consensus.cc:3055] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:30.771770  8396 rpcz_store.cc:276] 0709 12:27:28.438178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.077925 (+1639747us) service_pool.cc:224] Handling call
0709 12:27:30.078373 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.080209 (+  1836us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:30.346071 (+265862us) log.cc:844] Serialized 14 byte log entry
0709 12:27:30.761413 (+415342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.761461 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:30.761504 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.761565 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.761672 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":609,"prepare.queue_time_us":362729,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":82581,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":519788,"threads_started":3,"wal-append.queue_time_us":317622}
I20260709 12:27:30.790392  8362 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:30.773085 12029 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:30.745011  8397 rpcz_store.cc:276] 0709 12:27:28.437935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.069617 (+1631682us) service_pool.cc:224] Handling call
0709 12:27:30.070057 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.075517 (+  5460us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:30.387669 (+312152us) log.cc:844] Serialized 14 byte log entry
0709 12:27:30.721446 (+333777us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.721494 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:30.725497 (+  4003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.725660 (+   163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.725984 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5952,"prepare.queue_time_us":367204,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":33856,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":610059,"threads_started":3,"wal-append.queue_time_us":326491}
I20260709 12:27:30.795600 12033 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:30.797103 12033 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:30.798481  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:30.799284  8390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1846) took 1223 ms (client timeout 1510 ms). Trace:
W20260709 12:27:30.800194  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 45378.9us
W20260709 12:27:30.799662  8390 rpcz_store.cc:269] 0709 12:27:29.576372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.798172 (+1221800us) service_pool.cc:224] Handling call
0709 12:27:30.799226 (+  1054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.806291  8388 pending_rounds.cc:85] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 4
I20260709 12:27:30.808591  8388 pending_rounds.cc:107] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:27:30.808969  8388 raft_consensus.cc:2889] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:30.810693  8396 raft_consensus.cc:1275] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:27:30.812064  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1858) took 1232 ms. Trace:
I20260709 12:27:30.788311 12039 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:30.805510  8361 leader_election.cc:400] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:30.813107  8396 rpcz_store.cc:276] 0709 12:27:29.580043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.789054 (+1209011us) service_pool.cc:224] Handling call
0709 12:27:30.807768 (+ 18714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.811796 (+  4028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.812006 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.816303  8361 leader_election.cc:403] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:27:30.816488 12039 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:30.839529  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:30.842209 11872 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:30.842984 11872 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:30.844041 11530 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:30.844429 11530 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:30.845335 11530 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:30.846580 11530 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:30.849684  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.850464  8543 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:30.850522  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.851200  8545 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:30.852460  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.854452  8395 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:30.855049  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1769) took 1280 ms. Trace:
I20260709 12:27:30.855345  8395 rpcz_store.cc:276] 0709 12:27:29.574581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.854000 (+1279419us) service_pool.cc:224] Handling call
0709 12:27:30.854292 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.854840 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.854999 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.856568  8395 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:30.857106  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1865) took 1274 ms. Trace:
I20260709 12:27:30.857396  8395 rpcz_store.cc:276] 0709 12:27:29.582380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.856090 (+1273710us) service_pool.cc:224] Handling call
0709 12:27:30.856395 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.856891 (+   496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.857041 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.858641  8395 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:30.859867  8391 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:27:30.914070  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1845) took 1338 ms. Trace:
I20260709 12:27:30.914469  8391 rpcz_store.cc:276] 0709 12:27:29.576037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.859270 (+1283233us) service_pool.cc:224] Handling call
0709 12:27:30.859622 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.913771 (+ 54149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.914007 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.768277 12035 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:30.867811 12032 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:27:30.868432 12029 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:30.870205  8438 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:30.870816  8389 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:27:30.871901 11975 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:30.939309  8396 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:30.875165  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.876036  8390 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: [6.6-10.8]
I20260709 12:27:30.941187  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1862) took 1360 ms. Trace:
I20260709 12:27:30.877475  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.883796  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.942164  8542 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:30.884536  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.885267  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.943167  8545 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:30.886284  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.912811  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.916065  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1866) took 1333 ms. Trace:
W20260709 12:27:30.875312  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.817942 12039 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:30.939862  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.941514  8390 rpcz_store.cc:276] 0709 12:27:29.581149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.808326 (+1227177us) service_pool.cc:224] Handling call
0709 12:27:30.875777 (+ 67451us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:30.940944 (+ 65167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.941140 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.941859  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.946570  8538 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:30.946882  8546 raft_consensus.cc:2393] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 7: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:30.943907  8537 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:30.939477  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1857) took 1359 ms. Trace:
I20260709 12:27:30.947933  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.943847  8395 rpcz_store.cc:276] 0709 12:27:29.582857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.858046 (+1275189us) service_pool.cc:224] Handling call
0709 12:27:30.858323 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.915792 (+ 57469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.916007 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.945063  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1859) took 1364 ms. Trace:
I20260709 12:27:30.953842  8397 rpcz_store.cc:276] 0709 12:27:29.580319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.794268 (+1213949us) service_pool.cc:224] Handling call
0709 12:27:30.815694 (+ 21426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.940168 (+124474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:30.940194 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:30.944792 (+  4598us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:30.944837 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.944898 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:30.944998 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:30.963217  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:30.963891  8390 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:30.964380  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.965070  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.965458  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.965643  8537 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:27:30.942587 11903 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:30.973399 11903 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:30.974501  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.974826  8541 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:30.975687  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.976243 12035 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:30.976608  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:30.976912  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 106780us
I20260709 12:27:30.977921  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:30.979490 11980 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:30.964486  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1869) took 1093 ms. Trace:
I20260709 12:27:30.980145 11980 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:30.980211  8390 rpcz_store.cc:276] 0709 12:27:29.870930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.946513 (+1075583us) service_pool.cc:224] Handling call
0709 12:27:30.963728 (+ 17215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.964260 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.964437 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.947995  8389 rpcz_store.cc:276] 0709 12:27:29.579755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.783965 (+1204210us) service_pool.cc:224] Handling call
0709 12:27:30.789971 (+  6006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.939149 (+149178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:30.939370 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:30.984005  8542 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:30.950687  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:30.988885  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:30.995879  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.996802  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:30.998564  8537 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:31.000267  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.001168  8537 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:31.002972  8543 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:31.004066  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.005652  8546 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:30.953178 11929 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:31.002521  8540 raft_consensus.cc:2376] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 6. Re-sending same reply.
I20260709 12:27:31.010418  8539 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:31.012036  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:31.012461  8540 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:30.995265 11903 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:31.011582  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:60370 (request call id 90) took 1129 ms. Trace:
I20260709 12:27:31.013792  8391 rpcz_store.cc:276] 0709 12:27:29.872862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.915223 (+1042361us) service_pool.cc:224] Handling call
0709 12:27:31.002403 (+ 87180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:31.014245  8542 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:31.014818  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:31.017545  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 66944.4us
I20260709 12:27:31.021291  8546 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:31.008710 11985 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:31.022961  8436 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:31.025213  8541 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:27:31.025817  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.019934 12029 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:31.027401 11985 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:31.032577  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:31.032637  8544 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:27:31.033659  8438 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.037693  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 551) took 1473 ms. Trace:
I20260709 12:27:31.043573 11983 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:31.044252  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 278593us
I20260709 12:27:31.045272  8361 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:31.048053 12034 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:31.048744 12034 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:31.049401 12034 consensus_queue.cc:1059] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:31.050227 12034 raft_consensus.cc:3055] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:31.050540 12034 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:31.048748  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 228676us
I20260709 12:27:31.053534  8362 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:31.053996  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:31.054581  8362 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:31.055346 12036 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:31.058696  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:31.053433  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:31.060690 11975 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:31.061250 11975 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:31.062283  8361 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.508s (SENT)
I20260709 12:27:31.062189 11975 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.033990 11929 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:31.063891 11929 raft_consensus.cc:697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:31.064018 11903 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:27:31.064950  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.065090  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:31.065768  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:31.038069  8392 rpcz_store.cc:276] 0709 12:27:29.564843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.560323 (+995480us) service_pool.cc:224] Handling call
0709 12:27:30.560652 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.560920 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:30.636126 (+ 75206us) log.cc:844] Serialized 14 byte log entry
0709 12:27:30.793044 (+156918us) log.cc:844] Serialized 14 byte log entry
0709 12:27:31.037266 (+244222us) spinlock_profiling.cc:243] Waited 5.69 ms on lock 0x7b180035ed20. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6461216c0a 00007f646a956219 00007f646129ea40 00007f64612994e4 00007f6461299455 00007f6464381060 00007f6464393716 00007f64643a4287 00007f64643a4208
0709 12:27:31.037397 (+   131us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:31.037442 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:31.037487 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.037544 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:31.037643 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8970,"prepare.queue_time_us":14486,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":40576,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"spinlock_wait_cycles":13078912,"thread_start_us":130618,"threads_started":2,"wal-append.queue_time_us":114156}
I20260709 12:27:31.067756  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.068563  8541 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:31.069018  8361 leader_election.cc:336] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.513s (SENT)
I20260709 12:27:31.069325  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.069972  8541 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:31.070616  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.070760  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.072106  8537 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:31.072662  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.072831 12038 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:31.043637 12040 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:31.075659 12038 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.077265 11870 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:31.077811  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1864) took 1496 ms. Trace:
I20260709 12:27:31.077932 12038 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:31.078176  8396 rpcz_store.cc:276] 0709 12:27:29.581808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.816678 (+1234870us) service_pool.cc:224] Handling call
0709 12:27:30.817018 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:30.940596 (+123578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.077596 (+137000us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400166554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:31.077758 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280832768}
I20260709 12:27:31.075917  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47416 (request call id 375) took 1432 ms. Trace:
I20260709 12:27:31.059742 12034 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.079190  8362 leader_election.cc:400] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:31.079315 11980 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:31.059764  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:31.072772  9046 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:31.082816 12034 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:31.084400  9041 rpcz_store.cc:276] 0709 12:27:29.644031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:29.657651 (+ 13620us) service_pool.cc:224] Handling call
0709 12:27:30.380632 (+722981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:30.403427 (+ 22795us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.075691 (+672264us) spinlock_profiling.cc:243] Waited 698 ms on lock 0x7b540008bbd0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:31.075833 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1605667200}
I20260709 12:27:31.083662  8362 leader_election.cc:403] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:31.074863  8394 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:27:31.079895  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:31.085703 11980 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.076421 12040 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.086301 12040 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.086222 11642 consensus_queue.cc:1059] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:31.086943 11983 consensus_queue.cc:1059] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:31.088093 11983 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:31.088449 11983 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:31.089248 11983 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:31.090054  8361 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.544s (SENT)
I20260709 12:27:31.087240 11642 raft_consensus.cc:3055] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:31.090497  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.090720 11642 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:31.079985 11985 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.091645 11642 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.092939 11642 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.094350  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:31.095085  8294 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46076 (request call id 131) took 23119 ms (client timeout 15000 ms). Trace:
I20260709 12:27:31.096246  8396 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:31.097014  8293 catalog_manager.cc:5697] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.098304  8391 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:31.090821  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1855) took 1511 ms. Trace:
I20260709 12:27:31.097507  8362 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:31.098277  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.100330  8394 rpcz_store.cc:276] 0709 12:27:29.579188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.775057 (+1195869us) service_pool.cc:224] Handling call
0709 12:27:31.074424 (+299367us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5800002a98. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:27:31.074621 (+   197us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.090568 (+ 15947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.090769 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8137088}
I20260709 12:27:31.064800 11929 consensus_queue.cc:237] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.101565  8396 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:31.075498  8392 raft_consensus.cc:2376] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11. Re-sending same reply.
I20260709 12:27:31.099752  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:31.035166  8436 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:31.107016  8539 raft_consensus.cc:2376] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11. Re-sending same reply.
W20260709 12:27:31.112305  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 82933us
I20260709 12:27:31.114719 12000 raft_consensus.cc:2764] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:27:31.090433 11983 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:31.118655  8540 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:31.119328  8542 raft_consensus.cc:2410] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:31.113101  8293 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.124008  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.130443  8538 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:31.124306  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.120021  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:31.121413  8293 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:31.165786  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.122663 11980 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
I20260709 12:27:31.141674 12027 consensus_queue.cc:1059] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:27:31.172117 12027 raft_consensus.cc:3055] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:31.154596  8545 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
W20260709 12:27:31.173090  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49531.3us
I20260709 12:27:31.180140  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:31.180938  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:31.175978  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 56014.6us
I20260709 12:27:31.138842 12038 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:31.160648 12029 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:31.194777  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 104771us
I20260709 12:27:31.189447  9016 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:31.183895 11825 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:27:31.205824  9016 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:31.206707 11530 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:31.177012 12027 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:31.209527  8293 catalog_manager.cc:5697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.119398 12040 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.185882 12000 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:31.220495  8293 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 7 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.208101 11530 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:31.232884 11530 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:31.236117  8361 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.552s (SENT)
I20260709 12:27:31.236693  8361 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:31.237174  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 57127.3us
I20260709 12:27:31.209354 11825 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:31.238257  8293 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 8 to 9, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 9 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.209247 12038 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:31.252900 12040 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:31.236378 12000 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:31.253417 12038 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.254490 12000 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:31.095475  8294 rpcz_store.cc:269] 0709 12:27:07.991643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.993705 (+  2062us) service_pool.cc:224] Handling call
0709 12:27:31.094886 (+23101181us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:26.388479 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:26.389026 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:26.389059 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:27:26.389077 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:26.389649 (+   572us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:26.389726 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:26.389753 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:26.390124 (+   371us) tablet.cc:701] Row locks acquired
0709 12:27:26.390141 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:27:26.390282 (+   141us) write_op.cc:270] Start()
0709 12:27:26.390443 (+   161us) write_op.cc:276] Timestamp: P: 1783600046390233 usec, L: 0
0709 12:27:26.390468 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:27:26.534825 (+144357us) log.cc:844] Serialized 1662 byte log entry
0709 12:27:27.511620 (+976795us) op_driver.cc:464] REPLICATION: finished
0709 12:27:28.389550 (+877930us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f646127f0ac 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6467dbfef0
0709 12:27:28.681619 (+292069us) write_op.cc:301] APPLY: starting
0709 12:27:28.694265 (+ 12646us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:28.824507 (+130242us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:28.824534 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:28.825173 (+   639us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:28.825384 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:27:28.825434 (+    50us) write_op.cc:312] APPLY: finished
0709 12:27:28.825672 (+   238us) log.cc:844] Serialized 41 byte log entry
0709 12:27:29.214451 (+388779us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:29.237564 (+ 23113us) write_op.cc:454] Released schema lock
0709 12:27:29.305069 (+ 67505us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:29.424479 (+119410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:29.435943 (+ 11464us) write_op.cc:454] Released schema lock
0709 12:27:29.857766 (+421823us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b18001c64e0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:30.750354 (+892588us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438632a 00007f646430bf14 00007f646430bec3 00007f646430be38 00007f646430bdf3 00007f646430b0dc 00007f6464334e16 00007f646431ccbb 00007f646430739d 00007f646430ad75
Metrics: {"mutex_wait_us":18411,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1005112,"apply.run_cpu_time_us":10291,"apply.run_wall_time_us":780326,"num_ops":4,"prepare.queue_time_us":198580,"prepare.run_cpu_time_us":19437,"prepare.run_wall_time_us":396087,"raft.queue_time_us":517895,"raft.run_cpu_time_us":94936,"raft.run_wall_time_us":3353035,"replication_time_us":1048776,"spinlock_wait_cycles":24006400,"thread_start_us":2586010,"threads_started":5,"wal-append.queue_time_us":577282,"wal-append.run_cpu_time_us":21217,"wal-append.run_wall_time_us":2295711}]]}
I20260709 12:27:31.265070  8438 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.269724 12040 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:31.272297  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.256292 11825 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:31.266148  8293 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 8 to 9, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:31.277603 12027 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:31.283756  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 56402.6us
I20260709 12:27:31.292191 12027 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:31.282469 11825 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:31.303061 11929 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:31.325861 11474 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.328047 11474 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.341737  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:31.348354  8465 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:31.349128  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.349658  8466 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:31.349727  8464 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:31.351127  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:31.351917  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 168095us
I20260709 12:27:31.352414  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:31.354769  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 70399.4us
I20260709 12:27:31.362031  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.357627  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.356416  8436 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:31.357059  8293 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 9, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:31.368675  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.371483  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:31.372290  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:31.372666  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.372579  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.372867  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.370013 11903 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:27:31.374336  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:31.375036 11474 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:31.375980 12048 log.cc:927] Time spent T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:27:31.377461 12051 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:27:31.378139  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1854) took 1799 ms. Trace:
I20260709 12:27:31.378502  8393 rpcz_store.cc:276] 0709 12:27:29.578777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.774852 (+1196075us) service_pool.cc:224] Handling call
0709 12:27:30.789502 (+ 14650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.040102 (+250600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.040134 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.040662 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.123170 (+ 82508us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:31.123221 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.123288 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:31.377952 (+254664us) raft_consensus.cc:1685] finished
0709 12:27:31.377974 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:31.378087 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245271,"raft.queue_time_us":249243,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":53,"thread_start_us":82135,"threads_started":1,"wal-append.queue_time_us":202538}
I20260709 12:27:31.382735  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1856) took 1803 ms. Trace:
I20260709 12:27:31.383111  8388 rpcz_store.cc:276] 0709 12:27:29.579481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:30.777037 (+1197556us) service_pool.cc:224] Handling call
0709 12:27:30.791425 (+ 14388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:31.050439 (+259014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.050469 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:31.050973 (+   504us) log.cc:844] Serialized 52 byte log entry
0709 12:27:31.186367 (+135394us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:31.186414 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.186487 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:31.382532 (+196045us) raft_consensus.cc:1685] finished
0709 12:27:31.382555 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:31.382682 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":178715,"raft.queue_time_us":179882,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":134969,"threads_started":1,"wal-append.queue_time_us":178375}
W20260709 12:27:31.385033  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.385526  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.386883  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.387519  8467 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:31.387557  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.389673  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.391399 12040 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.391935 12040 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.392158 11903 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:31.392661 11903 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:31.393527 12053 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:27:31.394219 12040 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:31.394977  8293 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:31.371768 12000 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:31.396241  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:31.396945  8361 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.556s (SENT)
I20260709 12:27:31.396462  8293 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 7 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.396219 11642 consensus_queue.cc:1059] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:31.398185 11642 raft_consensus.cc:3055] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:31.398542 11642 raft_consensus.cc:740] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:31.398818  8396 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:31.397367  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:31.399341 11642 consensus_queue.cc:260] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.396764 11825 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.403256  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.403913  8393 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:31.407675  8293 catalog_manager.cc:5697] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.413232  9016 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:31.414162 11825 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:31.414592 11474 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:31.415009 11474 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.415333 11474 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:31.402153 11985 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:27:31.417220  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:31.409839 12000 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:31.419587 12000 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.418946  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.423161  8393 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:31.418906  8361 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.571s (SENT)
I20260709 12:27:31.425140  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.425953 11983 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:31.427274  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.427556  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.428151  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.429046  8388 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:31.430019  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.430291  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.430963  8391 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:31.431545  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.431861  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.431015  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.433017  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.433604  8396 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:31.430596  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.435933  8392 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:31.439738  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.430517  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.441416 11903 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.447186  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:31.447578  8389 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
W20260709 12:27:31.467123  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 220263us
I20260709 12:27:31.471535  8390 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:31.478557  8393 raft_consensus.cc:2468] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:31.461794  8293 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 8, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 8 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.405334 12040 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:31.482144  8438 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.482336  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.480018  9016 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:31.489841  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 70962.9us
I20260709 12:27:31.490150  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.489689 11530 raft_consensus.cc:2804] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:31.491492 11530 raft_consensus.cc:697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:31.491918 11903 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:31.492377 11530 consensus_queue.cc:237] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.484453 11474 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:31.498718  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 51621.9us
I20260709 12:27:31.499529  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:31.500344 11474 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:31.491019  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.503228  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.501372  8293 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 9, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:31.503784  8391 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:27:31.510128  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.510188  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:31.511112  8466 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:31.509634  8293 catalog_manager.cc:5697] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:31.513509  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:31.523514  8361 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.603s (SENT)
I20260709 12:27:31.524041  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:31.525211  8361 leader_election.cc:336] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.632s (SENT)
I20260709 12:27:31.525637  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.526630 12054 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:31.527069 12054 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.527426 12054 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:31.531569 12039 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:31.526660  8361 leader_election.cc:336] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.644s (SENT)
W20260709 12:27:31.533478  8361 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.648s (SENT)
I20260709 12:27:31.506405 12056 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:31.535660 12056 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:31.536036 12056 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:31.539062  8361 leader_election.cc:336] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.684s (SENT)
I20260709 12:27:31.548003  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.548343  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.523484  8466 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:31.549000  8394 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:31.549431  8395 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:31.549554  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.550138  8394 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:31.550292  8388 raft_consensus.cc:2393] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:31.550624  8361 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.837s (SENT) [suppressed 75 similar messages]
I20260709 12:27:31.551151  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.551792  8388 raft_consensus.cc:2376] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7. Re-sending same reply.
I20260709 12:27:31.550266  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.552143  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.552722  8395 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:31.551810  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.552927  8396 raft_consensus.cc:2376] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11. Re-sending same reply.
I20260709 12:27:31.553721  8393 raft_consensus.cc:2393] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:31.553660  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.554102  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.512895 11642 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:31.551923  8361 leader_election.cc:336] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.849s (SENT)
I20260709 12:27:31.554783  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.554592  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.554636  8396 raft_consensus.cc:2376] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13. Re-sending same reply.
I20260709 12:27:31.555496  8393 raft_consensus.cc:2376] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11. Re-sending same reply.
I20260709 12:27:31.551083  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.556062  8394 raft_consensus.cc:2376] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10. Re-sending same reply.
W20260709 12:27:31.560024  8361 leader_election.cc:336] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.868s (SENT)
I20260709 12:27:31.560483  8361 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.561223 12040 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:31.562355  8361 leader_election.cc:336] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.889s (SENT)
I20260709 12:27:31.562747  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:31.551720  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.563369  8397 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:27:31.564025  8361 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.901s (SENT)
I20260709 12:27:31.580350  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.569239  8391 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:31.580720  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.580984  8395 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:31.585740  8393 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:31.579912  8468 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:31.564015  8392 raft_consensus.cc:2368] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9.
W20260709 12:27:31.579658  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 181680us
I20260709 12:27:31.594381  9015 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:31.594671  8293 catalog_manager.cc:5697] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 9, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 9 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.602170  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.602963  8396 raft_consensus.cc:2393] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 8: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:31.605481  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.613463  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.618631  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.619246  8394 raft_consensus.cc:2376] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8. Re-sending same reply.
I20260709 12:27:31.619989  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.563485 12040 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:31.622586  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.569521 12059 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.628793  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.629498  8390 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:31.618091  8293 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.624711  8393 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:31.624686  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:31.631353  8472 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.625272  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.632160  8391 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 7: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:31.625916  8388 raft_consensus.cc:2410] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:27:31.626458  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:31.633066  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 165114us
I20260709 12:27:31.631997  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.611668 11985 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:31.634665  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:31.632534  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 68532.8us
I20260709 12:27:31.634914  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.614379 11474 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:31.637028  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.637892  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.638037  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.639027  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.636127  8391 raft_consensus.cc:2393] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:31.636341  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:31.640260  8469 raft_consensus.cc:2393] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:31.640535 11352 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:31.641812  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.642373  8394 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
W20260709 12:27:31.641710  8361 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.915s (SENT)
I20260709 12:27:31.643136  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.644582  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.645282  8392 raft_consensus.cc:2368] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:31.646437  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.647933  8393 raft_consensus.cc:2376] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11. Re-sending same reply.
I20260709 12:27:31.648326  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.649202  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.650641  8397 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:31.657361  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.658232  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.658406  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.660383  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.660991  8391 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:31.661784  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.662731  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.663841  8293 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:31.666579  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 166109us
I20260709 12:27:31.622324 12056 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.669098  8395 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:31.669971  8463 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:27:31.670701  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.671725  8293 catalog_manager.cc:5697] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 8, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.673640  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:31.674404  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.676576  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:31.677135  8390 raft_consensus.cc:2376] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8. Re-sending same reply.
I20260709 12:27:31.678000  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:31.679173  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:31.679790  8397 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:31.685035  8472 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:31.657644 11474 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:31.689862  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 54349.1us
I20260709 12:27:31.685833  8293 catalog_manager.cc:5697] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 7 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.670346 12038 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:31.692330  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 247015us
W20260709 12:27:31.693773  8361 leader_election.cc:336] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.011s (SENT)
I20260709 12:27:31.695158  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.670539 11903 consensus_queue.cc:1059] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:27:31.694459 11352 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.008s
W20260709 12:27:31.696269  8361 leader_election.cc:336] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 3.184s (SENT)
I20260709 12:27:31.697165 12039 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:31.698333  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.699386 12039 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:31.699885 11903 raft_consensus.cc:3055] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:31.700290 11903 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:31.700497 12056 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:31.701330 11903 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.701937  9041 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:27:31.702239  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.702729 11903 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:31.702977 12039 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:31.705456 12039 consensus_queue.cc:1059] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:31.706333 12029 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:31.706657 12029 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:31.707523 12029 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.708647 12029 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:31.710012 12054 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:31.642426 12059 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:31.728276  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:31.720078  8361 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.743642  8293 catalog_manager.cc:5697] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 9, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 9 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.745271  8293 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:31.695648  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51303.9us
I20260709 12:27:31.675829 12000 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:27:31.778895  8293 catalog_manager.cc:5697] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 4 to 8, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 8 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.787158  8293 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:31.790295 12067 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:31.791121 11985 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:31.784708 12053 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:27:31.720587 11352 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:27:31.792610 11474 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.794168 12059 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:31.795907  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 75893.9us
I20260709 12:27:31.783771 11903 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.795710 12038 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:31.721601 12063 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 12:27:31.803679  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 141779us
I20260709 12:27:31.806401  8362 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:31.817945  8293 catalog_manager.cc:5697] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.819088  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.817138 12054 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:31.828245  8361 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.828663 12039 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:31.829074 12029 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:31.829715 12029 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.837359  8293 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 8 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 10 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:31.839696 12059 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:31.840169 12029 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:31.841285  8293 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:31.843421  8293 catalog_manager.cc:5697] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.845359 11903 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:31.847213  8472 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:31.847554 12067 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:31.848102 12063 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:31.849778  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:31.855916  8545 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:31.850859  8397 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:31.816579 12040 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:27:31.806839 12000 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:27:31.864918  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:31.868258  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:31.868826  8541 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:31.870028  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:31.853189 12067 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:31.883481  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 55296.8us
I20260709 12:27:31.860572  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:31.854851 12027 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:27:31.865249 11983 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:31.889014  8361 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.894430  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.887627  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:31.866462 11825 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:27:31.859835 12029 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:27:31.912839  9042 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:31.866523 11873 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:27:31.928993  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.886300 12039 raft_consensus.cc:697] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:31.905264 12038 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:27:31.963784  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 70986.6us
W20260709 12:27:31.968108  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 151951us
I20260709 12:27:31.976604  8545 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:31.887138 12072 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:31.980790  8541 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:31.985432  8361 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.977648 11352 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:31.966405 12079 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:31.991621 11352 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:32.001495  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:32.008409  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 114052us
I20260709 12:27:31.904392 12075 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 12:27:31.984007 12072 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:32.020314  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.003338 12038 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:32.022131 12039 consensus_queue.cc:237] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:32.007890 11872 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:32.026307  8438 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:31.973037 12067 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:32.076478  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 91105.3us
I20260709 12:27:32.078197  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.079339  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.079388 12095 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:32.080222 12029 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:32.081753  8361 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.080859 12079 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:32.019723 11903 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:32.015019 12072 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:32.024961 12056 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:32.090790  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:32.091378  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62543.5us
I20260709 12:27:32.008193 12059 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:27:32.094812  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:32.095829  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.029556 12068 raft_consensus.cc:2764] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:27:32.022526 11985 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 12:27:32.091375 12040 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:32.110306  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.111209 12091 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:27:32.117576  8361 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:32.104167  8511 connection.cc:256] RPC call timeout handler was delayed by -2.1024061419998361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260709 12:27:32.121361  8511 connection.cc:256] RPC call timeout handler was delayed by -2.0781061419997968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1537s for a response
W20260709 12:27:32.121656  8511 connection.cc:256] RPC call timeout handler was delayed by -1.7721061419997568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 12:27:32.121920  8511 connection.cc:256] RPC call timeout handler was delayed by -1.7352061419996971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
W20260709 12:27:32.122169  8511 connection.cc:256] RPC call timeout handler was delayed by -1.7046061419996477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 12:27:32.122416  8511 connection.cc:256] RPC call timeout handler was delayed by -1.68750614199962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 12:27:32.122660  8511 connection.cc:256] RPC call timeout handler was delayed by -1.6470061419995545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 12:27:32.122931  8511 connection.cc:256] RPC call timeout handler was delayed by -1.6236061419999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:27:32.123168  8511 connection.cc:256] RPC call timeout handler was delayed by -1.571406141999887s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21000000000000002s for a response
W20260709 12:27:32.129384  8511 connection.cc:256] RPC call timeout handler was delayed by -1.4841061419997459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
W20260709 12:27:32.129773  8511 connection.cc:256] RPC call timeout handler was delayed by -1.0818061419995502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2644s for a response
I20260709 12:27:32.094272 12080 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:32.166033  8469 raft_consensus.cc:3055] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:32.103273 11903 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:32.171168  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 144915us
I20260709 12:27:32.169564  8469 raft_consensus.cc:740] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:32.172253  8438 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.112673 11642 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:32.154364 12081 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:32.179353 11642 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:32.165907 12038 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:32.175313  8469 consensus_queue.cc:260] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:32.182837  8469 raft_consensus.cc:3060] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:32.166690 12067 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:32.170915 11903 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:32.223474  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.133414 12039 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:32.237290 12039 raft_consensus.cc:697] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:32.237900  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:32.241787  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 56681.5us
W20260709 12:27:32.243427  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 366825us
I20260709 12:27:32.192147 11903 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:32.192708 12068 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:32.287706 12088 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 12:27:32.289676 12077 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:27:32.328912  8438 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.328899  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:32.332583  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 95719.9us
I20260709 12:27:32.346884  8469 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:32.365674  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:32.284987 12027 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.371994  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:32.238278 12039 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:32.381500 12027 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:32.381811  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 372679us
I20260709 12:27:32.383586  9014 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.384502 12027 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:32.389231  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 97786.5us
I20260709 12:27:32.397377  8438 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.391096  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:32.391239  8542 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:27:32.401975  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 231398us
I20260709 12:27:32.408514  8541 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:32.410755  8438 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:32.429256 12094 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:27:32.388325 12105 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:32.391814 12073 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:32.390112 12040 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.391595 12100 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:32.414897 11985 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:32.442201 12105 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:32.374048 11642 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:32.427181 11474 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:27:32.448709  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 65341.8us
W20260709 12:27:32.456502  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 45911.7us
W20260709 12:27:32.449831 12089 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
W20260709 12:27:32.481197  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 95321.6us
I20260709 12:27:32.480667  8438 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.441607 12000 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:32.450889 12040 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:32.531106  9014 leader_election.cc:336] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.155s (SENT)
I20260709 12:27:32.531657  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.443240 12108 consensus_queue.cc:1059] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:27:32.450165 11825 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:27:32.478129 12100 raft_consensus.cc:697] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:32.491554 12000 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:32.556082  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 75494.6us
I20260709 12:27:32.576010  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.579317  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:32.580003  9046 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:32.580073 12054 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:27:32.582794  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 167193us
I20260709 12:27:32.576567 12000 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:32.588728  8438 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.585673 12054 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:32.587666 12105 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:32.590893 12104 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.156s
W20260709 12:27:32.591970 12101 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:27:32.583945 12114 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:32.611104  8512 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:32.604182 11642 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:32.605955 12053 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:32.619606  8390 raft_consensus.cc:1275] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:32.626114 12084 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:32.627209 12110 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:32.609263 12114 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.600957 12113 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:32.627081  8511 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.628628  8512 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:32.644273 12112 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.648214  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:32.616437 12108 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:32.652217  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:32.628122 12097 log.cc:927] Time spent T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:32.616739 12104 consensus_queue.cc:1243] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer 21c151c99bcf4cbeb819de06e68d95bf log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:27:32.681097 11352 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:32.682957  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51035.2us
I20260709 12:27:32.688817  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.689616 12053 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:32.689951  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.690126 12053 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:32.685129  9014 leader_election.cc:336] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.065s (SENT)
I20260709 12:27:32.691047 12053 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:32.691725  9014 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.116s (SENT)
I20260709 12:27:32.687225 11352 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:32.692428 12059 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:32.696033 12092 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:32.691063  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.697419  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2017) took 1020 ms. Trace:
I20260709 12:27:32.658689 12113 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:32.699810  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:32.697779  8540 rpcz_store.cc:276] 0709 12:27:31.676969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.677080 (+   111us) service_pool.cc:224] Handling call
0709 12:27:31.677365 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.688161 (+ 10796us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:31.857736 (+169575us) log.cc:844] Serialized 14 byte log entry
0709 12:27:31.947198 (+ 89462us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.947680 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 12:27:31.947830 (+   150us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:31.947863 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:31.947931 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:32.599966 (+652035us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b1800116ec0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:32.697133 (+ 97167us) raft_consensus.cc:1685] finished
0709 12:27:32.697231 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:32.697365 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6585,"prepare.queue_time_us":200626,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":10077,"raft.queue_time_us":116533,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":16760,"spinlock_wait_cycles":10089728,"thread_start_us":132020,"threads_started":3,"wal-append.queue_time_us":75494}
I20260709 12:27:32.636101 12084 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:32.653127 12108 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:32.649153 12114 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:32.712275 12110 consensus_queue.cc:1048] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:27:32.724040  8469 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:32.704756 12084 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:32.711434 12092 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:32.738484  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 109917us
I20260709 12:27:32.762030  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:32.762547  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 62829.8us
I20260709 12:27:32.652096 12000 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:32.767168  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 76151.3us
I20260709 12:27:32.771430  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.718840 12104 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:32.723595 12056 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:32.684685 12112 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:32.782307  8468 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:32.627691 12100 consensus_queue.cc:237] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:32.785780  8469 raft_consensus.cc:1275] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:32.784372 11474 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.790252  8466 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:32.791940  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.729593 11903 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:32.797524 11929 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:32.809247  8438 leader_election.cc:400] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9.
I20260709 12:27:32.815730  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.781703 12081 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:27:32.792912 12073 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:32.807118 12072 consensus_meta.cc:287] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.709s	user 0.007s	sys 0.000s
I20260709 12:27:32.803745 12056 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:32.803869 12119 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:32.843060  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:32.798738 12092 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:32.849066  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.803920 11872 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:27:32.794435 11474 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:32.846020  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:32.837975 11352 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:32.851470  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:32.802484 12079 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:27:32.787460 12108 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:32.700474 12063 consensus_queue.cc:1175] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" responder_term: 11 status { last_received { term: 8 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:32.860905  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:32.858510  8512 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.877521 12104 consensus_queue.cc:1059] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:27:32.878566 12074 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:32.892004  8392 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
I20260709 12:27:32.880992 12056 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:32.896464 11352 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:32.897167  8512 leader_election.cc:400] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Vote denied by peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) with higher term. Message: Invalid argument: T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:32.854573 12054 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:32.909440  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 63507us
I20260709 12:27:32.910404 11903 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:32.847074 12073 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:32.916443  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:32.917197  9016 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:32.917898  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.918073 11352 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:32.918589 11352 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:32.918968 11352 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:32.919714 12098 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:32.920208 12098 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:32.921069 12067 consensus_meta.cc:287] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.729s	user 0.006s	sys 0.003s
I20260709 12:27:32.921622 12067 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:32.924610  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:32.925170 12067 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:32.859201 12053 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:27:32.927788  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 72226.8us
I20260709 12:27:32.919042  8512 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:32.847554 12072 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:32.900040 12119 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:32.937533 11474 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:32.939531 11873 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:32.906905 12092 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:32.940781  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.944264  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:32.947623  8392 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
W20260709 12:27:32.951092 12099 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.651s	user 0.004s	sys 0.001s
I20260709 12:27:32.942540 12092 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.966861 12130 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:32.967950  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 48959.3us
I20260709 12:27:32.968168 12132 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:32.971776  8512 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:32.973286  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:32.974120  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:32.964021 12088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.001s	sys 0.034s
W20260709 12:27:32.975819  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 45513.7us
I20260709 12:27:32.976433  8438 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:32.982345  8512 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:32.979538 12088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.002s	sys 0.035s
I20260709 12:27:32.984196 11929 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:32.969031 12053 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:27:32.992048 12127 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:27:32.970903 12092 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:32.984405 12088 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:32.965530 11352 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:32.988723 12027 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.969911 12119 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:27:32.984814 11929 raft_consensus.cc:697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:33.018920  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:33.021425  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:33.028187  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50975.8us
I20260709 12:27:33.029409  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:33.013437 12112 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:33.031778  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:33.032397  8540 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:33.018939 12132 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:33.034796  8393 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:33.041499  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:33.042012  8393 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:33.035190  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:33.036551 12098 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:33.036971  8512 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:33.023074 12040 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:33.039031  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:33.039557 12130 raft_consensus.cc:2764] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:27:33.037635 12133 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:33.047741  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:33.048381  8397 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:33.025676 12053 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:33.042797  8392 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:33.022435 12074 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:33.052661  8540 raft_consensus.cc:1275] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:33.057487 11929 consensus_queue.cc:237] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:33.058347 12126 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 12:27:33.057963  8544 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:33.040572 11352 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.060714  8512 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:33.061292  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 49999.2us
I20260709 12:27:33.023941 12027 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:33.073916  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:33.051076 12100 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:33.059794 12088 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:33.081525  8393 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:33.083006  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:33.084609  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:33.085232  8393 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:33.088338  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:33.086999  8392 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:33.093796  8397 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:33.075110 12079 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:33.084189 12112 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:33.110008 12112 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:33.110425 12112 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:33.111727 12086 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:33.111531 12079 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.112140 12086 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.112548 12086 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:33.089102 12100 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:33.113668 12088 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:33.114593 12088 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.115922  9016 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:33.116979 12109 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.583s	user 0.000s	sys 0.005s
I20260709 12:27:33.117267 12095 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:33.117693 12095 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.118036 12095 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:33.119211  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:33.102115 12073 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:33.087674 12072 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:33.104048 12027 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.086068 12130 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:33.105104  9046 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:33.108335 12113 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.109375 11352 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:27:33.153255  8397 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: [10.6-11.7]
I20260709 12:27:33.157833 12104 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.166337  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:33.121066 12132 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:33.168380  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 103197us
W20260709 12:27:33.174831  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 101595us
I20260709 12:27:33.180498 12140 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:33.181106 12135 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.155233 12119 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:27:33.138584 12074 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.181651 12135 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.180351 12104 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:33.147091 12091 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.004s	sys 0.016s
I20260709 12:27:33.189517  8393 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:33.189422  8511 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:33.188575  8394 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:27:33.161491 12084 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.192788  8394 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:33.193985  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:33.199443  8397 raft_consensus.cc:2410] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:33.197962  8393 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:27:33.178869 12040 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:33.202191  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:33.205030  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:33.190904 12091 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.004s	sys 0.016s
I20260709 12:27:33.205132  8394 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:33.208295 12054 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.208706 12104 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.210666 12115 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:33.211089 12115 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:33.211992 12115 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:33.213254 12125 log.cc:927] Time spent T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.290s	user 0.002s	sys 0.000s
I20260709 12:27:33.216316  8389 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:33.217427  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:33.218300  8389 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:33.219190 12119 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:33.219601  8395 raft_consensus.cc:1217] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Deduplicated request from leader. Original: 7.7->[8.8-8.8]   Dedup: 8.8->[]
I20260709 12:27:33.220077  8395 raft_consensus.cc:1240] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:27:33.221052 12079 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:33.223519 12096 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 1.043s	user 0.000s	sys 0.003s
W20260709 12:27:33.225270 12083 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 1.040s	user 0.003s	sys 0.000s
I20260709 12:27:33.186791 12113 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.207283  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:33.230103  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:33.233368  8394 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:33.236238  8393 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:33.238502  8545 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 12:27:33.256824  8361 leader_election.cc:336] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.669s (SENT)
I20260709 12:27:33.257215  8545 pending_rounds.cc:85] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 7
I20260709 12:27:33.257313  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:33.257577  8545 pending_rounds.cc:107] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:27:33.193173 12100 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:33.259218  8393 raft_consensus.cc:1275] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:27:33.237425  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 343) took 1356 ms. Trace:
I20260709 12:27:33.167840 12114 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.258615  8542 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:33.238075  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 48766.9us
I20260709 12:27:33.260077  9049 rpcz_store.cc:276] 0709 12:27:31.881357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.881471 (+   114us) service_pool.cc:224] Handling call
0709 12:27:31.890032 (+  8561us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:31.895984 (+  5952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:31.896014 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:31.906460 (+ 10446us) log.cc:844] Serialized 26 byte log entry
0709 12:27:32.007313 (+100853us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:32.007353 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:32.007771 (+   418us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:33.222828 (+1215057us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:33.226541 (+  3713us) raft_consensus.cc:1685] finished
0709 12:27:33.226559 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:33.237375 (+ 10816us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":152,"raft.queue_time_us":5946,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":7330,"spinlock_wait_cycles":387093888,"thread_start_us":28562,"threads_started":1,"wal-append.queue_time_us":209835}
I20260709 12:27:33.257936  8545 raft_consensus.cc:2889] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:33.223708 12135 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:33.268668  8511 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:33.270347  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:33.256390 12113 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:33.276410  9046 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:27:33.277912 12113 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.278544  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:33.278764 12144 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:33.273029  9041 raft_consensus.cc:3055] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:33.208813 12054 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:33.284245  8361 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.680s (SENT)
I20260709 12:27:33.271804 12081 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:33.280004 11992 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:33.286056  9041 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:33.290071 12136 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.290553 12104 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:33.291018 12084 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.274350 12115 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:33.292930  8511 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:33.261854 12038 consensus_queue.cc:1059] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:27:33.233160 12040 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:33.295557  8361 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.735s (SENT)
I20260709 12:27:33.261340 12095 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:33.276042 12088 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:33.291785 11992 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:33.296118 12136 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.329861  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:33.327713  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:33.328532  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:33.336658  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:35.721975  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 2.38517e+06us
I20260709 12:27:35.722999 12186 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:33.359648  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:35.723591 12186 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:33.353576  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:35.725603 12142 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:35.725996  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:47430 (request call id 350) took 2381 ms (client timeout 2188 ms). Trace:
I20260709 12:27:35.726099 12142 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:35.726437  9049 rpcz_store.cc:269] 0709 12:27:33.344554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.344674 (+   120us) service_pool.cc:224] Handling call
0709 12:27:35.725895 (+2381221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:33.329532  9041 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.810001  9041 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:33.337280 12000 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:33.348371 12029 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.014s	sys 0.010s
I20260709 12:27:33.338835 12038 raft_consensus.cc:3055] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:35.901873 12038 raft_consensus.cc:740] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:35.902287 12204 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:33.333460 12040 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:33.357775 12053 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:33.331056 12054 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:33.371544 11992 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:33.454564 12154 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:27:33.337184 12063 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:27:33.362378 12074 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.914252 12074 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.916399 12074 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.300299 12086 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.919023 12086 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:33.347815 12092 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.919986 12040 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.920509 12040 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.921515 12092 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.366837 12095 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.297330 12112 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:33.375090 12114 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:33.342609 12135 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:35.551903  8512 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.000s	sys 0.011s
W20260709 12:27:34.471720  8418 debug-util.cc:398] Leaking SignalData structure 0x7b080021eb40 after lost signal to thread 7264
W20260709 12:27:35.933391  8512 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.000s	sys 0.013s
W20260709 12:27:35.933682  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 1.02627e+06us
W20260709 12:27:35.934146  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08002ab980 after lost signal to thread 8329
I20260709 12:27:35.934036 12208 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:34.658259  8396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.389s	user 0.010s	sys 0.018s
I20260709 12:27:34.754732 12133 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:34.802827 12168 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:34.806818 12171 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:34.808038  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2043) took 1534 ms. Trace:
I20260709 12:27:34.807961 12172 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.818239  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2039) took 1637 ms. Trace:
I20260709 12:27:35.326313 12174 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:35.328405 12132 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:35.935722  8396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.666s	user 0.010s	sys 0.018s
I20260709 12:27:35.938369 12132 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.935874 12133 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.370079 12176 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.520864 11352 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.937106 12147 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:27:35.939739 12193 consensus_queue.cc:1059] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:27:35.534080 11929 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.155s	user 0.018s	sys 0.011s
I20260709 12:27:35.537855  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1808) took 2502 ms. Trace:
I20260709 12:27:35.553544 12177 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:35.554674 12104 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:35.572211 12100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.185s	user 0.016s	sys 0.058s
I20260709 12:27:35.575820 12130 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.935477 12092 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.586547 12091 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:35.939759 11352 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.941707 12130 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.942036 12091 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:35.943528 12100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.556s	user 0.016s	sys 0.059s
I20260709 12:27:35.936112 12168 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.592811 12067 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:35.639024  8435 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.286s	user 0.006s	sys 0.035s
W20260709 12:27:35.944960  8435 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.592s	user 0.006s	sys 0.036s
I20260709 12:27:35.941048 12177 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.945472 12168 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:35.945838  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:35.946708 12177 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:35.639689 12103 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:35.937798 12172 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.947381 12130 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:35.947382 12103 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.938125 12174 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.949352 12000 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:35.949898 12000 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.652185 12039 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.950487 12174 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:35.950744 12177 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:35.661296 11903 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:35.661809 11985 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.661855 12158 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.662340 12056 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.662536 12144 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:35.662773 12166 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.661980 12164 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.678807  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 349) took 2388 ms. Trace:
I20260709 12:27:35.679337  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2035) took 2645 ms. Trace:
W20260709 12:27:35.693396  8436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.340s	user 0.012s	sys 0.026s
I20260709 12:27:35.694316 12093 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:35.694970 12180 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:35.698772  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:35.701155  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 2.40539e+06us
I20260709 12:27:35.703083 12136 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:35.708155  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:35.709605  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:35.710662 12182 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.716797 12181 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:35.719065 11530 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:35.719524 12027 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:35.723291  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:35.727936 12106 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:35.728335 12142 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:35.728500  8392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1908) took 2433 ms (client timeout 2018 ms). Trace:
I20260709 12:27:35.734023  8394 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:27:35.738157  8438 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:35.729691 12186 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:35.741003  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.742671  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.743561  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:35.747141  9014 connection.cc:256] RPC call timeout handler was delayed by -1.8737395260000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 12:27:35.759138  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:35.737634 12113 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:35.767746 12190 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.768581  8389 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:35.741009 12187 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:35.758448 12072 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.743134 12068 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:27:35.760779 12119 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:35.747037  8282 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 21c151c99bcf4cbeb819de06e68d95bf is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:35.778405  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.780236  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.782025  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.785876  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:35.805070  8397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.543s	user 0.016s	sys 0.032s
I20260709 12:27:35.806332 12195 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.807272 12184 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:35.834275 12201 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.834846  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1810) took 2797 ms. Trace:
I20260709 12:27:35.836261 12202 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:35.840612  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:35.812420 11474 consensus_queue.cc:1175] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" responder_term: 7 status { last_received { term: 7 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:35.811915 12191 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:27:35.845814 12197 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:35.840366 12075 raft_consensus.cc:3055] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:35.857316 12108 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:35.867897 12199 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.869516  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.872987 12088 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:35.885177  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 101279us
W20260709 12:27:35.892156 12029 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 3.087s	user 0.016s	sys 0.012s
I20260709 12:27:35.962864 12100 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.963025 12181 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.964301  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:35.941169  8388 rpcz_store.cc:276] 0709 12:27:33.035899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.044998 (+  9099us) service_pool.cc:224] Handling call
0709 12:27:33.055987 (+ 10989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:33.073113 (+ 17126us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:27:33.119694 (+ 46581us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b18004adb80. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6461216c0a 00007f646a956219 00007f646129ea40 00007f64612994e4 00007f6461299455 00007f6467d813c7 00007f64643939a7 00007f64643a30bf 00007f64643a3038
0709 12:27:33.119958 (+   264us) log.cc:844] Serialized 14 byte log entry
0709 12:27:33.259274 (+139316us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:33.259754 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.259870 (+   116us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:33.259898 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.259955 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:35.537475 (+2277520us) raft_consensus.cc:1685] finished
0709 12:27:35.537583 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.537755 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38277,"prepare.queue_time_us":47088,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":41326,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":6308,"spinlock_wait_cycles":7747968,"thread_start_us":109644,"threads_started":1,"wal-append.queue_time_us":154996,"wal-append.run_cpu_time_us":1929,"wal-append.run_wall_time_us":1053673}
W20260709 12:27:35.965528  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 242294us
I20260709 12:27:35.944744 12067 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.966660 12166 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.967242  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.967916 12067 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:35.939682 12176 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.968703 12166 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:35.969362  9014 connection.cc:256] RPC call timeout handler was delayed by -1.0776797590001479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 12:27:35.969123 12088 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.970350 12176 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:35.970865 12176 consensus_queue.cc:1059] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:35.971933 12072 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.972388  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:35.972963  8395 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:35.968847 11530 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.973917 12072 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:35.966120 12160 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:35.950887 12039 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:35.975958  8397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.714s	user 0.017s	sys 0.032s
I20260709 12:27:35.976553 12039 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:35.977110  8393 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:27:35.907795  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 68529.5us
I20260709 12:27:35.977926  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:35.923045  8539 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:35.951362  8543 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
W20260709 12:27:35.965770  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 227689us
I20260709 12:27:35.963246  8465 raft_consensus.cc:2410] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:27:35.937925  8540 rpcz_store.cc:276] 0709 12:27:33.184968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.185208 (+   240us) service_pool.cc:224] Handling call
0709 12:27:33.185485 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.193069 (+  7584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.193114 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:33.193157 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:33.193196 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.818046 (+1624850us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b54003facd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:34.818077 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.818177 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17014016}
W20260709 12:27:35.963217  8361 leader_election.cc:336] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.784s (SENT)
I20260709 12:27:35.902844 12038 consensus_queue.cc:260] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:35.965171  8436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.612s	user 0.013s	sys 0.026s
I20260709 12:27:35.976845  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:35.929034 12112 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:33.478782 11873 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:35.944309 11929 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.567s	user 0.019s	sys 0.011s
I20260709 12:27:35.971159 12088 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.001432  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:36.001763  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:35.975481  8542 rpcz_store.cc:276] 0709 12:27:33.034021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.034132 (+   111us) service_pool.cc:224] Handling call
0709 12:27:33.049422 (+ 15290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.261528 (+212106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.679095 (+2417567us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54001b2954. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:35.679267 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":480670464}
I20260709 12:27:36.001266  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:35.978466  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:35.977579  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:35.979498  8392 rpcz_store.cc:269] 0709 12:27:33.294752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.295256 (+   504us) service_pool.cc:224] Handling call
0709 12:27:35.728428 (+2433172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:35.985634  8438 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:35.931802 12135 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.955538  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:35.983796  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 2.63053e+06us
W20260709 12:27:35.935357  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800120260 after lost signal to thread 8421
W20260709 12:27:36.015133  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb500 after lost signal to thread 8422
W20260709 12:27:36.016155  8418 debug-util.cc:398] Leaking SignalData structure 0x7b0800301440 after lost signal to thread 8496
W20260709 12:27:36.016422  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6420 after lost signal to thread 8497
W20260709 12:27:36.017381  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08003d6bc0 after lost signal to thread 8570
W20260709 12:27:36.017628  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7120 after lost signal to thread 8571
W20260709 12:27:36.018648  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3460 after lost signal to thread 9074
W20260709 12:27:36.018893  8418 debug-util.cc:398] Leaking SignalData structure 0x7b08003c34e0 after lost signal to thread 9075
I20260709 12:27:35.930047 12040 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:35.903095 12204 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.971585 12119 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.032992 12204 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:35.977272 12113 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.034899 12113 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:35.971675 12195 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.036808 12195 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:35.996094  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.045460  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 294) took 9503 ms. Trace:
I20260709 12:27:35.966073 12201 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.963441 12100 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.996076  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:35.934986 12208 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.046900  8546 raft_consensus.cc:2410] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:27:35.975244 12160 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:35.964401 12186 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:35.974570  8471 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:36.047887 12201 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.047789 12160 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.951153 12177 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:35.968700 12184 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.937553  8545 rpcz_store.cc:276] 0709 12:27:33.273832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.274139 (+   307us) service_pool.cc:224] Handling call
0709 12:27:33.274451 (+   312us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:33.284883 (+ 10432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.284916 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:27:33.285811 (+   895us) log.cc:844] Serialized 78 byte log entry
0709 12:27:34.803622 (+1517811us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b18001501c0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646127ee07 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6463f2320b 00007f6463f28d23 00007f6463f290d1 00007f6464344a0f
0709 12:27:34.804510 (+   888us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:34.805495 (+   985us) log.cc:844] Serialized 14 byte log entry
0709 12:27:34.806536 (+  1041us) log.cc:844] Serialized 14 byte log entry
0709 12:27:34.807712 (+  1176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:34.807764 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:34.807859 (+    95us) raft_consensus.cc:1685] finished
0709 12:27:34.807867 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:34.807977 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17147,"prepare.queue_time_us":1029,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":1414081,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":10155,"spinlock_wait_cycles":5855104,"thread_start_us":2818,"threads_started":4,"wal-append.queue_time_us":1510276,"wal-append.run_cpu_time_us":2706,"wal-append.run_wall_time_us":1006970}
I20260709 12:27:35.964956  8394 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:36.002427  8540 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:36.003073  8541 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:36.003490  8469 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:36.003216  8389 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:36.014011  8388 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:36.021545  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1900) took 2941 ms. Trace:
W20260709 12:27:35.996836  8282 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 249847us
I20260709 12:27:35.957192 12000 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:35.978911 12093 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:35.996984 12187 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.965662 11903 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:36.026340  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 47121.9us
I20260709 12:27:36.026585 12134 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:36.027139  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.027427  9041 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:35.997578 11873 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:35.941304 12104 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.027588 12144 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:35.944205 12091 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:35.940869 12132 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:35.972306 12027 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.003556 12092 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.029394 12176 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.029713 12106 raft_consensus.cc:3055] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:36.030194  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:35.950991 12073 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.996559 12197 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.031095 12181 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:35.965253 12158 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.964884 12199 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.038882 11352 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.039614  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.041009  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.041508  8295 catalog_manager.cc:5697] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:35.967870  8391 rpcz_store.cc:276] 0709 12:27:33.037072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.040790 (+  3718us) service_pool.cc:224] Handling call
0709 12:27:33.052020 (+ 11230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:33.056397 (+  4377us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:33.076498 (+ 20101us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.553929 (+2477431us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18004adbe0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646127ee07 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6463f2320b 00007f6463f28d23 00007f6463f2923a 00007f6464393a2a
0709 12:27:35.696004 (+142075us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:35.696502 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:27:35.696643 (+   141us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:35.724565 (+ 27922us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.834451 (+109886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:35.834525 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:35.834637 (+   112us) raft_consensus.cc:1685] finished
0709 12:27:35.834652 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.834786 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38290,"prepare.queue_time_us":54134,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":73,"raft.queue_time_us":118956,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":15621,"spinlock_wait_cycles":3250432,"thread_start_us":279044,"threads_started":4,"wal-append.queue_time_us":2528492}
I20260709 12:27:36.043074  9047 raft_consensus.cc:2410] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:27:35.963497 12190 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.971942 12202 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.026129  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:36.028505  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 73091.4us
I20260709 12:27:35.951467 11985 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:36.044821  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 2046) took 2666 ms (client timeout 2188 ms). Trace:
I20260709 12:27:36.045583  8538 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:35.937435 12171 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:35.945998 12168 consensus_queue.cc:1059] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:27:35.950490 12103 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.049544  8438 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.050009 12114 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:36.050340 12053 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:36.050370  8392 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:36.049953  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:36.048729  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.051532 12133 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.051941 12186 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.047892  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.049382 12100 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.052775  8468 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:36.053087 12135 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.053685  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.054986 12119 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.057813  8395 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
W20260709 12:27:36.058218  8539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 2034) took 2984 ms (client timeout 3258 ms). Trace:
I20260709 12:27:36.089184  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:35.907022 12203 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:36.058766  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 95591.5us
I20260709 12:27:35.975243 11530 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.061034  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:36.170194  8539 rpcz_store.cc:269] 0709 12:27:33.031306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.031517 (+   211us) service_pool.cc:224] Handling call
0709 12:27:36.015348 (+2983831us) spinlock_profiling.cc:243] Waited 2.89 s on lock 0x7b54001f3454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:36.015505 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6643869440}
I20260709 12:27:36.049469  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:35.977665 12075 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:35.975401 12164 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.037642 12038 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:36.188947  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 139462us
I20260709 12:27:36.171355  9043 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:36.048753 12059 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:36.171886  8537 raft_consensus.cc:2368] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7.
W20260709 12:27:36.171156  8361 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.823s (SENT)
I20260709 12:27:36.189431  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.169087  9048 raft_consensus.cc:2410] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:27:36.189636  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.173844  8463 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:36.088814  8394 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:27:36.089334  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.176926  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.189078 12172 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.193994  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.194572  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.194825 12187 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.195204 12177 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.195683 12093 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.196295 12164 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.196419 12177 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.014801 12182 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.197705 11903 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.199438 12182 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.064009 12193 consensus_queue.cc:1243] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer 21c151c99bcf4cbeb819de06e68d95bf log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:27:36.167428  8396 rpcz_store.cc:276] 0709 12:27:33.080277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.186500 (+106223us) service_pool.cc:224] Handling call
0709 12:27:33.194609 (+  8109us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:33.228036 (+ 33427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.228065 (+    29us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:27:33.233897 (+  5832us) log.cc:844] Serialized 78 byte log entry
0709 12:27:35.977952 (+2744055us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:35.978275 (+   323us) log.cc:844] Serialized 14 byte log entry
0709 12:27:36.021198 (+ 42923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.021280 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:36.021323 (+    43us) raft_consensus.cc:1685] finished
0709 12:27:36.021335 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:36.021469 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58856,"prepare.queue_time_us":457,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":28011,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":69443,"thread_start_us":2750786,"threads_started":2,"wal-append.queue_time_us":159107,"wal-append.run_cpu_time_us":2302,"wal-append.run_wall_time_us":1072659}
I20260709 12:27:36.200280  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.194579  8539 raft_consensus.cc:2376] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9. Re-sending same reply.
I20260709 12:27:36.200618  8470 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.201850  8546 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:36.177835  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:36.171316  8543 rpcz_store.cc:269] 0709 12:27:33.342501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.349351 (+  6850us) service_pool.cc:224] Handling call
0709 12:27:36.008890 (+2659539us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54001f3e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:36.008998 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522030464}
I20260709 12:27:36.178731 12040 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:36.178812  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.092199  8390 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
W20260709 12:27:36.180451  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 119481us
I20260709 12:27:36.206708  9015 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:36.199162 12136 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:36.207656  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.207917  8472 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:36.180524 12176 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.172358  8542 raft_consensus.cc:2376] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10. Re-sending same reply.
I20260709 12:27:36.045871  8293 rpcz_store.cc:276] 0709 12:27:26.572689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.574985 (+  2296us) service_pool.cc:224] Handling call
0709 12:27:36.045369 (+9470384us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:32.643306 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:32.645237 (+  1931us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:32.645292 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:27:32.645310 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:32.841750 (+196440us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:32.845449 (+  3699us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:32.847720 (+  2271us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:27:32.897970 (+ 50250us) tablet.cc:701] Row locks acquired
0709 12:27:32.898017 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:27:32.898190 (+   173us) write_op.cc:270] Start()
0709 12:27:32.898366 (+   176us) write_op.cc:276] Timestamp: P: 1783600052898131 usec, L: 0
0709 12:27:32.898389 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:32.975600 (+ 77211us) log.cc:844] Serialized 10535 byte log entry
0709 12:27:33.378408 (+402808us) op_driver.cc:464] REPLICATION: finished
0709 12:27:33.477590 (+ 99182us) write_op.cc:301] APPLY: starting
0709 12:27:33.477722 (+   132us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:33.478344 (+   622us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:33.478486 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:33.487706 (+  9220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:33.488192 (+   486us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=27
0709 12:27:33.488490 (+   298us) write_op.cc:312] APPLY: finished
0709 12:27:33.489060 (+   570us) log.cc:844] Serialized 182 byte log entry
0709 12:27:33.489242 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:33.489464 (+   222us) write_op.cc:454] Released schema lock
0709 12:27:33.489543 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:33.491963 (+  2420us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:33.491988 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9386,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":93295,"apply.run_cpu_time_us":6042,"apply.run_wall_time_us":13843,"num_ops":27,"prepare.queue_time_us":212058,"prepare.run_cpu_time_us":12032,"prepare.run_wall_time_us":391391,"raft.queue_time_us":196406,"raft.run_cpu_time_us":10881,"raft.run_wall_time_us":114709,"replication_time_us":472640,"thread_start_us":265543,"threads_started":4,"wal-append.queue_time_us":96268,"wal-append.run_cpu_time_us":57272,"wal-append.run_wall_time_us":1949397}]]}
I20260709 12:27:36.188683  8397 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1905) took 3107 ms. Trace:
I20260709 12:27:36.213686  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.149334 12204 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:36.175956  8295 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 4 to 7, term changed from 5 to 6, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:36.206938  8540 raft_consensus.cc:2410] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:27:36.199673 12171 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.006789 12056 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.211287  8538 raft_consensus.cc:2410] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:27:36.212088  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.136966 12195 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:36.177291 12106 raft_consensus.cc:740] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:36.088313 12201 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:36.181941  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 132050us
I20260709 12:27:36.208235  8395 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:36.236652  8438 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.214547  8394 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:36.182621 12180 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:36.224634 12040 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.219909 12059 raft_consensus.cc:697] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:36.248994 12180 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.249126  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.249677 12129 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:36.251266 12040 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.251842  8388 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:36.252369  8543 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:27:36.216596  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.252933  8396 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:36.253191  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.253429  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.216238  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.235817  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.088577 12039 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.254961  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.255535  8537 raft_consensus.cc:2376] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10. Re-sending same reply.
I20260709 12:27:36.249451  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.254012  8388 raft_consensus.cc:2410] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:27:36.249811  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.216135  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:36.259675  8389 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.206626  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.260577  8541 raft_consensus.cc:2368] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:36.091212 12208 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.191715 12181 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.225127  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.227952  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.229030  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.230608  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.203449 12000 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:36.224165 12093 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.219743 11530 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:36.231980  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.190485 12119 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.232293 12186 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.232913 12184 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.186791 12203 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.286810 12086 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:36.287539 12086 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.287894 12086 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.288290  8438 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.237021  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.288780 12203 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.289346  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.233464 12056 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.237597  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.293001  9043 raft_consensus.cc:2410] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 12:27:36.207335 12054 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.194765 12075 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:36.240501  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 69375.3us
W20260709 12:27:36.294668  8361 leader_election.cc:336] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.861s (SENT)
I20260709 12:27:36.230082  8295 catalog_manager.cc:5697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:36.221190 12135 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:27:36.242856 12197 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.236344 12136 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:36.243845  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.244132 12132 raft_consensus.cc:3055] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:36.244288 12195 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.245424 12106 consensus_queue.cc:260] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.246284 11985 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.247815  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.248461  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.251976 12059 consensus_queue.cc:237] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.253997  8543 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:36.186672 12113 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:35.978590  9046 rpcz_store.cc:276] 0709 12:27:33.290544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.290745 (+   201us) service_pool.cc:224] Handling call
0709 12:27:33.291085 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:33.291447 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:33.291483 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:33.291963 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:27:33.404491 (+112528us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:33.404543 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:33.404622 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:35.678557 (+2273935us) raft_consensus.cc:1685] finished
0709 12:27:35.678582 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:35.678733 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3632,"raft.queue_time_us":1069,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":2250,"thread_start_us":112099,"threads_started":1,"wal-append.queue_time_us":183910,"wal-append.run_cpu_time_us":1777,"wal-append.run_wall_time_us":1005728}
I20260709 12:27:36.264171 12092 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.264845 12104 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.265254 12039 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.266142  8465 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:36.267463 12199 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.227304 12204 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.272095 12202 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.272392 12027 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.208232  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 348) took 2946 ms. Trace:
I20260709 12:27:36.261520  8392 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:36.272981  8470 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:36.271183  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.273909  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.213775  8397 rpcz_store.cc:276] 0709 12:27:33.081382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.203986 (+122604us) service_pool.cc:224] Handling call
0709 12:27:33.230962 (+ 26976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:33.231169 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:33.261846 (+ 30677us) log.cc:844] Serialized 14 byte log entry
0709 12:27:35.976532 (+2714686us) log.cc:844] Serialized 14 byte log entry
0709 12:27:36.188374 (+211842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:36.188421 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:36.188470 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.188530 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:36.188630 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126117,"prepare.queue_time_us":28873,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":2528,"raft.queue_time_us":148633,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":42019,"thread_start_us":2799618,"threads_started":2,"wal-append.queue_time_us":172731,"wal-append.run_cpu_time_us":1243,"wal-append.run_wall_time_us":1027080}
I20260709 12:27:36.281520  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:36.361151 12219 log.cc:927] Time spent T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:27:36.361302  8541 raft_consensus.cc:2410] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:27:36.362165  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.362447  8542 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:36.218420 12176 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.362923  8390 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:36.282585  8472 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
I20260709 12:27:36.283363 12144 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.284775 12164 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:36.244251 12190 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.286253 11929 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:36.365788 11929 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:36.366145 11929 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:36.366971 11929 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.368254 11929 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.286782 12158 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.359674  9041 rpcz_store.cc:276] 0709 12:27:33.259848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.263794 (+  3946us) service_pool.cc:224] Handling call
0709 12:27:33.271548 (+  7754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:36.027151 (+2755603us) spinlock_profiling.cc:243] Waited 89.6 ms on lock 0x7b5400613da0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464300dc0 00007f646438bd87 00007f646438c470 00007f6464388d8f 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c
0709 12:27:36.180819 (+153668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.205861 (+ 25042us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206114688}
I20260709 12:27:36.372895 12195 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.288188 12068 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:36.290210  8393 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.290704 12114 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:36.375811 12114 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.376171 12114 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.376560 12178 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.377074 12178 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.377516 12180 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.290444 12119 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.381291 12119 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.381922  8393 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:36.382128  8544 raft_consensus.cc:2410] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:27:36.278820 11530 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.382403  8545 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:36.382658 11530 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:36.368057 12106 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.274111 12201 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.389101 12201 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.236946  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.390517  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.391631  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.391827 11873 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.392211  8395 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:36.289458 12000 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:36.393287 12000 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.393674 12000 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:36.292352  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.187167 12073 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.295046  8361 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:36.241991 12074 raft_consensus.cc:3055] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:36.296324  8295 catalog_manager.cc:5697] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 6 to 9, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 9 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:36.404404  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.405047  8295 catalog_manager.cc:5697] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:36.301782  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.407807  8537 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 3.
I20260709 12:27:36.272722 12181 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.312333  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.308634  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:36.312844  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 131555us
I20260709 12:27:36.409092  8467 raft_consensus.cc:2393] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:36.409478  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:36.410331  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:36.317961  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.319262  8540 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 5.
I20260709 12:27:36.294056 12054 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.413513  8391 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:36.307081 12177 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.335649  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.337309  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.415529  8543 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.307334 12132 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:36.340585  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.320374 12075 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:36.342094  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:36.345669  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.345988 12136 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:36.347026  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62072.1us
I20260709 12:27:36.359010  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:36.424134  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:36.424356  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 129708us
I20260709 12:27:36.424628  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.425503 12181 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.425894  8465 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:36.359134  8389 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:36.363330  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.428045  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.429085  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:36.396557  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 122714us
I20260709 12:27:36.430128  8362 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.430924 12132 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.431687  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.432071 12132 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.432753  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.433429  8537 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:36.433539 12178 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.397187  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.404325 12074 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:36.434245 12195 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.434631 12195 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.397943  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:36.435006 12195 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.413844 12201 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:36.362725  8541 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
I20260709 12:27:36.436452  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.393858 11873 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.417567  8388 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:36.362718 12039 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.418457  8512 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:36.434708  8397 raft_consensus.cc:2410] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 8 because replica has last-logged OpId of term: 7 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:27:36.444285  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.446494  8512 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:36.411686  8295 catalog_manager.cc:5697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 6 to 9, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 9 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:36.448230  8295 catalog_manager.cc:5697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:36.450192  8295 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:36.421809  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.413614 12038 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:36.457302  8512 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:36.415077 12054 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:36.455164  8361 connection.cc:256] RPC call timeout handler was delayed by -3.0797650780000367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
I20260709 12:27:36.445709  9042 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:36.456843  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.460924  8541 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:36.461122  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:36.414915 12119 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:36.443965 12073 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.461467  8538 raft_consensus.cc:2410] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:27:36.466682 12119 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.467872 12119 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.468158 12168 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:36.468544 12168 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:36.468905 12168 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:36.435017 12074 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.472510 12074 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:36.460009 12038 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.473057 12038 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.474395  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.475512  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.422482 12108 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:36.461771  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.463433  9043 raft_consensus.cc:1240] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:36.463709  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:36.479099  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.423261 12092 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:27:36.465689  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.419416 12177 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.484175  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:36.460171  8361 connection.cc:256] RPC call timeout handler was delayed by -3.0725650780000251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 12:27:36.488770  8436 connection.cc:256] RPC call timeout handler was delayed by -1.6332469400003902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260709 12:27:36.489151  8436 connection.cc:256] RPC call timeout handler was delayed by -1.1189400050002405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
I20260709 12:27:36.476040  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.425818 12100 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:36.479785  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:36.492465  9049 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.480082  8541 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:36.493736  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.454496  8295 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:36.481876  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.482342  8394 raft_consensus.cc:2393] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:36.483052  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.496750  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.497459  9044 raft_consensus.cc:2393] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:36.498492 12176 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.499392 12177 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:36.478607 12197 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:36.500214 12197 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:36.500559 12197 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:36.501070  9016 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:36.463335  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.502627  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.459439 12178 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:36.488224  8512 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:36.495522  9042 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:36.504376  8542 raft_consensus.cc:2410] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:36.507651  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:36.509351  8394 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:36.506086  8295 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 4 to 7, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:36.507565  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.513813  8295 catalog_manager.cc:5697] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 2 to 5, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 5 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:36.515558  8295 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:36.518226  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.518771  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.520094  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.520737  8392 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:36.522266  9049 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:36.518031 11474 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:36.429096 11530 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:36.535699  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.524439  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:36.536337  8397 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:36.527803  9047 raft_consensus.cc:2393] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 14: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:36.539135  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.532805  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.538156  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.542232  8389 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:36.545821  8466 raft_consensus.cc:1240] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 4. Current term is 5. Ops: []
I20260709 12:27:36.541383  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:36.546608  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:36.523764  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.559015  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.560145  8390 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:36.567538  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.567802  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.568445  8467 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:36.568635  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.569288  8540 raft_consensus.cc:2393] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:36.569159  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.569972  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.570246  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.570808  8467 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:36.571043  8388 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:36.571525  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.546288 11929 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:27:36.572305  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:36.572553  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.572927  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.573091  8545 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:36.503916 12100 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:36.573473  8389 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:36.573657  9042 raft_consensus.cc:2393] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:36.573890  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.574443  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.577580  8540 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:36.578541  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.579074  8540 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:36.579836  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.512405 12178 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:36.597319  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.598511  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.600226  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.602381  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.603015  8391 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
W20260709 12:27:36.604792  8436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 1.793s (SENT) [suppressed 18 similar messages]
I20260709 12:27:36.605988  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:36.606613  8397 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:36.582924 12195 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.608191  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.511647 12056 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:36.602138  8541 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 8.
I20260709 12:27:36.607720  8472 raft_consensus.cc:1240] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:36.524513 12108 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:36.629973  8544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 2040) took 3430 ms (client timeout 1793 ms). Trace:
I20260709 12:27:36.545243 12171 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:36.513101 12106 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:36.624588  8392 raft_consensus.cc:2393] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:36.636096  8470 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:27:36.630452  8544 rpcz_store.cc:269] 0709 12:27:33.199884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:33.200146 (+   262us) service_pool.cc:224] Handling call
0709 12:27:36.629799 (+3429653us) spinlock_profiling.cc:243] Waited 3.15 s on lock 0x7b5400099a54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:36.629909 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7241482624}
I20260709 12:27:36.635813 12171 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.639328  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.573407  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.642561  8393 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:36.642911  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.644338  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.597285 12178 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:36.574026 12129 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:36.641737  8397 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:27:36.596163 12100 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.648200  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.645591  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.649039  8546 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
W20260709 12:27:36.647516  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.649242  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.657773  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.668941  8538 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.559302 12114 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.631259 12092 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:36.654309  8544 raft_consensus.cc:2410] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:27:36.638156 12056 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.642047 12171 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.641085  8467 raft_consensus.cc:1240] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: [8.5-10.6]
W20260709 12:27:36.671480  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 124936us
I20260709 12:27:36.641692  8395 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:36.685985  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:36.523747  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.687747  8537 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:36.673381  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:36.674278  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.676512  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:36.690608  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.691116  8543 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:36.692198  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.696030  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.696610  8546 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:36.654070  9046 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:36.697645  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:36.701465  9014 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:36.698462  8467 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:36.668241 12204 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.707028  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:36.708527  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.682480 12129 raft_consensus.cc:697] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:36.709087  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.721053  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.752993  8537 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 7.
W20260709 12:27:36.710413  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:36.755729  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:36.756242  8511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.712034  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.758584  8543 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:36.714385  8468 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
W20260709 12:27:36.759845  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50814.5us
W20260709 12:27:36.762243  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.760365  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.709824 12172 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:36.703061 12068 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:36.768941  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:36.751959 12039 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.704883  8512 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:36.768333  8438 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:36.812794  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 44553.7us
I20260709 12:27:36.813561  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.711205 12176 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.817054  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:36.766427 12059 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:36.810774  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.711342 12164 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:36.770816  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:36.757789 12195 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:36.767966 12072 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:36.823724  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 218948us
I20260709 12:27:36.769600 11903 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:27:36.795138 12158 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:27:36.710718 12108 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.777619  8544 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:37.013862  8538 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
W20260709 12:27:37.033875  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 329064us
I20260709 12:27:37.004992  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:36.857082  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.035436  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.879993  8539 raft_consensus.cc:2410] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:27:36.917654  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.892338  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.037077  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:36.901832  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:37.039595  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:36.900194  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.040381  8540 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:37.043467  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:37.032359  8361 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.005s	sys 0.009s
W20260709 12:27:37.047199  8361 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.005s	sys 0.009s
W20260709 12:27:37.047498  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 558550us
W20260709 12:27:37.047961  8361 connection.cc:256] RPC call timeout handler was delayed by -3.0164866679997431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2637s for a response
W20260709 12:27:37.048305  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:37.049171  8361 connection.cc:256] RPC call timeout handler was delayed by -2.8958866680000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2771s for a response
W20260709 12:27:37.049593  8361 connection.cc:256] RPC call timeout handler was delayed by -2.6615262250002161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 12:27:37.049960  8361 connection.cc:256] RPC call timeout handler was delayed by -2.5787262250000822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:27:37.050380  8361 connection.cc:256] RPC call timeout handler was delayed by -2.4728866679997736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32410000000000005s for a response
W20260709 12:27:37.050704  8361 connection.cc:256] RPC call timeout handler was delayed by -2.3669650780002485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29710000000000003s for a response
W20260709 12:27:37.051136  8361 connection.cc:256] RPC call timeout handler was delayed by -1.8903860460000033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 12:27:37.172070  8361 connection.cc:256] RPC call timeout handler was delayed by -1.6780331309996654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 12:27:37.173360  8361 connection.cc:256] RPC call timeout handler was delayed by -1.6562122790001013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260709 12:27:37.052671  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.174752  8538 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:37.175817  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.176373  8538 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:37.177129  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.178093  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.038364  8541 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:37.055125  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:36.894117 12220 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
W20260709 12:27:37.179210  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 124145us
I20260709 12:27:37.179262  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:36.869055 12086 consensus_meta.cc:287] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.014s
I20260709 12:27:37.179940  8463 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 2137) took 1380 ms. Trace:
W20260709 12:27:37.062846  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:36.997728 12224 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:27:37.181175 12093 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:36.886775 12222 log.cc:927] Time spent T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:27:37.064394  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.182758  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:37.182905  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 2138) took 1383 ms. Trace:
I20260709 12:27:36.819670 12073 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:37.180013 12086 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.184351 12073 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.183284  8464 rpcz_store.cc:276] 0709 12:27:35.799440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.273534 (+474094us) service_pool.cc:224] Handling call
0709 12:27:36.284397 (+ 10863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:36.291838 (+  7441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:36.291882 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:36.304588 (+ 12706us) log.cc:844] Serialized 26 byte log entry
0709 12:27:36.425527 (+120939us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4800231e58. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64692b2aa1 00007f64692a9b37 00007f64692a99ca 00007f64693a126f 00007f64693a0f37 00007f64693b555c 00007f64693b5508 00007f64693b5488 00007f64693b5443 00007f64693b46ec 00007f64682dea96
0709 12:27:36.508864 (+ 83337us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:36.508904 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.508964 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.182646 (+673682us) raft_consensus.cc:1685] finished
0709 12:27:37.182664 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.182852 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7069,"raft.queue_time_us":7188,"raft.run_cpu_time_us":2572,"raft.run_wall_time_us":131473,"spinlock_wait_cycles":5266176,"thread_start_us":182260,"threads_started":1,"wal-append.queue_time_us":322696}
I20260709 12:27:37.183765  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.185587  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.034508 12059 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:37.062927  8512 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:36.825170 12144 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:37.029191 11530 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:36.996382 12056 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.186417 12144 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.186143 12059 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:37.186813 12056 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:37.094995  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:37.180681  8361 connection.cc:256] RPC call timeout handler was delayed by -1.2341262250001819s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.34230000000000005s for a response
I20260709 12:27:36.824700 11985 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:37.187660 11985 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.188035 11985 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:36.978096 12114 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.099026  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.052933 12132 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:37.191231  8544 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
W20260709 12:27:37.111196  8394 consensus_meta.cc:287] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.007s
I20260709 12:27:37.180328  8463 rpcz_store.cc:276] 0709 12:27:35.799161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.254928 (+455767us) service_pool.cc:224] Handling call
0709 12:27:36.255217 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:36.255585 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:36.255614 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:36.292573 (+ 36959us) log.cc:844] Serialized 52 byte log entry
0709 12:27:36.623715 (+331142us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:27:36.623757 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:36.623825 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:37.179727 (+555902us) raft_consensus.cc:1685] finished
0709 12:27:37.179750 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.179885 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7639,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":313146,"threads_started":1,"wal-append.queue_time_us":322651}
W20260709 12:27:37.117411 12168 consensus_meta.cc:287] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.648s	user 0.003s	sys 0.007s
I20260709 12:27:37.121832 12178 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.843572 12218 consensus_queue.cc:1059] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.253s
I20260709 12:27:36.885154 12000 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.923427 12119 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:36.883507 12129 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:37.140527  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 320300us
W20260709 12:27:37.148080  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 446664us
I20260709 12:27:37.163583 12172 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.171031  9041 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:36.890700  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:37.193982 12227 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:27:37.185745 12086 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.186201  8467 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:37.240466  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.181692 12093 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.194747 12104 raft_consensus.cc:2804] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:37.193616 12132 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.180377  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:37.188942  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 126101us
W20260709 12:27:37.155195 12197 consensus_meta.cc:287] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.000s
I20260709 12:27:37.180882  8436 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:37.180300  8465 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:37.269891 12197 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.186432  8471 raft_consensus.cc:2393] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:37.271136 12068 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:37.272301 12197 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:37.273079  8545 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:37.188834  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:37.273962  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 85187.9us
I20260709 12:27:37.274639  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:37.274827 12093 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:37.192075  8394 raft_consensus.cc:2468] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 14.
I20260709 12:27:37.269579  8512 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:37.276108 12195 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.276753 12195 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:37.193131  9044 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.012s
W20260709 12:27:37.277454  9044 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.005s	sys 0.012s
I20260709 12:27:37.278342  8388 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 13. Current term is 14. Ops: []
W20260709 12:27:37.193480  8390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.011s
W20260709 12:27:37.279621  8390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.009s	sys 0.011s
I20260709 12:27:37.230233  9014 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:37.280512 12074 consensus_meta.cc:287] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.002s
I20260709 12:27:37.237768  8546 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 7.
I20260709 12:27:37.281145 12074 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:37.184763 12073 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:37.281734 12038 consensus_meta.cc:287] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.808s	user 0.005s	sys 0.014s
I20260709 12:27:37.281942 12234 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.283919 12000 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.284653 12104 raft_consensus.cc:697] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:37.280740  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50598.3us
I20260709 12:27:37.286191  8541 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:37.286362  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:37.281483  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.289568  8546 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:37.288569  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.186821 12144 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.241261  8544 raft_consensus.cc:2410] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:27:36.812700 12039 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.265054  8538 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:37.053180 12181 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:37.267874  8463 raft_consensus.cc:1240] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:37.279217  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.190891 12056 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:37.281546 12074 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:37.239526 12114 raft_consensus.cc:3055] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:27:37.296840  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 116031us
I20260709 12:27:37.310168  8436 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:37.269112 12218 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:37.304455 12178 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:37.194185 12168 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.300876 12056 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.298049  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.327071  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.327489  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.315204  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.284605 12119 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:37.291625 12132 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.296486 12233 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:37.312762  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:37.309293 12074 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.329370  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:37.336668  8543 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:37.313477 12068 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:37.352942  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.353128  8543 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:27:37.353766  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 2042) took 1107 ms. Trace:
I20260709 12:27:37.332823  8511 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:37.309722 12114 raft_consensus.cc:740] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:37.355515  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 80950.4us
I20260709 12:27:37.337718  8546 raft_consensus.cc:2410] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:27:37.340157  8436 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:37.316921 11903 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.360826 11929 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:37.351528 12104 consensus_queue.cc:237] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:37.341301 12171 consensus_meta.cc:287] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.640s	user 0.005s	sys 0.004s
I20260709 12:27:37.363346 12171 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.363619 12056 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.364506  8542 raft_consensus.cc:2393] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:37.365446 12171 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:37.340756 12072 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:37.344313 12000 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:27:37.345033 12054 consensus_meta.cc:287] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.877s	user 0.006s	sys 0.003s
I20260709 12:27:37.346060  8545 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:37.313823 12181 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.352406 12068 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:37.347323  8537 raft_consensus.cc:1275] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:27:37.348683 12039 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.366226 12000 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:37.368978 12000 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:37.336136 12233 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:37.371588 12233 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:37.371914 12201 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.367370 12068 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.372383 12201 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.374605 12201 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.375073 12201 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.366731  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 2043) took 1120 ms. Trace:
I20260709 12:27:37.375782  8545 rpcz_store.cc:276] 0709 12:27:36.246446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.345421 (+1098975us) service_pool.cc:224] Handling call
0709 12:27:37.345738 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.366487 (+ 20749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.366667 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.377187  8545 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:27:37.377674  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 388) took 1074 ms. Trace:
I20260709 12:27:37.377957  8545 rpcz_store.cc:276] 0709 12:27:36.303683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.376590 (+1072907us) service_pool.cc:224] Handling call
0709 12:27:37.376904 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.377471 (+   567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.377626 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:37.378750 12100 consensus_meta.cc:287] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.002s
I20260709 12:27:37.368201 12181 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.368340  8537 pending_rounds.cc:85] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 3
I20260709 12:27:37.380155  8537 pending_rounds.cc:107] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:27:37.380370  8537 raft_consensus.cc:2889] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:37.381013  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 2045) took 1134 ms. Trace:
I20260709 12:27:37.366359 12054 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.383296 12054 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.383492  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.383900  8466 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:37.384701  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.385182  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.386204  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:37.386580  8472 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:37.367019 11474 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:37.387230 11474 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:37.379136 12100 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.391109  8467 raft_consensus.cc:1240] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:37.356452  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:37.392491  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.392935  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 390) took 1088 ms. Trace:
I20260709 12:27:37.393426  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.394515  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:37.296964 12038 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.394789 12142 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:37.396126  8542 raft_consensus.cc:1240] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:37.396450 12038 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:37.396708  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 392) took 1077 ms. Trace:
I20260709 12:27:37.354054  8543 rpcz_store.cc:276] 0709 12:27:36.246190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.352487 (+1106297us) service_pool.cc:224] Handling call
0709 12:27:37.352809 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.353509 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.353698 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.397329 11903 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:37.397776 11903 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:37.398442  8543 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:27:37.381302  8537 rpcz_store.cc:276] 0709 12:27:36.246957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.346729 (+1099772us) service_pool.cc:224] Handling call
0709 12:27:37.347027 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.380795 (+ 33768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.380962 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.400386  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 395) took 1035 ms. Trace:
I20260709 12:27:37.400687  8537 rpcz_store.cc:276] 0709 12:27:36.365321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.399647 (+1034326us) service_pool.cc:224] Handling call
0709 12:27:37.399937 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.400102 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.400128 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.400163 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:37.400205 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.400251 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.400338 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.402225 12144 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.359892 12195 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:37.403055 12195 consensus_queue.cc:1243] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:27:37.357978 12114 consensus_queue.cc:260] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.403784 12114 raft_consensus.cc:3060] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.386693  8466 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.360095  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:37.340758 12168 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:37.318641 12218 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.397329  8470 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:37.408962  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 76190.7us
I20260709 12:27:37.409365 12218 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:37.357220 12241 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:27:37.409914 12218 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:27:37.410472  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50459us
I20260709 12:27:37.402572 12038 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:37.386264  8469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 2149) took 1326 ms (client timeout 1664 ms). Trace:
I20260709 12:27:37.411458  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.397823  8465 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1941) took 1120 ms. Trace:
I20260709 12:27:37.411808 12038 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.394464  8471 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 2153) took 1118 ms. Trace:
I20260709 12:27:37.412792  8471 rpcz_store.cc:276] 0709 12:27:36.276497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.333364 (+ 56867us) service_pool.cc:224] Handling call
0709 12:27:37.394293 (+1060929us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b54001a4854. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:37.394414 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1768148224}
I20260709 12:27:37.413879 12038 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:37.413707 12074 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.411805 12168 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.361248 11929 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:37.409556  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.415915  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 393) took 1077 ms. Trace:
I20260709 12:27:37.393307  8540 rpcz_store.cc:276] 0709 12:27:36.304153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.392267 (+1088114us) service_pool.cc:224] Handling call
0709 12:27:37.392534 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.392668 (+   134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.392690 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.392725 (+    35us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:37.392750 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.392808 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.392887 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.411808  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:37.381263  9016 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:37.416785  8468 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:37.359179 12059 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.402227  8537 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:37.419286  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 401) took 1052 ms. Trace:
I20260709 12:27:37.416599  8543 rpcz_store.cc:276] 0709 12:27:36.338475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.397799 (+1059324us) service_pool.cc:224] Handling call
0709 12:27:37.398082 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.415589 (+ 17507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.415864 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.397094  8542 rpcz_store.cc:276] 0709 12:27:36.319750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.395710 (+1075960us) service_pool.cc:224] Handling call
0709 12:27:37.395977 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.396476 (+   499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.396657 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.424453  8466 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:37.424810  8511 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:37.417176  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.419745  8537 rpcz_store.cc:276] 0709 12:27:36.366876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.401689 (+1034813us) service_pool.cc:224] Handling call
0709 12:27:37.401955 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.419038 (+ 17083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.419228 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:37.415048  8469 rpcz_store.cc:269] 0709 12:27:36.059958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.185847 (+125889us) service_pool.cc:224] Handling call
0709 12:27:37.386098 (+1200251us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54001a5c54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:37.386212 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1181903104}
I20260709 12:27:37.412168  8465 rpcz_store.cc:276] 0709 12:27:36.277304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.426593 (+149289us) service_pool.cc:224] Handling call
0709 12:27:37.180141 (+753548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.269964 (+ 89823us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.397635 (+127671us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b5400196750. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:37.397763 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1732329344}
I20260709 12:27:37.429572  8470 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:37.430357  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:37.431535  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50369.8us
I20260709 12:27:37.432731  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:37.430612  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2035) took 1219 ms. Trace:
I20260709 12:27:37.430649  8546 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:37.356978  8361 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:37.433636  8539 rpcz_store.cc:276] 0709 12:27:36.211688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.211844 (+   156us) service_pool.cc:224] Handling call
0709 12:27:37.430448 (+1218604us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54001d6ad4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:37.430562 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498585472}
I20260709 12:27:37.434388  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2053) took 1004 ms. Trace:
I20260709 12:27:37.434814  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.434762  8546 rpcz_store.cc:276] 0709 12:27:36.430344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.425895 (+995551us) service_pool.cc:224] Handling call
0709 12:27:37.430342 (+  4447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.434096 (+  3754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.434334 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.437916  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.440052  8466 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:37.441530  8362 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:37.444186  8472 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 1952) took 1085 ms. Trace:
I20260709 12:27:37.388233 12233 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.455401  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.455211  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.444600  8472 rpcz_store.cc:276] 0709 12:27:36.359134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:36.654411 (+295277us) service_pool.cc:224] Handling call
0709 12:27:37.386408 (+731997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.386962 (+   554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.443986 (+ 57024us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54001a5c50. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:37.444121 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619421056}
I20260709 12:27:37.454347  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:37.455260  8538 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:37.466827  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.468178  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2050) took 1038 ms. Trace:
I20260709 12:27:37.405460 12144 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.429641 12168 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.468550  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.456009  8546 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.468083  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2054) took 1037 ms. Trace:
I20260709 12:27:37.457037  8511 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:37.472011  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.473790  8468 raft_consensus.cc:2468] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:37.468321  8469 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:37.471925  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.474661  8511 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:37.457032  9048 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.473399  8537 rpcz_store.cc:276] 0709 12:27:36.430563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.429081 (+998518us) service_pool.cc:224] Handling call
0709 12:27:37.467605 (+ 38524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.467792 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.467816 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.467857 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:37.467889 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.467939 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.468033 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.475883  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.474967  8540 rpcz_store.cc:276] 0709 12:27:36.429671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.417640 (+987969us) service_pool.cc:224] Handling call
0709 12:27:37.467379 (+ 49739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.467898 (+   519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.467922 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.467961 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:37.467990 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.468035 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.468128 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.474756  8396 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.476547  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.457329  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2049) took 1027 ms. Trace:
I20260709 12:27:37.477253  8538 rpcz_store.cc:276] 0709 12:27:36.429414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.416686 (+987272us) service_pool.cc:224] Handling call
0709 12:27:37.455086 (+ 38400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.457091 (+  2005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.457279 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.473968  8395 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.429803 12201 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.393544 12100 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:37.431186 11929 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:37.366102 12056 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:37.487668  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.493264  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:37.488660  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:37.493413  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.455861 11873 raft_consensus.cc:2804] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:37.510777 11873 raft_consensus.cc:697] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 14 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:37.491734 12178 consensus_queue.cc:1059] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:27:37.511756 11873 consensus_queue.cc:237] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.494015  8388 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:37.494391  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.514001  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.494933  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.495537  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.515446  8393 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:37.495994  8546 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:37.451915 12130 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:37.499015  8511 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:37.499606 12168 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.500316  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.521821  8395 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:37.504204 11474 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:37.504999  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:37.470799 12108 consensus_queue.cc:1059] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:27:37.456055 12039 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:27:37.497041 12172 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.435865 12171 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:37.521924  8392 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.536033  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.536233  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.536672  8394 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.537750  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.538821  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.472308 12158 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:27:37.522733  9042 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:37.549990  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.522475 12195 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:27:37.558138  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.522831  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.523473  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.559842  8390 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.452147 12135 raft_consensus.cc:2764] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:27:37.484838 12197 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.398766 11903 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.531541  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.564955  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.500595 12201 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.546583  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.565954  8540 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.568326  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.569368  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.567286  8390 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:37.497666 12074 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:37.565433 11903 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.573140  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.576165  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.578673  8389 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.578791  8388 raft_consensus.cc:3060] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:37.539631 12110 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:37.500716 12073 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.599936 12059 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.554764 12130 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:37.600790 12073 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.600714 12130 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.602823 12130 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:37.605707  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.606844  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.609098  8546 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:27:37.555538 12119 raft_consensus.cc:3055] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:37.609660 12119 raft_consensus.cc:740] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:37.610535 12119 consensus_queue.cc:260] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.607165  8389 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:37.609685  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2055) took 1178 ms. Trace:
I20260709 12:27:37.585083  8394 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:37.585548  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:37.612457  8546 rpcz_store.cc:276] 0709 12:27:36.430777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.608543 (+1177766us) service_pool.cc:224] Handling call
0709 12:27:37.608818 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.609462 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.609632 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.582685  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.614058  8393 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.587734 11985 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.628984  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:37.585901 12201 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:37.592631 11474 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.586097 12195 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:37.598170 12068 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.611668 12119 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.571810 12086 consensus_queue.cc:1059] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:27:37.607328  8537 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:37.612967  8466 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:37.670054  8392 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:37.671592  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.617600  8394 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:37.671860  8467 raft_consensus.cc:2393] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:37.672156  8392 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:37.618070  8390 raft_consensus.cc:1240] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:37.618389  8388 raft_consensus.cc:2468] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:37.673667  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.619236  8512 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:37.585615  8540 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:37.619735  9048 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
W20260709 12:27:37.586795  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 301857us
I20260709 12:27:37.640165  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.676134  8546 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:37.641229  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.644834  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:37.660804  8469 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:27:37.680136  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 60971.3us
I20260709 12:27:37.681252  8512 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:37.678660  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2060) took 1215 ms. Trace:
I20260709 12:27:37.681875  8539 rpcz_store.cc:276] 0709 12:27:36.463281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.677896 (+1214615us) service_pool.cc:224] Handling call
0709 12:27:37.678181 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.678374 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.678399 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.678438 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:37.678469 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.678516 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.678605 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.683422  8539 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:37.667286  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 51706us
I20260709 12:27:37.678376  9015 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:37.682469  8512 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:37.691741  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2064) took 1216 ms. Trace:
I20260709 12:27:37.692207  8539 rpcz_store.cc:276] 0709 12:27:36.475677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.682922 (+1207245us) service_pool.cc:224] Handling call
0709 12:27:37.683228 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.691487 (+  8259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.691682 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.694758  8546 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:37.700294  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:37.701035  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 72637us
I20260709 12:27:37.701543  8538 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:37.702116  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2056) took 1271 ms. Trace:
I20260709 12:27:37.702448  8538 rpcz_store.cc:276] 0709 12:27:36.431013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.670309 (+1239296us) service_pool.cc:224] Handling call
0709 12:27:37.701383 (+ 31074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.701915 (+   532us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.702068 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:37.702426  8393 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:37.698822  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:37.704870  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:37.701658  8438 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:37.707156  8394 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:37.705469  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:37.640869 12164 consensus_queue.cc:1059] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:27:37.709273  8546 raft_consensus.cc:1240] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:27:37.709425  8436 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:37.687479 12172 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:37.712404  8466 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
W20260709 12:27:37.717401  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.739156  8512 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:37.697250 12074 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:37.765588  8394 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:37.706406 12197 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:37.706542 12027 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:37.781504  8537 raft_consensus.cc:2410] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:27:37.801204  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2052) took 1371 ms. Trace:
I20260709 12:27:37.801635  8542 rpcz_store.cc:276] 0709 12:27:36.430115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.424182 (+994067us) service_pool.cc:224] Handling call
0709 12:27:37.435825 (+ 11643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.436020 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:37.436251 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 12:27:37.800885 (+364634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:37.800941 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:37.800988 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:37.801043 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:37.801148 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61774,"prepare.queue_time_us":547,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3541,"thread_start_us":276416,"threads_started":1}
I20260709 12:27:37.687923 12000 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:37.833317  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 334345us
I20260709 12:27:37.786631  8392 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:37.788329  8388 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:37.864693  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:37.775308 12129 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:37.866740  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.799430 12108 raft_consensus.cc:2764] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:27:37.714989 12132 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.878887  8464 raft_consensus.cc:1240] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:37.716428 12059 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.148s
I20260709 12:27:37.710192 12234 consensus_queue.cc:1059] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:27:37.790040 12027 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:37.866134 12220 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:27:37.798847 12166 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:37.891981 12068 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:37.892850 11985 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:37.895987 12249 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260709 12:27:37.896651 12251 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:27:37.774816 12201 consensus_queue.cc:1059] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 12:27:37.901204  8362 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:37.891275  8393 raft_consensus.cc:1240] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: [6.6-11.8]
I20260709 12:27:37.910781  8541 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:37.923332  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:37.883278 12142 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:37.799475 12195 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:37.907819 12027 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:27:37.974009 12248 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 12:27:37.992865  8393 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:38.039613  8543 raft_consensus.cc:1240] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:38.004525  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 103384us
W20260709 12:27:39.217032  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:38.002894  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 645921us
I20260709 12:27:39.714879  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1874) took 2188 ms. Trace:
I20260709 12:27:40.654060  8393 rpcz_store.cc:276] 0709 12:27:37.526570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.039421 (+512851us) service_pool.cc:224] Handling call
0709 12:27:38.039695 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:39.714475 (+1674780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:39.714508 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:39.714554 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:39.714589 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:39.714642 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:39.714779 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:40.656664  8361 leader_election.cc:400] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:40.657123  8361 leader_election.cc:403] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:37.996971  8396 consensus_meta.cc:287] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.000s
I20260709 12:27:40.661425  8396 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:40.662571  8390 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 12:27:40.665961  8390 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1866) took 3177 ms. Trace:
I20260709 12:27:40.666299  8390 rpcz_store.cc:276] 0709 12:27:37.488356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.898246 (+409890us) service_pool.cc:224] Handling call
0709 12:27:40.662032 (+2763786us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.662970 (+   938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.665718 (+  2748us) spinlock_profiling.cc:243] Waited 2.76 s on lock 0x7b54003dead0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f64643888ad 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:40.665900 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6355083008}
W20260709 12:27:39.657101  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:38.003134  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 293772us
W20260709 12:27:37.991583  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 289959us
W20260709 12:27:39.690951  8510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.858s	user 0.003s	sys 0.030s
W20260709 12:27:40.771893  8510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.956s	user 0.004s	sys 0.030s
W20260709 12:27:39.763279  8512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.997s	user 0.015s	sys 0.017s
I20260709 12:27:39.549434  8537 raft_consensus.cc:1240] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: []
W20260709 12:27:40.451228  8362 connection.cc:256] RPC call timeout handler was delayed by -2.5013773069999843s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:27:40.776571  8512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.010s	user 0.016s	sys 0.017s
I20260709 12:27:40.777294  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2075) took 3774 ms. Trace:
I20260709 12:27:40.777791  8537 rpcz_store.cc:276] 0709 12:27:37.002838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:39.548865 (+2546027us) service_pool.cc:224] Handling call
0709 12:27:39.549237 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:40.776688 (+1227451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.777087 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:40.778388  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 3.03901e+06us
W20260709 12:27:39.812602  8540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.998s	user 0.009s	sys 0.046s
W20260709 12:27:39.684386  8545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.780s	user 0.000s	sys 0.032s
I20260709 12:27:40.763150  8438 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:40.785815  8438 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:38.000874  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 296589us
I20260709 12:27:40.591429  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1878) took 2932 ms. Trace:
I20260709 12:27:40.851579  8388 rpcz_store.cc:276] 0709 12:27:37.659107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.040369 (+381262us) service_pool.cc:224] Handling call
0709 12:27:38.040639 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.040825 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:27:40.424242 (+2383417us) log.cc:844] Serialized 14 byte log entry
0709 12:27:40.590082 (+165840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:40.590474 (+   392us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:40.590626 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.590760 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.591082 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3161,"prepare.queue_time_us":156,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":921,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":692,"thread_start_us":106344,"threads_started":1,"wal-append.queue_time_us":149013}
W20260709 12:27:40.854094  8541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2063) took 4329 ms (client timeout 4363 ms). Trace:
I20260709 12:27:40.594079 12290 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:40.854694  9015 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:40.855291 12290 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:38.128867 11929 consensus_meta.cc:287] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.623s	user 0.009s	sys 0.000s
I20260709 12:27:38.062564 12038 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:38.013932 12142 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:39.621469 12072 raft_consensus.cc:3055] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:37.973256 12166 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:38.001286 12181 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.004s	sys 0.013s
W20260709 12:27:38.135113 12253 log.cc:927] Time spent T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
I20260709 12:27:40.877794 12290 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:38.136906 12255 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:27:40.869285 12168 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:39.774677 12256 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 1.768s	user 0.038s	sys 0.034s
I20260709 12:27:38.075616 12259 raft_consensus.cc:3055] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:40.884459 12259 raft_consensus.cc:740] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:40.884872 12142 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:40.885762 12142 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:40.885870 12259 consensus_queue.cc:260] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:40.886461 12142 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:39.805965 11903 raft_consensus.cc:3055] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:38.137581 12000 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:38.154222 12027 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:40.892767 12038 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:40.894119 12038 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:40.894671 12027 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:38.145733 12114 consensus_meta.cc:287] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.742s	user 0.003s	sys 0.005s
I20260709 12:27:38.149847 12132 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:38.064553 12220 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:37.888506 12233 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:40.589550 12164 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.816s	user 0.011s	sys 0.046s
W20260709 12:27:40.949321 12164 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.184s	user 0.011s	sys 0.048s
W20260709 12:27:40.616645  9013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.883s	user 0.026s	sys 0.064s
W20260709 12:27:40.950672  9013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.217s	user 0.027s	sys 0.065s
W20260709 12:27:40.621429  9014 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.636049 11474 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.637161  9016 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:40.638423  8392 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1875) took 3111 ms. Trace:
I20260709 12:27:40.952960 11474 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:40.953037  8392 rpcz_store.cc:276] 0709 12:27:37.526812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:38.039989 (+513177us) service_pool.cc:224] Handling call
0709 12:27:38.043036 (+  3047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.043919 (+   883us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:40.635958 (+2592039us) log.cc:844] Serialized 14 byte log entry
0709 12:27:40.637705 (+  1747us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:40.637777 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:40.637868 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.637998 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.638265 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1112,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":125,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":203,"spinlock_wait_cycles":20352,"thread_start_us":1469,"threads_started":2,"wal-append.queue_time_us":1208}
I20260709 12:27:40.659749 12195 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:40.955451 11474 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:40.673805  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50338 (request call id 634) took 2969 ms. Trace:
I20260709 12:27:40.673570 12293 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:40.958837  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 3.09382e+06us
I20260709 12:27:40.958827 12293 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:40.961170 12293 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:40.677805  9041 raft_consensus.cc:1240] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 14 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:40.673646  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:40.962832  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 289901us
W20260709 12:27:40.683687  8396 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1937) took 3212 ms (client timeout 1780 ms). Trace:
W20260709 12:27:40.963585  8396 rpcz_store.cc:269] 0709 12:27:37.471601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.471705 (+   104us) service_pool.cc:224] Handling call
0709 12:27:40.683546 (+3211841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:40.685125 12299 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.965222 12299 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:40.966683  8436 connection.cc:256] RPC call timeout handler was delayed by -1.8503518239999721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:27:40.967100  8436 connection.cc:256] RPC call timeout handler was delayed by -1.0457518240000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.244s for a response
I20260709 12:27:40.688482 12144 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.967854 12144 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:40.968389  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:40.970590 12144 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:40.693382  8542 raft_consensus.cc:1275] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:27:40.971573  8542 pending_rounds.cc:85] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 7
W20260709 12:27:40.695202  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.971807 12000 consensus_queue.cc:1059] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:40.972146 12160 consensus_queue.cc:1059] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:40.971861 12305 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:40.973487 12305 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:40.973852  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:40.697845  8397 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60394 (request call id 1944) took 3223 ms (client timeout 2629 ms). Trace:
W20260709 12:27:40.975333  8397 rpcz_store.cc:269] 0709 12:27:37.474388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.564656 (+ 90268us) service_pool.cc:224] Handling call
0709 12:27:40.697553 (+3132897us) spinlock_profiling.cc:243] Waited 3.13 s on lock 0x7b54002058d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:40.697688 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7200225536}
I20260709 12:27:40.975000 12305 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:40.709110  8391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.806s	user 0.035s	sys 0.024s
I20260709 12:27:40.709589 12300 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.713964 12093 raft_consensus.cc:3055] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:40.725654  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2078) took 3544 ms. Trace:
W20260709 12:27:40.728935  8539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.854s	user 0.018s	sys 0.049s
W20260709 12:27:40.729502  8389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.826s	user 0.020s	sys 0.016s
I20260709 12:27:40.735459 12218 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.741802  8464 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39218 (request call id 2163) took 3313 ms. Trace:
I20260709 12:27:40.745672 12294 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:40.780162  8537 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:27:40.791050  8512 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:40.797560  8545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.909s	user 0.000s	sys 0.033s
W20260709 12:27:40.798456  8540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.981s	user 0.010s	sys 0.047s
I20260709 12:27:40.809135 12302 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.816782 12301 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:27:40.822219  8509 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:40.993788  8537 pending_rounds.cc:85] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 6
I20260709 12:27:40.809183 12303 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:40.978360 12093 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:40.971239 12144 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:41.011659 12027 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.012261 12144 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.013087 12171 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:41.013164  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 360) took 3580 ms. Trace:
I20260709 12:27:40.594028 12291 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.856101 12191 raft_consensus.cc:2804] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:41.014309 12191 raft_consensus.cc:697] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:41.014791  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2058) took 4583 ms. Trace:
W20260709 12:27:40.854586  8541 rpcz_store.cc:269] 0709 12:27:36.524947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.327231 (+802284us) service_pool.cc:224] Handling call
0709 12:27:40.853591 (+3526360us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54001b3354. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:40.853874 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1339665280}
I20260709 12:27:40.866022 12072 raft_consensus.cc:740] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:40.867321 12304 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:40.868180 12166 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.015221  8540 rpcz_store.cc:276] 0709 12:27:36.439560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.675179 (+1235619us) service_pool.cc:224] Handling call
0709 12:27:37.705185 (+ 30006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.705541 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.705569 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.712916 (+  7347us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.014401 (+3301485us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:41.014457 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.014536 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.014594 (+    58us) raft_consensus.cc:1685] finished
0709 12:27:41.014606 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.014734 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3520,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":49780,"thread_start_us":3179515,"threads_started":1,"wal-append.queue_time_us":382474,"wal-append.run_cpu_time_us":1739,"wal-append.run_wall_time_us":1001770}
I20260709 12:27:41.018337  8540 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:40.869210 12296 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:40.872586  8543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2051) took 4442 ms. Trace:
W20260709 12:27:40.887810 12181 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.421s	user 0.004s	sys 0.016s
I20260709 12:27:40.888391 11929 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:40.889559  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 394) took 4524 ms. Trace:
I20260709 12:27:40.888410 11903 raft_consensus.cc:740] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:40.887188 12259 raft_consensus.cc:3060] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:40.897575  9046 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:40.910132  8463 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:40.921420 12074 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:40.926143 12114 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:40.982417  8464 rpcz_store.cc:276] 0709 12:27:37.428146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.452097 (+ 23951us) service_pool.cc:224] Handling call
0709 12:27:37.467215 (+ 15118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.879875 (+412660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.741193 (+2861318us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54000d84d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:40.741558 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946339200}
W20260709 12:27:40.936213  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 150659us
I20260709 12:27:40.927865 12142 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:40.956144  8393 rpcz_store.cc:276] 0709 12:27:37.687837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.656282 (+2968445us) service_pool.cc:224] Handling call
0709 12:27:40.656867 (+   585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:40.657254 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:40.657279 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:40.657332 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:40.657366 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.657421 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.657528 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:41.014740 12144 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.073103  8544 rpcz_store.cc:276] 0709 12:27:36.364991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.399642 (+1034651us) service_pool.cc:224] Handling call
0709 12:27:37.400030 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.400349 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.400376 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.400845 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 12:27:37.713412 (+312567us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:37.859881 (+146469us) log.cc:844] Serialized 14 byte log entry
0709 12:27:40.790635 (+2930754us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b1800425020. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6461216c0a 00007f646a956219 00007f646129ea40 00007f64612994e4 00007f6461299455 00007f6464381060 00007f6464393716 00007f64643a4287 00007f64643a4208
0709 12:27:40.821737 (+ 31102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.821833 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:40.889078 (+ 67245us) raft_consensus.cc:1685] finished
0709 12:27:40.889197 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.889372 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13303,"prepare.queue_time_us":149213,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":3153690,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":194,"spinlock_wait_cycles":243044480,"thread_start_us":336643,"threads_started":2,"wal-append.queue_time_us":508187}
I20260709 12:27:41.111873  8438 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.082154 12074 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.112681 12074 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.012351 12027 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:41.113545  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.109143 11903 consensus_queue.cc:260] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:40.707926  8395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.121s	user 0.036s	sys 0.061s
W20260709 12:27:40.993181  8391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.090s	user 0.036s	sys 0.025s
I20260709 12:27:41.003895 12195 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:41.115763  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1936) took 3644 ms. Trace:
I20260709 12:27:40.971885  8542 pending_rounds.cc:107] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:27:41.110337 12086 raft_consensus.cc:3055] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:41.116403  8542 raft_consensus.cc:2889] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:41.117242  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2077) took 4055 ms. Trace:
I20260709 12:27:41.117542  8542 rpcz_store.cc:276] 0709 12:27:37.061618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.692105 (+3630487us) service_pool.cc:224] Handling call
0709 12:27:40.692678 (+   573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.116994 (+424316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.117176 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:40.976715  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:41.118425  8466 raft_consensus.cc:2376] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10. Re-sending same reply.
I20260709 12:27:40.978516  8538 rpcz_store.cc:276] 0709 12:27:37.181359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.724162 (+3542803us) service_pool.cc:224] Handling call
0709 12:27:40.724670 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:40.725066 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:40.725093 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:40.725145 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:27:40.725198 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.725265 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:40.725422 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:41.119473 12086 raft_consensus.cc:740] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:40.973013 12000 consensus_queue.cc:1059] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:27:41.154062  8395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.570s	user 0.037s	sys 0.061s
I20260709 12:27:41.008497 12100 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.009305 12300 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.009722 12197 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.013722 12171 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:41.072806  8539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.210s	user 0.019s	sys 0.049s
I20260709 12:27:41.076026 11474 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:41.006774 12302 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.077006 12093 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.077490 12072 consensus_queue.cc:260] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.078155 12291 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.080976 11929 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.081152 12304 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:40.930892 12308 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:41.108592  8541 raft_consensus.cc:1240] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:41.108788  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.109120 12218 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.015471 12191 consensus_queue.cc:237] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.110198  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.075510  8543 rpcz_store.cc:276] 0709 12:27:36.429897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.420629 (+990732us) service_pool.cc:224] Handling call
0709 12:27:37.420947 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:38.040089 (+619142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:40.872090 (+2832001us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400387054. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:40.872388 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422321920}
I20260709 12:27:40.976459  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:41.113327 12114 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.004307  8537 pending_rounds.cc:107] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:27:41.112983  8544 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:27:41.119199  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2090) took 3681 ms. Trace:
I20260709 12:27:41.018879  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2083) took 3836 ms. Trace:
W20260709 12:27:41.336256  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 317254us
I20260709 12:27:41.344743  8537 raft_consensus.cc:2889] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:41.345099  8540 rpcz_store.cc:276] 0709 12:27:37.182619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:41.017351 (+3834732us) service_pool.cc:224] Handling call
0709 12:27:41.017832 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.018674 (+   842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.018833 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:41.345202  8544 pending_rounds.cc:85] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 5
I20260709 12:27:41.346972  8544 pending_rounds.cc:107] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:27:41.347302  8544 raft_consensus.cc:2889] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:41.347024 12100 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:41.154284  8463 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39218 (request call id 2156) took 3820 ms (client timeout 1655 ms). Trace:
W20260709 12:27:41.345453  8389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.442s	user 0.027s	sys 0.027s
I20260709 12:27:41.348630  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2087) took 3912 ms. Trace:
W20260709 12:27:41.120329  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 483503us
I20260709 12:27:41.371753  8467 raft_consensus.cc:1240] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 12:27:41.349360  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 237683us
I20260709 12:27:41.233892  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.076916 12233 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.110091 12296 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.478150 12093 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:41.222168 12086 consensus_queue.cc:260] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.482867 12086 raft_consensus.cc:3060] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:41.457635 12299 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.451325 12074 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.402848  8291 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.485584  8538 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:27:41.485718  8295 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35638 (request call id 247) took 13880 ms (client timeout 15000 ms). Trace:
I20260709 12:27:41.435122 12308 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:41.407068  9014 leader_election.cc:336] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.129s (SENT)
W20260709 12:27:41.359634  8463 rpcz_store.cc:269] 0709 12:27:37.333978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.384488 (+ 50510us) service_pool.cc:224] Handling call
0709 12:27:41.153976 (+3769488us) spinlock_profiling.cc:243] Waited 3.52 s on lock 0x7b5400298e54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:41.154172 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8106026368}
I20260709 12:27:41.488768  8538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2093) took 3892 ms. Trace:
I20260709 12:27:41.165683 12294 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.489462  8538 rpcz_store.cc:276] 0709 12:27:37.596155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:41.119736 (+3523581us) service_pool.cc:224] Handling call
0709 12:27:41.120131 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:41.486051 (+365920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.488513 (+  2462us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54004493d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:41.488702 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839734528}
I20260709 12:27:41.416505 12100 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.451488  8537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2082) took 4269 ms. Trace:
I20260709 12:27:41.013625  9041 rpcz_store.cc:276] 0709 12:27:37.432212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.436530 (+  4318us) service_pool.cc:224] Handling call
0709 12:27:37.496723 (+ 60193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:40.961878 (+3465155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.012802 (+ 50924us) spinlock_profiling.cc:243] Waited 3.18 s on lock 0x7b540058aa54. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:41.013057 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7314520448}
I20260709 12:27:41.492676  8537 rpcz_store.cc:276] 0709 12:27:37.182390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:40.779024 (+3596634us) service_pool.cc:224] Handling call
0709 12:27:40.779572 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.451153 (+671581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.451390 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:41.256778 12312 raft_consensus.cc:3055] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:41.405836 12304 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.410264  8468 raft_consensus.cc:2393] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 5: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:41.478602 12218 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.408406  8472 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.488346 12233 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.373387  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2086) took 3940 ms. Trace:
I20260709 12:27:41.495772  8541 rpcz_store.cc:276] 0709 12:27:37.432705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:41.081955 (+3649250us) service_pool.cc:224] Handling call
0709 12:27:41.108351 (+ 26396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.360267 (+251916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.373318 (+ 13051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:41.004676 12293 raft_consensus.cc:3055] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:41.496627 12293 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:41.497009 12233 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.489784  8544 rpcz_store.cc:276] 0709 12:27:37.436663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:41.112067 (+3675404us) service_pool.cc:224] Handling call
0709 12:27:41.112458 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.348328 (+235870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.348544 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:41.458976  8438 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.409322  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:41.408563 12302 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.408958 12197 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.500116 12302 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:41.500555 12302 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.406546 12291 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:41.445657  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.486835  8291 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 7 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:41.373153 12160 consensus_queue.cc:1243] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:27:41.503060 12160 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:41.165701 12104 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.503489 12284 raft_consensus.cc:3055] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:41.154520 12027 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.504019 12284 raft_consensus.cc:740] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:41.504648 12168 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.504925 12311 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.505040 12314 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:41.505240  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 714374us
I20260709 12:27:41.505609 12132 raft_consensus.cc:2804] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:41.505578 12311 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.505712 12314 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.504029 12307 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.336148 11903 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:41.508096 12314 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:41.504300 12306 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.116143  8391 rpcz_store.cc:276] 0709 12:27:37.471304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.471448 (+   144us) service_pool.cc:224] Handling call
0709 12:27:37.496184 (+ 24736us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.802061 (+305877us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.802093 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.872109 (+ 70016us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.115298 (+3243189us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:41.115354 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.115461 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.115537 (+    76us) raft_consensus.cc:1685] finished
0709 12:27:41.115552 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.115698 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89813,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":3517495,"threads_started":2,"wal-append.queue_time_us":261414,"wal-append.run_cpu_time_us":1615,"wal-append.run_wall_time_us":1001649}
I20260709 12:27:41.344619  8542 rpcz_store.cc:276] 0709 12:27:37.437451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:41.118300 (+3680849us) service_pool.cc:224] Handling call
0709 12:27:41.118651 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.118880 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:41.118906 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:41.118960 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:41.119000 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.119052 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.119135 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:41.450767 12114 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.478003 12072 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:41.486788  8295 rpcz_store.cc:269] 0709 12:27:27.604959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.610259 (+  5300us) service_pool.cc:224] Handling call
0709 12:27:29.707663 (+2097404us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f3090 00007f6464391f3a 00007f646a147e9c 00007f646a24604e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc 00007f6468706392 00007f64626c448c 00007f64626c38c6
0709 12:27:41.485508 (+11777845us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:37.155192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:37.175968 (+ 20776us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:37.176001 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:27:37.176017 (+    16us) tablet.cc:662] Decoding operations
0709 12:27:37.177029 (+  1012us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:37.177081 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:37.177106 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:27:37.178002 (+   896us) tablet.cc:701] Row locks acquired
0709 12:27:37.178017 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:27:37.178162 (+   145us) write_op.cc:270] Start()
0709 12:27:37.178291 (+   129us) write_op.cc:276] Timestamp: P: 1783600057178117 usec, L: 0
0709 12:27:37.178313 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:27:37.178955 (+   642us) log.cc:844] Serialized 4832 byte log entry
0709 12:27:37.973602 (+794647us) op_driver.cc:464] REPLICATION: finished
0709 12:27:38.155591 (+181989us) write_op.cc:301] APPLY: starting
0709 12:27:38.156076 (+   485us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:38.156649 (+   573us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:38.156769 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:38.162199 (+  5430us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:38.162393 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:27:38.162436 (+    43us) write_op.cc:312] APPLY: finished
0709 12:27:38.162650 (+   214us) log.cc:844] Serialized 89 byte log entry
0709 12:27:38.162776 (+   126us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:38.162868 (+    92us) write_op.cc:454] Released schema lock
0709 12:27:38.162899 (+    31us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:38.163148 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:38.163168 (+    20us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":985800,"reported_tablets":41,"spinlock_wait_cycles":3884617984,"child_traces":[["op",{"apply.queue_time_us":162728,"apply.run_cpu_time_us":2669,"apply.run_wall_time_us":8530,"num_ops":12,"prepare.queue_time_us":324413,"prepare.run_cpu_time_us":84293,"prepare.run_wall_time_us":160277,"raft.queue_time_us":479141,"raft.run_cpu_time_us":14149,"raft.run_wall_time_us":265121,"replication_time_us":710087,"thread_start_us":665388,"threads_started":4,"wal-append.queue_time_us":202933,"wal-append.run_cpu_time_us":39389,"wal-append.run_wall_time_us":1781388}]]}
I20260709 12:27:41.508783  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2074) took 4536 ms. Trace:
I20260709 12:27:41.486717 12074 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:41.548475  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 56570.9us
I20260709 12:27:41.548242  8438 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.379876 11474 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:41.503688  8510 connection.cc:256] RPC call timeout handler was delayed by -1.6013535659999434s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
W20260709 12:27:41.555753  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:41.499424  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 95520.7us
I20260709 12:27:41.509668  8465 raft_consensus.cc:2468] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:41.500963 12302 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:41.493625 12312 raft_consensus.cc:740] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:41.578464  8472 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:41.234635  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47416 (request call id 406) took 3557 ms. Trace:
I20260709 12:27:41.204030 12144 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:41.548666  8546 rpcz_store.cc:276] 0709 12:27:36.972586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.879905 (+907319us) service_pool.cc:224] Handling call
0709 12:27:37.882254 (+  2349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:40.931572 (+3049318us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:27:41.120525 (+188953us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.506511 (+385986us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:41.507158 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.507299 (+   141us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:27:41.507330 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.507428 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.508473 (+  1045us) raft_consensus.cc:1685] finished
0709 12:27:41.508489 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.508625 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3194237,"prepare.queue_time_us":414305,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":38,"raft.queue_time_us":3310352,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":215,"thread_start_us":348510,"threads_started":3,"wal-append.queue_time_us":189377}
I20260709 12:27:41.563688 12130 consensus_queue.cc:1059] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:41.564491 12278 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:41.508114 12311 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:41.584771  9046 rpcz_store.cc:276] 0709 12:27:37.676812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.680360 (+  3548us) service_pool.cc:224] Handling call
0709 12:27:40.775088 (+3094728us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b58001f1798. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f6461264a22 00007f646a17d8d9 00007f64692d7ee0 00007f64693a10ab 00007f64693a1131 00007f6469362fc0 00007f646934d929 00007f646934d3d2 00007f64628c4bd4
0709 12:27:40.787674 (+ 12586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:41.077248 (+289574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.228002 (+150754us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54004e0cd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:41.234560 (+  6558us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259326080}
I20260709 12:27:41.567704  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:41.568876  8467 raft_consensus.cc:1240] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:41.546031 12132 raft_consensus.cc:697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:41.591964 12132 consensus_queue.cc:237] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.592721 12311 raft_consensus.cc:3055] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:41.593118 12311 raft_consensus.cc:740] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:41.593973 12311 consensus_queue.cc:260] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.570355  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.594699 12312 consensus_queue.cc:260] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.573072  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 389) took 5269 ms. Trace:
I20260709 12:27:41.508296 12307 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.558043 12168 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.545811 12306 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.595356 12311 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:41.601051 12306 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:41.601617 12306 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.505241 12284 consensus_queue.cc:260] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.557711  8291 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 7 to 8, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:41.629688  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 60288.1us
I20260709 12:27:41.553150  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.411158 12300 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.503616 12160 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:41.595736  8463 raft_consensus.cc:2393] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 10: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:41.593794  8391 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:27:41.596650  8512 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:41.632835  8436 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.67:37713 timed out after 2.440s (SENT) [suppressed 5 similar messages]
W20260709 12:27:41.597633  9071 debug-util.cc:398] Leaking SignalData structure 0x7b080029d220 after lost signal to thread 7261
W20260709 12:27:41.648027  9071 debug-util.cc:398] Leaking SignalData structure 0x7b080029d380 after lost signal to thread 7264
W20260709 12:27:41.650923  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.600677 12119 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:41.599895 12178 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.597698 12307 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:41.654542  9071 debug-util.cc:398] Leaking SignalData structure 0x7b080029d480 after lost signal to thread 8329
I20260709 12:27:41.655061  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
W20260709 12:27:41.655619  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.599437 12168 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:41.409658 12171 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.596143 12312 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.653960 12114 raft_consensus.cc:2804] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:41.596753 12296 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.599570 12276 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.658370  8539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2069) took 4948 ms. Trace:
I20260709 12:27:41.596807 12314 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:41.602209 12306 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.658977  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:41.665148  8361 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:41.595942  8545 rpcz_store.cc:276] 0709 12:27:36.303923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.378649 (+1074726us) service_pool.cc:224] Handling call
0709 12:27:37.379001 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.379335 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.379362 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.436269 (+ 56907us) log.cc:844] Serialized 26 byte log entry
0709 12:27:37.789861 (+353592us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:41.007893 (+3218032us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.572715 (+564822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.572814 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.572869 (+    55us) raft_consensus.cc:1685] finished
0709 12:27:41.572879 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.573003 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285584,"prepare.queue_time_us":117092,"prepare.run_cpu_time_us":6079,"prepare.run_wall_time_us":60695,"raft.queue_time_us":230954,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":10415,"thread_start_us":3732661,"threads_started":3,"wal-append.queue_time_us":823241,"wal-append.run_cpu_time_us":4602,"wal-append.run_wall_time_us":1162193}
W20260709 12:27:41.667877  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 119711us
I20260709 12:27:41.497771 12293 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.673535  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.665819 12233 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.584465 12104 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.679311  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:41.681051  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08001ae960 after lost signal to thread 8421
I20260709 12:27:41.654189 12130 consensus_queue.cc:1059] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:27:41.674185  8539 rpcz_store.cc:276] 0709 12:27:36.710199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.693361 (+983162us) service_pool.cc:224] Handling call
0709 12:27:37.713670 (+ 20309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.747112 (+ 33442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:37.747144 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:37.747654 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.348110 (+3600456us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:41.348537 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.647475 (+298938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.654071 (+  6596us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.654110 (+    39us) raft_consensus.cc:1685] finished
0709 12:27:41.654120 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.658304 (+  4184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62150,"prepare.queue_time_us":1618,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":104974,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":31198,"spinlock_wait_cycles":5646080,"thread_start_us":3735830,"threads_started":2,"wal-append.queue_time_us":664101,"wal-append.run_cpu_time_us":1636,"wal-append.run_wall_time_us":1001667}
I20260709 12:27:41.685834  9015 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.686535  8438 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.688151  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:41.688652  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.689309  8464 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
I20260709 12:27:41.683079 12291 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:41.689872 12323 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:41.690132 12304 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:41.690438 12323 raft_consensus.cc:697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:41.690547  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:41.690722  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.691068 12300 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:41.692636 12300 raft_consensus.cc:2804] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:41.693094 12300 raft_consensus.cc:697] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:41.693782  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:41.694438  8546 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:41.695108  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:41.695514  8468 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:41.695672  8544 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:41.680087 12114 raft_consensus.cc:697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:41.697060  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.689484  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:41.698791  9015 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:41.700665  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.696736 12114 consensus_queue.cc:237] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.705250 12296 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:41.706959  8546 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:41.708345  8542 raft_consensus.cc:1240] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:41.709235 12323 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.709797  8291 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 2 to 6, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 6 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.689577 12306 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:41.711704  8291 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 6 to 7, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.712456 12160 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.714442 12307 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.713784  8291 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 6 to 7, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 7 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:41.715678  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 119179us
I20260709 12:27:41.688105  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.719553 11474 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.720574 12284 raft_consensus.cc:3060] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.694012 12300 consensus_queue.cc:237] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.719950  8438 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:41.674086 12314 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.671666 12172 raft_consensus.cc:3055] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:41.690021 12291 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.697748 12304 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.752957 12304 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:41.748858  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 61480.6us
W20260709 12:27:41.757141  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 153191us
I20260709 12:27:41.747641 12172 raft_consensus.cc:740] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:41.758158  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08002f2d40 after lost signal to thread 8496
W20260709 12:27:41.758365  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 351341us
W20260709 12:27:41.760437  9071 debug-util.cc:398] Leaking SignalData structure 0x7b0800360f40 after lost signal to thread 8497
I20260709 12:27:41.739378 12168 raft_consensus.cc:2804] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:41.720590 12299 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:41.763828  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:41.764452  8463 raft_consensus.cc:1240] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:41.763584  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.739605 12314 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:41.767176  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf440 after lost signal to thread 8570
W20260709 12:27:41.769400  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf180 after lost signal to thread 8571
W20260709 12:27:41.765734  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 45920.4us
I20260709 12:27:41.714987 12307 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.772585  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.758929 12291 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.759522 12318 raft_consensus.cc:2804] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:27:41.768291 12324 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:27:41.772766  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:41.765851  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:41.775600  9071 debug-util.cc:398] Leaking SignalData structure 0x7b080039a400 after lost signal to thread 9074
W20260709 12:27:41.784665  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08003b95e0 after lost signal to thread 9075
W20260709 12:27:41.785115  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.775134  8539 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.763294 12130 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:41.771713 12306 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:41.776537  9014 connection.cc:256] RPC call timeout handler was delayed by -1.5269181779999599s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3134s for a response
I20260709 12:27:41.776734 12027 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.778052 12144 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:41.768297  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:41.778995 12172 consensus_queue.cc:260] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.780011 12308 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.780669 12086 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:41.781219 12294 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.680554 12276 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.677486 12178 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.790550  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:41.676084 12119 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.795768  8542 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:41.772722 12259 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:41.797657  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:41.812386  8472 raft_consensus.cc:2368] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:41.792574 12132 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.790825 12168 raft_consensus.cc:697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:41.821166 12168 consensus_queue.cc:237] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.799588  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:41.763450 12191 consensus_queue.cc:1059] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:27:41.800612 12195 consensus_queue.cc:1059] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:27:41.824169 12191 raft_consensus.cc:3055] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:41.824262 12195 raft_consensus.cc:3055] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:41.824575 12191 raft_consensus.cc:740] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:41.825491 12191 consensus_queue.cc:260] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.826815 12191 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.799151  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60394 (request call id 1939) took 4323 ms. Trace:
I20260709 12:27:41.826973  8544 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:41.827544 12197 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:41.799350 12144 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:41.808369  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:41.819649  9041 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:41.820169 12172 raft_consensus.cc:3060] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:41.817384  8291 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.834839  8362 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:41.831920  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 142539us
I20260709 12:27:41.798308 12318 raft_consensus.cc:697] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:41.836575 12327 log.cc:927] Time spent T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:27:41.837756 12130 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.838102  8291 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:41.839648  8291 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 9 to 12, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 12 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.841255  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:41.842559 12307 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.827335  8395 rpcz_store.cc:276] 0709 12:27:37.473212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.573872 (+100660us) service_pool.cc:224] Handling call
0709 12:27:37.582113 (+  8241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:37.583216 (+  1103us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:27:37.583833 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.552954 (+3969121us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.760161 (+207207us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:41.765429 (+  5268us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:41.765483 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.775449 (+  9966us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.796716 (+ 21267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3038,"prepare.queue_time_us":160599,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":84,"raft.queue_time_us":43371,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":3600,"thread_start_us":4003048,"threads_started":3,"wal-append.queue_time_us":739656,"wal-append.run_cpu_time_us":964,"wal-append.run_wall_time_us":1001159}
I20260709 12:27:41.843259  8291 catalog_manager.cc:5697] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 3 to 4, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 4 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:41.807682 12108 consensus_queue.cc:1059] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:27:41.845624 12108 raft_consensus.cc:3055] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:41.845981 12108 raft_consensus.cc:740] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:41.846426  8362 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:41.843616  8541 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:41.814916 12259 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:41.856896  8510 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:41.830303 12195 raft_consensus.cc:740] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:41.864928  8389 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1863) took 4377 ms. Trace:
I20260709 12:27:41.868824  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:41.870814  9044 raft_consensus.cc:2410] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:41.868460  8472 raft_consensus.cc:1275] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:27:41.859622 12038 raft_consensus.cc:2764] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:27:41.828758 12144 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.861595 12290 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:41.814210 12027 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.801471 12306 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.865402 12259 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.869076  8389 rpcz_store.cc:276] 0709 12:27:37.487517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:37.799036 (+311519us) service_pool.cc:224] Handling call
0709 12:27:37.813897 (+ 14861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:37.814275 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:27:37.878910 (+ 64635us) log.cc:844] Serialized 14 byte log entry
0709 12:27:41.571689 (+3692779us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:41.572271 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 12:27:41.666311 (+ 94040us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:41.666351 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:41.682531 (+ 16180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:41.829120 (+146589us) raft_consensus.cc:1685] finished
0709 12:27:41.829139 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:41.864869 (+ 35730us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67000,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1759,"raft.queue_time_us":4085,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":65685,"thread_start_us":3700531,"threads_started":2,"wal-append.queue_time_us":425086,"wal-append.run_cpu_time_us":1104,"wal-append.run_wall_time_us":1001141}
I20260709 12:27:41.884625 12178 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:41.884483 12304 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:41.885299 12294 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:41.885480 12318 consensus_queue.cc:237] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.887363 12304 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:41.888337 12276 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.877463 12290 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:41.889685 12290 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:41.899135  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:41.876343  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:41.918356  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 61540.5us
I20260709 12:27:41.868028 12132 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.876926  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:41.887557 12119 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:41.932696  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:41.933373  8541 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.935465  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:41.891759 12299 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:27:41.936592  8544 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:41.917624 12197 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:41.940403  8546 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:27:41.942713  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:41.931759 12304 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:41.866034 12108 consensus_queue.cc:260] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:41.903203 12315 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:27:41.891875 12195 consensus_queue.cc:260] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:41.951251  9013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.951802  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:41.954552  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:41.954988  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 81254.9us
I20260709 12:27:41.955617  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:41.957105 12108 raft_consensus.cc:3060] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:41.960543 12218 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:41.961069 12218 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:41.955823 12331 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:27:41.971614  8472 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:41.945417 12308 consensus_queue.cc:1059] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
W20260709 12:27:41.980991  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 122585us
I20260709 12:27:41.996806  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:41.995152 12306 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:42.043833  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 47173.8us
W20260709 12:27:42.041218  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 73186.4us
W20260709 12:27:42.029381  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:41.983718 12308 consensus_queue.cc:1243] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:27:42.044727  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 46101.9us
I20260709 12:27:42.074976  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.076426 12314 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.077054 12302 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.077310 12233 consensus_queue.cc:1048] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:42.007669  8468 raft_consensus.cc:2410] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:27:42.047865  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:42.048089  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 48717us
I20260709 12:27:41.987865  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:42.061681 12340 log.cc:927] Time spent T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:27:42.062198 12338 log.cc:927] Time spent T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:27:42.061065 12132 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.065058 12195 raft_consensus.cc:3060] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:42.068933 11903 consensus_meta.cc:287] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.008s
I20260709 12:27:42.069594 12027 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.070704  8472 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:42.114609  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.062143 12038 consensus_queue.cc:1059] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:27:42.100044 12344 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:42.117057 12038 raft_consensus.cc:3055] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:42.060997 12160 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:27:42.080845  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:42.082427  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:42.079497 12233 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:42.080142  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:42.084749 12291 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.086161  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:42.087756  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.079734 12130 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.112926 12306 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.131210 12306 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.131636 12291 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:42.132550  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 46507.5us
I20260709 12:27:42.133332  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:42.091817 12339 log.cc:927] Time spent T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:27:42.043885 12072 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:27:42.100473  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.101301  8467 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:42.107605  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.107615  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.108212  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.110880  8393 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:42.111487  8539 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:42.116097  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:42.117285  8470 raft_consensus.cc:1240] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:42.069620 12104 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:42.119220  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.127705 12344 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:42.141662  8395 raft_consensus.cc:3060] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.118582  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.117419 12038 raft_consensus.cc:740] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:42.122159  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:41.987061 12300 consensus_queue.cc:1048] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 12:27:42.123914  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.124418 12132 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:42.123376  8471 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:42.108922 12296 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.119202  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:42.150633  8546 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
W20260709 12:27:42.149964  8510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.151300  8544 raft_consensus.cc:2410] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:27:42.149571  8390 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:42.136358 12299 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.133442 12306 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.138512 12294 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:42.157843  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.160483  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.138654 12314 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:42.162276  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.155800  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.144160 12130 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.174178  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:42.174888  8539 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:42.144481  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.161059  8388 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:42.162536  8467 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:42.161927 12302 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.144994 12344 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.165091  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:42.165279  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.166198  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.165930 12038 consensus_queue.cc:260] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.168213  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.188246  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.162281  8392 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:42.168901 12299 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.171687  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:42.193202  8542 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.172248  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.162201 12100 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:27:42.173036 12218 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.175127  8464 raft_consensus.cc:2468] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:42.157591 12291 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:42.184800  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 49958.4us
W20260709 12:27:42.185300  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.181505  9049 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:42.189949  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.191828  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.155652 12086 consensus_queue.cc:1059] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:27:42.153015 12160 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.196224  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.199085  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:42.162998 11903 consensus_queue.cc:1059] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:27:42.204329  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:42.204977  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:42.200927  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 67726.1us
I20260709 12:27:42.202410  9050 raft_consensus.cc:2393] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:42.202497  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:42.205174  8395 raft_consensus.cc:2468] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:42.205806  8539 raft_consensus.cc:2410] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:27:42.206008  8393 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.159000 12114 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:27:42.163141 12132 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.197804 12291 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.211066  8389 raft_consensus.cc:2393] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:42.211727  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.212613 12317 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:27:42.212628  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:42.217049  8545 raft_consensus.cc:2468] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:42.221807  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:42.191829 12290 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.224035  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:42.225982  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.226027  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.224964  8388 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:42.227735  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.194809 12130 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.229660  8392 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:42.216537 12314 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.256593 12114 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:42.257230  8436 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:42.259495 11903 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:27:42.259753 12334 log.cc:927] Time spent T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.377s	user 0.004s	sys 0.006s
I20260709 12:27:42.260006 11903 raft_consensus.cc:697] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.261090  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.260880 11903 consensus_queue.cc:237] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.261734  8392 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:42.229496  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.232640 12290 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.262629  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:42.263738  8541 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:42.264091  8392 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:42.265067  8512 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.266391  8390 raft_consensus.cc:2393] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 13: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:42.257148 12314 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.269131 12314 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:42.271118 12306 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:42.271525 12306 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.271857 12306 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:42.275667 12130 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:42.220129 12291 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:42.280737 12284 raft_consensus.cc:3055] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:42.281127 12284 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.281975 12284 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.285151  9014 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:42.285892  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.286496 11474 consensus_queue.cc:1059] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:42.286972  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.287804 12027 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:42.288664 12027 raft_consensus.cc:3055] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:42.288976 12027 raft_consensus.cc:740] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:42.289726 12027 consensus_queue.cc:260] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.290783 12233 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:42.229236  8537 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:42.220229 12038 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:42.294108  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.294696  8396 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:42.295331  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:42.219950 12259 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.296059 12300 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:42.296412 12300 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.296727 12300 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:42.297026 12293 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.297367 12259 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.252779 12132 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:42.255551 12312 consensus_meta.cc:287] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.005s
I20260709 12:27:42.298154  8391 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:42.255998  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.299587  9041 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:42.299703  8389 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:42.300088  8463 raft_consensus.cc:2410] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:27:42.300597  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.301370  8389 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:42.301867  8438 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:42.302176  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.303031  8389 raft_consensus.cc:2410] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:42.208519 12160 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.303769  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.304309  8389 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:42.304922 12160 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.305064  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.305792  8389 raft_consensus.cc:2393] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 4: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:42.306386  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.256366 12299 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.247684  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.307374 12218 raft_consensus.cc:3055] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:42.307832 12218 raft_consensus.cc:740] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.308307  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.308655 12218 consensus_queue.cc:260] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.309811 12218 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.299707  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.290903 12027 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:42.283176 12284 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.242156  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.325126  8542 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:42.326243  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.326841  8463 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:42.327050  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.327869  8471 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:42.327759  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.327430  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.328897  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.316702  9042 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:42.317855  8512 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.318877  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.313422  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:42.321038 12305 raft_consensus.cc:3055] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:42.323354  8464 raft_consensus.cc:1240] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:42.327693  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.332921  8469 raft_consensus.cc:2410] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:27:42.332921  8436 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.331398  8438 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:42.332214  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.331192  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.335587  8397 raft_consensus.cc:2468] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:42.333729  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.332836 12305 raft_consensus.cc:740] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.336949 12299 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:42.337404 12299 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:42.332666 12304 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:42.337751 12305 consensus_queue.cc:260] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.338284 12132 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:42.340584  8393 raft_consensus.cc:2410] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:27:42.337983  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.342741  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:42.346781  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.356221  8436 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:42.357765  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:42.357963  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.306298 12195 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.358870  8512 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.364598  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:42.364792  8469 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:42.366972  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.367919  8512 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.368284  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.369266  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.370404  8512 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.337756 12299 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:42.376434  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:42.377349  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 135277us
I20260709 12:27:42.372471  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.372567  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.378789  8389 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:42.374634  8512 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.372274 12108 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.381866 12108 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:42.382279 12108 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.328789 12290 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:27:42.376092  8395 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
W20260709 12:27:42.377528  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.359164 12130 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.380443  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.376433 12100 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:42.381233  8391 raft_consensus.cc:2410] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:27:42.339215 12304 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:42.343508 12314 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:27:42.383819  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 167805us
I20260709 12:27:42.374017  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:42.369887 12307 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.369760 12308 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.373346 12144 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:42.395783 12114 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:42.369097 12306 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.404138  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.367213 12312 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:42.406064  8396 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:42.391191 12104 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:42.408113  8393 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:42.378386  8511 leader_election.cc:400] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:42.426337  8511 leader_election.cc:403] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:27:42.393939 12300 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.373502 12132 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:42.361316 12352 raft_consensus.cc:2804] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:42.419261  8436 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:42.405066 12172 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:42.433933  8512 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.416138 12144 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.436529  8512 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.405864 12130 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.407449 12305 raft_consensus.cc:3060] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:42.370059 12195 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.423841 12312 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
W20260709 12:27:42.456423  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 78206.6us
I20260709 12:27:42.456609  8393 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:42.457175  8511 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.431773 12278 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:42.367358 12160 raft_consensus.cc:2804] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:42.415304 12308 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:42.363956 12291 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.439682  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.435935 12172 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.413137 12100 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.440393 12130 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.447778  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:42.457340  8391 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:27:42.469600  8388 raft_consensus.cc:2410] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:42.413561 12304 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.467072  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.413419 12307 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.457082  8542 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:42.460548  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:42.446067 12168 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:42.434469 12132 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:42.439591 12144 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:42.407735 12344 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:42.447526  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.440248 12197 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:42.438648 12311 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:42.469609  9042 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:42.430964 12354 consensus_queue.cc:1059] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:27:42.472429  8544 raft_consensus.cc:2410] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:27:42.470721 12100 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.474349  8396 raft_consensus.cc:1240] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:42.459527 12312 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:42.446095 12352 raft_consensus.cc:697] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.472848 12104 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:42.479076  8390 raft_consensus.cc:2393] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:42.481210  8539 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:27:42.466231 12172 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.497416  8539 pending_rounds.cc:85] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 6
I20260709 12:27:42.497691  8539 pending_rounds.cc:107] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:27:42.497918  8539 raft_consensus.cc:2889] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.485630  8395 raft_consensus.cc:1275] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:27:42.489679  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.471084  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.475378 12307 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.475955 12278 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:42.464485 12308 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:42.477640 12132 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.476527 12168 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:42.460994  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 89000.8us
I20260709 12:27:42.500165  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.483155 11903 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:42.500803  8544 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:27:42.497870  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.498533  8395 pending_rounds.cc:85] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Aborting all ops after (but not including) 8
I20260709 12:27:42.482664 12318 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.502622  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:42.503680  8471 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:42.488699 12314 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:42.511869  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.513090  8438 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:42.516402 12291 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:42.516803  8280 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3660d999c0a41658a1f1dbe7cc90746 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:42.517762 12108 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.520578  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:42.518445 12344 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.518647 12195 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.551010  8543 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 5.
I20260709 12:27:42.518455  8463 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:42.522578  8395 pending_rounds.cc:107] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:27:42.557173  8395 raft_consensus.cc:2889] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.537443  8389 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:42.549695  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.521660 12168 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:42.558329  8472 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:42.558478  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 58369.1us
I20260709 12:27:42.504743 12278 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.521852 11903 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:42.588619  8392 raft_consensus.cc:2468] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 13.
I20260709 12:27:42.557652 12038 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:42.590689  8394 raft_consensus.cc:1240] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:27:42.580664 12108 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:42.581591  8389 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:42.590466  8396 raft_consensus.cc:1275] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:42.527417 12314 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.589263  8395 raft_consensus.cc:1240] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:42.589429  8472 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 13.
I20260709 12:27:42.564158 12366 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:42.589999  8280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 114205us
I20260709 12:27:42.525110 12311 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:42.598556 12311 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.598966 12311 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:42.592760 12104 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:42.592864 12038 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.603770 12038 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:42.606653 12358 log.cc:927] Time spent T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:27:42.598517 12355 log.cc:927] Time spent T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:27:42.609551  8389 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:42.602829 12304 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.613339  8391 raft_consensus.cc:1240] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:42.614487 12304 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.595795  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:42.617488  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 104479us
I20260709 12:27:42.625617 12197 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:42.627593 12307 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.628628  8541 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:27:42.629235 12363 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:42.629565  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.634778 12352 consensus_queue.cc:237] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:42.640316  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 155751us
I20260709 12:27:42.588702 12278 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:42.590598 12360 raft_consensus.cc:3055] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:42.592044 11903 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.596534 12314 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:42.671654  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 172311us
I20260709 12:27:42.549464 12318 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.682065  8391 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:42.593860 12233 consensus_queue.cc:1048] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 12:27:42.668097 12307 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:42.672143 12360 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.640115 12306 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:42.628667 12172 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:42.683651  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 65337.2us
I20260709 12:27:42.681097  8512 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.673898 12300 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.673274 12104 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:27:42.703339  8436 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.687532 12160 raft_consensus.cc:697] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.709175  8436 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:42.709764  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:42.711589  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.716485  8538 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:42.704311 12323 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:27:42.717974 12361 consensus_queue.cc:1059] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:27:42.711688 12354 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:27:42.711803 12300 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:42.707857 12284 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:27:42.722250 12362 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:27:42.711568 12306 raft_consensus.cc:2804] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:42.723654  8436 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:42.724828  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:42.725030 12172 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:42.687958 11474 consensus_queue.cc:1059] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:27:42.737527  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:42.740291  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:42.746737  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 182051us
I20260709 12:27:42.747864  8511 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:42.746124  8542 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:42.750367  8391 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:42.752156  8543 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:27:42.752524  8543 pending_rounds.cc:85] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 6
I20260709 12:27:42.752737  8543 pending_rounds.cc:107] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:27:42.752960  8543 raft_consensus.cc:2889] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:42.723351 12306 raft_consensus.cc:697] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 13 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:42.754011 12356 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:42.745852 12114 consensus_queue.cc:1059] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:27:42.754891 12369 raft_consensus.cc:3055] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:42.755445 12130 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.715858 12197 consensus_queue.cc:1048] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:27:42.777674 12369 raft_consensus.cc:740] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.731715 12363 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:27:42.781170 12363 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:42.782361 12370 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:27:42.784711 12144 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:42.766939  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.731942 12304 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:42.753965  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.787303 12304 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:42.787755 12304 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:42.789312 12130 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.789716 12108 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:42.790074 12108 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:42.770350 12307 raft_consensus.cc:2804] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:42.779176 12086 consensus_queue.cc:1059] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:42.793093  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.782840 12038 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.755308 12315 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:42.793896  8541 raft_consensus.cc:1240] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:27:42.798502  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.790829 12108 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.778231 12361 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:42.802388  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:42.802650  8362 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:42.811254  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.771659 12291 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:42.764626 12368 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:27:42.812770 12291 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:42.813253 12291 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:42.777592 12300 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:42.781584 12363 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:42.809947  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.814100 12291 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.819774 12346 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:27:42.820443 12317 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:42.820950 12357 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:27:42.821805 12306 consensus_queue.cc:237] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.786738 12144 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:42.741748 12132 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.820818 12299 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:42.832244  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 99318.6us
W20260709 12:27:42.868115  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.807772 12307 raft_consensus.cc:697] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:42.770157 11903 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.795085 12356 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:42.809366 12315 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:42.882475  8544 raft_consensus.cc:1240] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:42.889194  8469 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:42.888875  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 131905us
W20260709 12:27:42.890642  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 79471.8us
I20260709 12:27:42.892556  8511 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.808637 12233 consensus_queue.cc:1059] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:27:42.809518 12160 consensus_queue.cc:237] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:42.907394  8465 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:42.907260  8361 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.880462  9041 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:42.884238 12108 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:42.886066 12130 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:42.919426  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:42.956568  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 262716us
I20260709 12:27:42.957536  8512 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:42.958251  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:42.894438 12114 raft_consensus.cc:3055] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:42.913878 12361 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:42.890167 12352 consensus_queue.cc:1059] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
W20260709 12:27:42.962637 12305 consensus_meta.cc:287] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.008s
W20260709 12:27:42.975111  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:42.962070 12291 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:42.981887 12130 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:42.979755 12307 consensus_queue.cc:237] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:42.991017 12372 log.cc:927] Time spent T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:27:42.963464 12104 consensus_queue.cc:1059] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:27:42.966073 12114 raft_consensus.cc:740] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:43.008795  8469 raft_consensus.cc:1240] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:42.971243  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:43.019896  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:43.020625  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 131279us
I20260709 12:27:43.003875 12293 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:42.985782 12038 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:42.994242 12291 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:43.029069  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 70915us
I20260709 12:27:43.031303 12375 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:42.978927 12361 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.034152  8361 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.039908 12104 raft_consensus.cc:3055] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:43.040287 12104 raft_consensus.cc:740] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:43.003826 12308 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.041383  8470 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:43.041090 12104 consensus_queue.cc:260] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.042146 12308 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.042591 12132 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:43.046476  8511 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:43.012669 12364 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:43.067389  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.067600 12318 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.060215  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:42.781518 12369 consensus_queue.cc:260] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.066773  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:43.067103 12385 raft_consensus.cc:2764] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:27:42.741607 12360 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.072095  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.073519  9014 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:43.010514 12311 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.066710 12038 raft_consensus.cc:2764] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:27:43.042389 12104 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:43.010347 12168 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.033495 12291 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:43.079888  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:43.084410  9014 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.086488  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:42.986935 12315 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.081257 12360 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:43.089795  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.052382 12382 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.093466  8544 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:27:43.033869 12363 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.089584 12317 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:43.018781 12356 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.054427 12172 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:27:43.102598 12317 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:43.104564 12380 log.cc:927] Time spent T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:27:43.087649 12191 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:43.054370 12314 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.128064 12385 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.129441  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.138495  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.141842  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.117828 12172 consensus_queue.cc:1243] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:27:43.173522  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:43.203263  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 64051.8us
I20260709 12:27:43.204896  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:43.208444 12195 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.209465  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.211937  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.212538  8467 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:43.213146 12378 log.cc:927] Time spent T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:27:43.144932 12385 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.145335  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.145985 12168 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.146175  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.129603 12317 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:43.223600 12369 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:43.155197  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.158288  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:43.227975  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 69796.1us
W20260709 12:27:43.131603 12377 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:27:43.160509  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:43.144455 12315 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.228863  8392 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:43.161499  8397 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: [9.11-9.11]
I20260709 12:27:43.163863 12072 raft_consensus.cc:3055] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:43.140053  8538 raft_consensus.cc:2376] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8. Re-sending same reply.
I20260709 12:27:43.168242 12114 consensus_queue.cc:260] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.154639 12375 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.117655 11903 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.173573 12291 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.174515 12382 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:43.173439 12278 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:43.175856 12312 consensus_meta.cc:287] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.000s
I20260709 12:27:43.177225 12311 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:43.269913  8470 pending_rounds.cc:85] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 7
I20260709 12:27:43.181874 12354 raft_consensus.cc:3055] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:43.183583 12293 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:43.183759 12314 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:43.131947 12374 log.cc:927] Time spent T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.163s	user 0.004s	sys 0.000s
I20260709 12:27:43.185156 12363 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.187163 12299 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.134845 12361 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.192909 12304 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.297479 12304 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:43.297650 12379 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.329s	user 0.004s	sys 0.000s
I20260709 12:27:43.298074 12304 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:43.218588  8542 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 12.
I20260709 12:27:43.300127  8541 raft_consensus.cc:2368] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10.
I20260709 12:27:43.247992 12130 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:43.234100  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:43.234666  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:43.311561  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 79386.3us
I20260709 12:27:43.236174  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:43.242139  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 284662us
W20260709 12:27:43.246905  8438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.016s
W20260709 12:27:43.313256  8438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.008s	sys 0.016s
I20260709 12:27:43.257702  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:43.313565  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 585352us
I20260709 12:27:43.314976  8467 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
W20260709 12:27:43.179885  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.274351  8470 pending_rounds.cc:107] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:27:43.316397  8470 raft_consensus.cc:2889] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:43.235489 12323 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:43.235317 12072 raft_consensus.cc:740] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:43.218037 12038 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:27:43.318892  8396 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:43.288053  8543 raft_consensus.cc:1275] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:43.292755 12291 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.300469  8546 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:27:43.312425  8463 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 12.
I20260709 12:27:43.219480  8540 raft_consensus.cc:1240] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:43.275004  8537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.010s	sys 0.029s
I20260709 12:27:43.228999 12385 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.321136  8539 raft_consensus.cc:1240] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10. Ops: []
W20260709 12:27:43.321219  8537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.011s	sys 0.029s
W20260709 12:27:43.313490  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 77386.4us
I20260709 12:27:43.328532 12382 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:43.335999 12114 raft_consensus.cc:3060] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:43.336700  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.337288  8392 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.337733  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:43.328805 12100 consensus_meta.cc:287] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.000s
I20260709 12:27:43.338897 12100 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.339329 12307 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:43.340010  8472 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:27:43.339892 12307 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.340924 12100 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.343158  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.328781  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.346941  8394 raft_consensus.cc:3060] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.348083  8392 raft_consensus.cc:2468] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:43.301277 12293 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:43.275334 12354 raft_consensus.cc:740] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:43.352061  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.328778 12381 consensus_queue.cc:1059] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:27:43.319145 12375 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.354491 12375 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.355351 12072 consensus_queue.cc:260] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.356431 12072 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.356663 12375 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:43.275893 12312 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.358752 12312 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.351046  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.359609  8471 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:43.359514 12392 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:27:43.363916 12354 consensus_queue.cc:260] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.364743 12357 raft_consensus.cc:3055] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:43.365142 12357 raft_consensus.cc:740] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:43.365239 12354 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.368618 12191 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.319872 12305 consensus_queue.cc:1059] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:27:43.369115 12191 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.371016 12191 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.372347  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.377058 12293 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.379886  8389 raft_consensus.cc:2393] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:43.382615 12307 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.382817 12369 consensus_queue.cc:1059] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:43.383253 12307 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:43.382557  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 60189.7us
W20260709 12:27:43.384830  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 154068us
I20260709 12:27:43.387962  8467 raft_consensus.cc:1240] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:43.389014  8469 raft_consensus.cc:1275] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:43.390481  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:43.391108  8463 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:43.382193  8511 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:43.399159  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:43.416967  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:43.383729 12307 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.417047  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.391742 11903 consensus_queue.cc:1059] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:27:43.410887 12306 raft_consensus.cc:2804] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:27:43.427376  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 222570us
I20260709 12:27:43.435600  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.436761  8388 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:43.436774  8391 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.438331  8541 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:27:43.437518  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.439740  8537 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:43.440404  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:43.440582  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.441130  8542 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:43.440989  8395 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:43.414263 12311 consensus_queue.cc:1059] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:27:43.430068  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:43.430783  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.445488  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.445833  8396 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:43.431520  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:43.414281 12104 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:43.387271 12291 consensus_queue.cc:1059] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:27:43.455446  8393 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:43.397802 12299 consensus_queue.cc:1059] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:27:43.456067  8393 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:43.363082 12317 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.443636  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.467948  8394 raft_consensus.cc:2468] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:43.468258  8538 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:43.437745 12390 raft_consensus.cc:3055] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:43.443137 12312 raft_consensus.cc:3055] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:43.469661 12312 raft_consensus.cc:740] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:43.455663  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.470423 12312 consensus_queue.cc:260] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.469295  9046 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
I20260709 12:27:43.471637 12312 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:43.471992  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.472276  8393 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:27:43.472666  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.473217  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:43.433382  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:43.449113  8539 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:43.449514  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.474843  8545 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:43.449018  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.475694  8546 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:43.452203  8389 raft_consensus.cc:1275] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:27:43.457062  8362 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.458001 12311 raft_consensus.cc:3055] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:43.443241 12306 raft_consensus.cc:697] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:43.459278  8512 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.460361 12291 raft_consensus.cc:3055] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:43.483383  8512 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.460844 12195 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:43.463089 11903 raft_consensus.cc:3055] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:43.455897 12086 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:43.464408 12307 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:43.462994  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:43.494166  8388 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:43.494282  8397 raft_consensus.cc:1275] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:43.495043  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.465258  8542 raft_consensus.cc:2468] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:43.434775 12357 consensus_queue.cc:260] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.444162 12027 consensus_queue.cc:1059] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:27:43.467046  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.446775  9050 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:43.414149 12314 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:27:43.429231  9014 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.478154  8391 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:43.485952 12108 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:43.479897  8538 raft_consensus.cc:2468] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:43.488809  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.477600 12311 raft_consensus.cc:740] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:43.474260 12390 raft_consensus.cc:740] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:43.496407 12130 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:43.498545 12344 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:43.492640  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 45500.5us
I20260709 12:27:43.493052 12363 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:43.495379  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:43.523175  8389 raft_consensus.cc:2393] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:43.456038 12104 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.498739  8393 raft_consensus.cc:1240] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:27:43.455796 12293 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.491537 11903 raft_consensus.cc:740] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:43.469337 12317 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.500577  8541 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:43.482579 12291 raft_consensus.cc:740] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:43.509328 12027 raft_consensus.cc:3055] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:43.509373  8397 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:43.503917 12397 log.cc:927] Time spent T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:43.514119  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:43.526718  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.561944  8467 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:43.514889  8537 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:43.515631  8469 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:27:43.501300  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.501446  8391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:43.504091  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 74930.3us
I20260709 12:27:43.563275  9016 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:43.503793 12406 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:43.567694  8393 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:43.515071  8395 raft_consensus.cc:1240] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:43.518229  8512 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.532234  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:43.532359  8510 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.537459  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.526417 12108 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:43.554695  8397 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:43.570607 12357 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:43.571519 12114 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.572041 12114 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.574146 12114 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.508222 12306 consensus_queue.cc:237] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.524338  8470 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:27:43.575268  8470 pending_rounds.cc:85] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 6
I20260709 12:27:43.575560  8470 pending_rounds.cc:107] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:27:43.575775  8470 raft_consensus.cc:2889] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:43.500847 12314 consensus_queue.cc:1243] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:27:43.577214  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 44948.2us
I20260709 12:27:43.564831  9014 leader_election.cc:400] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for earlier term 9. Current term is 10.
I20260709 12:27:43.578128  8510 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:43.517015  8539 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:43.503067 12390 consensus_queue.cc:260] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.582646  8389 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: [7.5-9.6]
W20260709 12:27:43.568907  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 80977.4us
W20260709 12:27:43.588336  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 70224.7us
I20260709 12:27:43.588552  8510 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:43.579681  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.580252  8546 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:43.530381 12104 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.585052  8388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:43.581492  8397 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:43.554349 12027 raft_consensus.cc:740] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:43.500017 12086 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.592662  8388 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:43.594141  8397 raft_consensus.cc:1240] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: []
I20260709 12:27:43.515574 12100 consensus_queue.cc:1059] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:27:43.531299 11474 consensus_queue.cc:1059] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:27:43.594591  8389 raft_consensus.cc:1240] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:43.583381 12323 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:43.601945  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.602156  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.602703  8537 raft_consensus.cc:2368] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:43.602869  8538 raft_consensus.cc:2368] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
W20260709 12:27:43.599181  8361 connection.cc:256] RPC call timeout handler was delayed by -5.6240179080000416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260709 12:27:43.604641  8361 connection.cc:256] RPC call timeout handler was delayed by -5.6213179080000373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:27:43.604954  8361 connection.cc:256] RPC call timeout handler was delayed by -5.5871179080004367s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 12:27:43.605221  8361 connection.cc:256] RPC call timeout handler was delayed by -5.571817908000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:27:43.605486  8361 connection.cc:256] RPC call timeout handler was delayed by -5.522317908000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:27:43.605746  8361 connection.cc:256] RPC call timeout handler was delayed by -5.4881179080002767s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
W20260709 12:27:43.606038  8361 connection.cc:256] RPC call timeout handler was delayed by -5.4818179080002665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1837s for a response
W20260709 12:27:43.606302  8361 connection.cc:256] RPC call timeout handler was delayed by -5.4008179080001355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
W20260709 12:27:43.606587  8361 connection.cc:256] RPC call timeout handler was delayed by -5.3927179080001224s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 12:27:43.606863  8361 connection.cc:256] RPC call timeout handler was delayed by -5.3396179080000366s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 12:27:43.607146  8361 connection.cc:256] RPC call timeout handler was delayed by -5.3342179080000278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 12:27:43.607430  8361 connection.cc:256] RPC call timeout handler was delayed by -5.31081790799999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 12:27:43.502951 12311 consensus_queue.cc:260] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.587978 12362 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:43.608942  8542 raft_consensus.cc:1240] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:43.593132 12375 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:43.627617  8546 raft_consensus.cc:1275] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:27:43.601440  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.628270  8546 pending_rounds.cc:85] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 6
I20260709 12:27:43.628567  8546 pending_rounds.cc:107] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:27:43.628690  8544 raft_consensus.cc:2368] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
I20260709 12:27:43.629168  8546 raft_consensus.cc:2889] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:43.629437  8396 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 13.
I20260709 12:27:43.630170  8394 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:43.630617  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.631080  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.595362 12390 raft_consensus.cc:3060] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:43.631882  8389 raft_consensus.cc:1240] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:43.598953 12344 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.599053 12278 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:43.608665 12323 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.639876  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.590082 12284 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:27:43.650768  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:43.604269 12172 raft_consensus.cc:2804] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:43.642762  8436 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:43.592025 12191 consensus_queue.cc:1059] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:27:43.592355 12385 consensus_queue.cc:1048] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:27:43.628857 12108 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:43.615499 12362 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:43.633138 12366 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:43.670332  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 86442.9us
I20260709 12:27:43.672369  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.673053  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.702840  8538 raft_consensus.cc:2393] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:43.675443  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.702661 12366 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.704746 12191 raft_consensus.cc:3055] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:27:43.705127 12191 raft_consensus.cc:740] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:43.705909 12191 consensus_queue.cc:260] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.705919 12366 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.702731 12362 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:43.707520  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:43.676168  8397 raft_consensus.cc:1275] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:27:43.679590  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 92059.9us
I20260709 12:27:43.709827  9050 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
W20260709 12:27:43.675429  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 45276.1us
I20260709 12:27:43.684492  8544 raft_consensus.cc:1240] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11. Ops: [8.4-10.5]
I20260709 12:27:43.651368 12323 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:43.630573 12168 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:27:43.685467  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.649614 12311 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:43.636127 12318 consensus_queue.cc:1048] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:27:43.730196 12172 raft_consensus.cc:697] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:43.733166 12172 consensus_queue.cc:237] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.686582  8395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:43.701092 12108 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.735766 12108 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:43.736765  8510 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:43.737869  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.738587  8544 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:43.739174 12366 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:43.739617 12366 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.740003 12366 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:43.740267 12420 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:27:43.688710  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.599356 11903 consensus_queue.cc:260] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.608233  8393 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3"
dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
mode: GRACEFUL
new_leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
 from {username='slave'} at 127.0.0.1:49398
I20260709 12:27:43.741791  8393 raft_consensus.cc:606] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Received request to transfer leadership to TS 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:43.619436 12291 consensus_queue.cc:260] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.648562 12104 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.649966 12344 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:43.667949 12363 consensus_queue.cc:1059] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:27:43.651214 12315 consensus_queue.cc:1059] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
W20260709 12:27:43.691596 12410 log.cc:927] Time spent T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.070s	user 0.003s	sys 0.000s
I20260709 12:27:43.615379 12100 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.721506 12086 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.723073  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.701699 12293 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:43.727312  9016 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:43.726737  8396 raft_consensus.cc:1240] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:43.700145  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 57475.2us
I20260709 12:27:44.832038  8361 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:44.802047  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 112644us
I20260709 12:27:45.254051 12446 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.052518 12446 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.055186 12446 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:44.167865  8388 raft_consensus.cc:1275] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:27:43.730454  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:44.689239  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:46.481793  8390 raft_consensus.cc:2468] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
W20260709 12:27:46.482323  8390 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1939) took 1793 ms (client timeout 1807 ms). Trace:
W20260709 12:27:46.482643  8390 rpcz_store.cc:269] 0709 12:27:44.688794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.688931 (+   137us) service_pool.cc:224] Handling call
0709 12:27:46.482234 (+1793303us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:43.742123  8393 raft_consensus.cc:614] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:46.485556  8393 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49398 (request call id 26) took 2914 ms. Trace:
I20260709 12:27:46.485870  8393 rpcz_store.cc:276] 0709 12:27:43.571019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.579736 (+  8717us) service_pool.cc:224] Handling call
0709 12:27:46.485460 (+2905724us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:44.864069  8394 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1936) took 1134 ms. Trace:
I20260709 12:27:46.488385  8394 rpcz_store.cc:276] 0709 12:27:43.729345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.729463 (+   118us) service_pool.cc:224] Handling call
0709 12:27:43.742050 (+ 12587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:44.863656 (+1121606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:44.863700 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:44.863748 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:44.863795 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:44.863860 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:44.863985 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:44.879172  8395 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:44.688916  8396 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:46.496577  8396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1937) took 1808 ms. Trace:
I20260709 12:27:46.496889  8396 rpcz_store.cc:276] 0709 12:27:44.688101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.688240 (+   139us) service_pool.cc:224] Handling call
0709 12:27:44.688560 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.496308 (+1807748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.496521 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:43.802726  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:44.803037  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:45.135914  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 142584us
I20260709 12:27:45.466342 12447 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.502480 12447 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:45.398267  8493 debug-util.cc:398] Leaking SignalData structure 0x7b080016b2c0 after lost signal to thread 7261
W20260709 12:27:46.505338  8493 debug-util.cc:398] Leaking SignalData structure 0x7b0800170ea0 after lost signal to thread 7264
W20260709 12:27:46.506227  8493 debug-util.cc:398] Leaking SignalData structure 0x7b0800170fc0 after lost signal to thread 8329
W20260709 12:27:43.947763  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:44.892096  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:43.799633  8540 raft_consensus.cc:1240] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:27:43.787999  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.747363  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:43.770007  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:46.558220  8545 raft_consensus.cc:2393] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 13: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:46.558660  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2081) took 2797 ms. Trace:
I20260709 12:27:46.558933  8545 rpcz_store.cc:276] 0709 12:27:43.760898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.761024 (+   126us) service_pool.cc:224] Handling call
0709 12:27:46.558601 (+2797577us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:46.559928  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2088) took 2747 ms (client timeout 1631 ms). Trace:
W20260709 12:27:46.560269  8545 rpcz_store.cc:269] 0709 12:27:43.812289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.559758 (+2747469us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.559870 (+   112us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:46.560920  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2086) took 2759 ms (client timeout 1649 ms). Trace:
W20260709 12:27:46.561192  8545 rpcz_store.cc:269] 0709 12:27:43.801160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.560786 (+2759626us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.560878 (+    92us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:46.561833  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2083) took 2777 ms (client timeout 1698 ms). Trace:
W20260709 12:27:46.562107  8545 rpcz_store.cc:269] 0709 12:27:43.784161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.561682 (+2777521us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.561769 (+    87us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:46.562764  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2092) took 2745 ms (client timeout 1683 ms). Trace:
W20260709 12:27:46.563033  8545 rpcz_store.cc:269] 0709 12:27:43.817835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.562637 (+2744802us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.562724 (+    87us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:43.760360  8546 raft_consensus.cc:1240] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12. Ops: []
W20260709 12:27:45.977041  8510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.003s
W20260709 12:27:46.564155  8510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.110s	user 0.003s	sys 0.004s
I20260709 12:27:46.564291  8546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 2079) took 2861 ms. Trace:
I20260709 12:27:46.564630  8546 rpcz_store.cc:276] 0709 12:27:43.703379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.731231 (+ 27852us) service_pool.cc:224] Handling call
0709 12:27:43.760176 (+ 28945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.564024 (+2803848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.564227 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:46.565600  8546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2094) took 2747 ms (client timeout 1694 ms). Trace:
W20260709 12:27:46.565948  8546 rpcz_store.cc:269] 0709 12:27:43.818379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.565436 (+2747057us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.565541 (+   105us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:46.566632  8546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2089) took 2753 ms (client timeout 1719 ms). Trace:
W20260709 12:27:46.566917  8546 rpcz_store.cc:269] 0709 12:27:43.813358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.566494 (+2753136us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.566587 (+    93us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:27:45.512984  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 1.78443e+06us
I20260709 12:27:45.104976 12172 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.573457 12172 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.768292 12293 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.577039 12293 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:43.769119 12291 raft_consensus.cc:3060] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:45.911429 12300 raft_consensus.cc:3055] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:46.582156 12300 raft_consensus.cc:740] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:46.583032 12300 consensus_queue.cc:260] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.584019 12300 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:46.584443 12393 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.584964 12393 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:45.216001 12314 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.586865 12314 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.587136  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:44.906563 12317 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.589051  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:46.589224 12317 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.590286  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:46.591750  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:46.591945  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:46.592512  9049 raft_consensus.cc:2410] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 12:27:45.971626 12364 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.398329 12368 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
W20260709 12:27:46.597683  8546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2093) took 2779 ms (client timeout 1833 ms). Trace:
I20260709 12:27:46.597828 12368 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:46.598104  8546 rpcz_store.cc:269] 0709 12:27:43.818114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.597495 (+2779381us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.597624 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:46.598620 12462 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:46.598927  8546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2084) took 2798 ms (client timeout 2183 ms). Trace:
I20260709 12:27:44.804438 12434 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.805593 12436 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:44.831108 12437 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.609687 12436 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.610333 12437 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:44.985785 12296 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:44.844094 12438 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.614459 12438 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.615453  8543 raft_consensus.cc:2410] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:27:46.615777  8392 raft_consensus.cc:2468] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:46.616307 12438 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:44.852859 12439 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:46.617689 12439 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.754165 12406 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:46.621802  8392 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1926) took 3069 ms (client timeout 1608 ms). Trace:
I20260709 12:27:44.856871 12440 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:44.887847 12443 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.868559 12441 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.623813 12443 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.622196 12406 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.624507 12441 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.625913 12443 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.626482  8389 raft_consensus.cc:2468] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:454: Failure
Failed
Bad status: Timed out: LeaderStepDown RPC to 127.7.23.65:38641 timed out after 10.000s (SENT)
I20260709 12:27:46.626955 12441 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:44.805051 12435 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:46.627573  8389 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60384 (request call id 1935) took 2927 ms (client timeout 1923 ms). Trace:
I20260709 12:27:46.628139 12435 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:46.628401  8389 rpcz_store.cc:269] 0709 12:27:43.700022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.702416 (+  2394us) service_pool.cc:224] Handling call
0709 12:27:46.627375 (+2924959us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003dead4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:46.627501 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335780736}
I20260709 12:27:46.628818 12465 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:46.622767 12466 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.629366 12465 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.629567 12466 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.629514  8292 catalog_manager.cc:5697] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:43.777240  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50020.4us
I20260709 12:27:46.631880  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:46.610081 12300 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:46.632475  9049 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 13.
I20260709 12:27:46.632606 12300 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.782455 11903 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:43.767831 12100 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.641443 12100 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.641919 12100 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:46.634598 12300 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.642333 12100 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.786093 12104 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.646104 12104 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.646534 12104 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.798478 12108 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.648229 12465 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.649461 12108 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:43.707106 12191 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:46.654042  8541 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
W20260709 12:27:46.655028  8541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2076) took 2971 ms (client timeout 1790 ms). Trace:
I20260709 12:27:43.815850 12218 raft_consensus.cc:3055] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:46.656028 12218 raft_consensus.cc:740] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:46.618793 12293 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.656901 12218 consensus_queue.cc:260] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.657877 12218 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:46.658574 12293 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.791481 12318 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:46.660533 12318 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:46.660910 12318 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:43.824364 12323 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.666131 12323 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.792387 12344 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:43.824724 12362 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.770521 12363 consensus_queue.cc:1243] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:27:43.816190 12366 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.688217 12366 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.688758 12366 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.689195 12366 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:44.111575 12370 raft_consensus.cc:3055] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:43.825827 12382 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.686633 12403 consensus_queue.cc:1059] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.232s
I20260709 12:27:46.694571 12366 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.694866 12403 raft_consensus.cc:3055] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:46.695263 12403 raft_consensus.cc:740] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:46.697839 12403 consensus_queue.cc:260] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:43.790681 12418 raft_consensus.cc:3055] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:46.699632 12418 raft_consensus.cc:740] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:46.700431 12418 consensus_queue.cc:260] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.701373 12418 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:44.872692 12419 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.710983 12419 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.712204  9046 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
W20260709 12:27:44.061667 12421 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.385s	user 0.004s	sys 0.001s
I20260709 12:27:44.610852 12423 raft_consensus.cc:3055] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:46.729017 12423 raft_consensus.cc:740] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:44.695457 12426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.003s	sys 0.004s
W20260709 12:27:46.732314 12426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.720s	user 0.005s	sys 0.004s
I20260709 12:27:44.802279 12433 consensus_queue.cc:1059] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:46.734109 12433 raft_consensus.cc:3055] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:46.734452 12433 raft_consensus.cc:740] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:45.972148 12385 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.736084 12385 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.737058  8544 raft_consensus.cc:2468] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:46.738108 12385 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:46.020455  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:46.738914  8544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2080) took 2992 ms (client timeout 1626 ms). Trace:
W20260709 12:27:46.739360  8544 rpcz_store.cc:269] 0709 12:27:43.746828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.747104 (+   276us) service_pool.cc:224] Handling call
0709 12:27:46.738718 (+2991614us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540006c7d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:46.738840 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413218176}
W20260709 12:27:46.740484  8544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2087) took 2939 ms (client timeout 2749 ms). Trace:
I20260709 12:27:46.741647  8397 raft_consensus.cc:1240] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 7. Current term is 8. Ops: []
I20260709 12:27:46.058518  8436 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:46.742316  8389 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
W20260709 12:27:46.742825  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 684322us
I20260709 12:27:46.743635  8436 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:46.068100 12453 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:46.744520  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:46.068075  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 1.23602e+06us
I20260709 12:27:46.743103 12344 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.745386 12344 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.745819  8436 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:46.746012  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:46.746745 11903 raft_consensus.cc:2804] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:46.729923 12423 consensus_queue.cc:260] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.069978 12455 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:46.747929 12363 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:46.325644 12446 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.749059 12293 raft_consensus.cc:2804] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:46.332728 12456 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:46.749780 12443 raft_consensus.cc:3055] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:27:46.333441  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 264318us
I20260709 12:27:46.747341  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:46.750448  8280 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3660d999c0a41658a1f1dbe7cc90746 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:46.750164 12443 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:46.334685 12375 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.381193 12027 consensus_queue.cc:260] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:46.432929  8537 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2091) took 2615 ms (client timeout 1620 ms). Trace:
I20260709 12:27:46.440471 12233 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.464924  8388 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1928) took 2871 ms. Trace:
I20260709 12:27:46.504691 12447 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.510288 12306 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.513521  8540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2150) took 2877 ms. Trace:
W20260709 12:27:46.507330  8493 debug-util.cc:398] Leaking SignalData structure 0x7b080016ec20 after lost signal to thread 8421
I20260709 12:27:46.546078  8395 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:27:46.775379  8493 debug-util.cc:398] Leaking SignalData structure 0x7b080016ec60 after lost signal to thread 8422
I20260709 12:27:46.776275  8395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1938) took 2087 ms. Trace:
W20260709 12:27:46.552013 12416 log.cc:927] Time spent T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 2.954s	user 0.012s	sys 0.031s
I20260709 12:27:46.585937  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:46.586192  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:45.473084 12315 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.748091 12459 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:46.778988 12233 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.783754 12233 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.588531  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:46.599275  8546 rpcz_store.cc:269] 0709 12:27:43.800508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.598783 (+2798275us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.598878 (+    95us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:46.779640 12306 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.785001  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:46.785600  8546 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:46.786597  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:46.787087  8546 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:46.593700 12364 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.768692 12291 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.600798  8539 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:46.601454 12463 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.601853 12368 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.591312 12317 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.603605 12464 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.599103 12462 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.779114 12443 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.796407 12443 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:46.796917 12462 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:46.605975  8545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2090) took 2788 ms (client timeout 2202 ms). Trace:
W20260709 12:27:46.797499  8545 rpcz_store.cc:269] 0709 12:27:43.817350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.605844 (+2788494us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.605932 (+    88us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:46.798424  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:46.798990  8545 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
I20260709 12:27:46.771661 12375 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.795269 12463 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.799954  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:46.800520  8545 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:46.801255  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:46.801612  8538 raft_consensus.cc:2393] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:46.801654 12027 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:46.607162 12314 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.606951 12434 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.607534 12172 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.612039 12436 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.613720 12437 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.613749 12393 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:46.616840  8543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2082) took 2844 ms (client timeout 1668 ms). Trace:
I20260709 12:27:46.620033 12439 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.616861 12438 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.612151 12296 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:46.622165  8392 rpcz_store.cc:269] 0709 12:27:43.552774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.554020 (+  1246us) service_pool.cc:224] Handling call
0709 12:27:46.621628 (+3067608us) spinlock_profiling.cc:243] Waited 3.02 s on lock 0x7b54001437d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:46.621725 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6945840512}
I20260709 12:27:46.819520  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:46.623140 12440 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:44.805843 12432 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.820838 12432 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.821521  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf"
I20260709 12:27:46.627535 12441 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.822284  8392 raft_consensus.cc:2376] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8. Re-sending same reply.
I20260709 12:27:46.822336 12441 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.822888 12432 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.823267  8392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:46.823882  8392 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:46.824466 12441 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.824923  8392 raft_consensus.cc:1275] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:27:46.630244 12435 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:44.872084 12442 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:46.826071  8392 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:46.826356 12442 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.827000 12440 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.631352  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
I20260709 12:27:46.633606  8292 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:46.636116  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:46.636992  9016 connection.cc:256] RPC call timeout handler was delayed by -2.0879175119998763s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:27:46.637370 11474 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.639214 12466 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.643203  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:46.635526  8510 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:46.644456 12100 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.668538  8542 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 7. Current term is 8. Ops: []
W20260709 12:27:46.669445  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.669275 12465 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.670995 12460 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.672910 12104 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.838167 12465 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.838292 12460 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.840423 12460 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.840452 12465 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.670490 12108 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.673671 12362 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:46.673784  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:46.847766  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.846565  8292 catalog_manager.cc:5697] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 6 to 7, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:46.674381 12144 raft_consensus.cc:3055] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:27:46.655381  8541 rpcz_store.cc:269] 0709 12:27:43.683496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.683621 (+   125us) service_pool.cc:224] Handling call
0709 12:27:46.654837 (+2971216us) spinlock_profiling.cc:243] Waited 2.92 s on lock 0x7b5400099554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:46.654965 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6722833792}
W20260709 12:27:46.686120  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 183187us
I20260709 12:27:46.692657 12370 raft_consensus.cc:740] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:46.693346 12318 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.856420  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:46.857115  8463 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:46.698997 12403 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:46.862084  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:46.862879  8466 raft_consensus.cc:2410] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:27:46.693367 12382 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.865025 12382 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.865372  9042 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:46.865563 12072 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.866089 12072 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.707617 12458 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.866812 12370 consensus_queue.cc:260] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:46.718946  8291 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46076 (request call id 132) took 15667 ms (client timeout 15000 ms). Trace:
I20260709 12:27:46.742069  8394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:46.747300 11903 raft_consensus.cc:697] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:46.867691 12458 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.868932  8394 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:46.869266 12434 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.742861  8389 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:46.852632 12368 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.870146 12368 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.735190 12433 consensus_queue.cc:260] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.747388 12344 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.747786 12300 raft_consensus.cc:2804] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:46.068552 12454 consensus_queue.cc:1059] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:46.749367 12455 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:46.871702 12300 raft_consensus.cc:697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:46.740841  8544 rpcz_store.cc:269] 0709 12:27:43.801413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.740221 (+2938808us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.740401 (+   180us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:46.844074 11474 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.872571 12300 consensus_queue.cc:237] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.873591 12454 raft_consensus.cc:3055] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:46.873935 12454 raft_consensus.cc:740] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:46.874936 11474 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.874703 12454 consensus_queue.cc:260] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.744561  8391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60384 (request call id 1920) took 3261 ms. Trace:
I20260709 12:27:46.770054  8388 rpcz_store.cc:276] 0709 12:27:43.593668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.594736 (+  1068us) service_pool.cc:224] Handling call
0709 12:27:43.601779 (+  7043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.342047 (+2740268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.464637 (+122590us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b5400166554. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:46.464853 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300839168}
I20260709 12:27:46.774583  8397 raft_consensus.cc:3060] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:46.875893 12454 raft_consensus.cc:3060] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:46.771606  8390 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "21c151c99bcf4cbeb819de06e68d95bf" is_pre_election: true
I20260709 12:27:46.878602  8390 raft_consensus.cc:2468] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:46.829707 12438 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:46.776829  8493 debug-util.cc:398] Leaking SignalData structure 0x7b080037ff40 after lost signal to thread 8496
I20260709 12:27:46.879618  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:46.880146  9043 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:27:46.880383  8493 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca2e0 after lost signal to thread 8570
W20260709 12:27:46.881503  8493 debug-util.cc:398] Leaking SignalData structure 0x7b08003696e0 after lost signal to thread 9074
W20260709 12:27:46.881742  8493 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4100 after lost signal to thread 9075
W20260709 12:27:46.882301  8493 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0f80 after lost signal to thread 12357
W20260709 12:27:46.882612  9013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.775175  8540 rpcz_store.cc:276] 0709 12:27:43.636481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.636608 (+   127us) service_pool.cc:224] Handling call
0709 12:27:43.650973 (+ 14365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:46.511155 (+2860182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.513277 (+  2122us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54001d6ad4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:46.513465 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341184768}
I20260709 12:27:46.883953  8465 pending_rounds.cc:85] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 4
I20260709 12:27:46.884251  8465 pending_rounds.cc:107] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 10.5
I20260709 12:27:46.884473  8465 raft_consensus.cc:2889] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:46.776639  8395 rpcz_store.cc:276] 0709 12:27:44.688508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.878734 (+190226us) service_pool.cc:224] Handling call
0709 12:27:44.879060 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.776015 (+1896955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.776220 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:46.727620 12419 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.911882  9043 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:46.788662  9014 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:46.887058  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.887209  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:46.789779  8512 connection.cc:256] RPC call timeout handler was delayed by -1.825045338000109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 12:27:46.914031  8512 connection.cc:256] RPC call timeout handler was delayed by -1.6634326769999461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260709 12:27:46.749481 12446 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.914285 12440 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.914800 12440 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.772150 12293 raft_consensus.cc:697] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:46.804313 12364 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.803228 12464 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.779373 12453 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:46.781517 12315 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:46.778064 12471 consensus_queue.cc:1059] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:27:46.806947 12306 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:46.807353  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 60091.3us
I20260709 12:27:46.928359  9041 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:46.928534  8361 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:46.929415 12344 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:46.930054  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:46.930609 12463 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.852130 12108 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.801164 12375 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.807736  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:46.807933 12468 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:46.810180  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 61804.2us
W20260709 12:27:46.802699  8538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2078) took 3103 ms (client timeout 1520 ms). Trace:
I20260709 12:27:46.875602  8391 rpcz_store.cc:276] 0709 12:27:43.483559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.582086 (+ 98527us) service_pool.cc:224] Handling call
0709 12:27:43.582487 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:43.582789 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:43.582825 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:43.592283 (+  9458us) log.cc:844] Serialized 26 byte log entry
0709 12:27:43.676796 (+ 84513us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:27:43.676841 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:43.676907 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:44.061016 (+384109us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f64611c2c85 00007f64611c36a2 00007f6463f351db 00007f6463f30aaf 00007f6463f2486e 00007f6463f23bb6 00007f6463f237d8 00007f6463f2d221 00007f6463f2d1d9 00007f6463f2d169
0709 12:27:46.722789 (+2661773us) raft_consensus.cc:1685] finished
0709 12:27:46.722809 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:46.744502 (+ 21693us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8746,"spinlock_wait_cycles":8950912,"thread_start_us":46279,"threads_started":1,"wal-append.queue_time_us":75341}
W20260709 12:27:46.934629  8538 rpcz_store.cc:269] 0709 12:27:43.699177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.722769 (+ 23592us) service_pool.cc:224] Handling call
0709 12:27:46.802520 (+3079751us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b5400038ed4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:46.802639 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6980265856}
I20260709 12:27:46.868042 12370 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:46.813941  9050 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:46.815614  8546 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
W20260709 12:27:46.816502  8543 rpcz_store.cc:269] 0709 12:27:43.772187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.787755 (+ 15568us) service_pool.cc:224] Handling call
0709 12:27:46.616644 (+2828889us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54003fb6d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:46.616779 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":135113472}
I20260709 12:27:46.819830 12363 raft_consensus.cc:697] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:46.821934  8396 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:27:46.829685  9049 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
W20260709 12:27:46.831179  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 195740us
I20260709 12:27:46.833225 12435 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.835330  8542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2148) took 3218 ms. Trace:
I20260709 12:27:46.836104 12436 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.836484 12100 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.836863 12432 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.851033  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:46.828446 12442 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:46.948655 12434 consensus_queue.cc:1048] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 12:27:46.858031  8438 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.23.65:38641 timed out after 1.687s (SENT) [suppressed 6 similar messages]
I20260709 12:27:46.860311 12218 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:46.727813  9048 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
I20260709 12:27:46.868425 11903 consensus_queue.cc:237] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.873005  8544 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
W20260709 12:27:46.769845  8537 rpcz_store.cc:269] 0709 12:27:43.817604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.432719 (+2615115us) service_pool.cc:211] Skipping call since client already timed out
0709 12:27:46.432846 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:27:46.775676 12423 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:46.912500  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:46.804702 12291 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.003317 12291 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.004078 12440 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:47.004878 12438 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:46.914106  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 125515us
I20260709 12:27:46.981500 12435 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.981618 12446 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:47.007349  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:46.967618 12293 consensus_queue.cc:237] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.919593  9016 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:46.864941 12318 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.920641  8541 raft_consensus.cc:1240] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8. Ops: [7.4-7.4]
W20260709 12:27:46.922088  8512 connection.cc:256] RPC call timeout handler was delayed by -1.5932326770002874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17300000000000001s for a response
W20260709 12:27:47.012713  8512 connection.cc:256] RPC call timeout handler was delayed by -1.5649453380001432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260709 12:27:47.013142  8512 connection.cc:256] RPC call timeout handler was delayed by -1.3678453379998246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 12:27:47.013445  8512 connection.cc:256] RPC call timeout handler was delayed by -1.1102091359998667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 12:27:47.013825  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:47.014513  8546 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:46.847640 12466 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:46.872128 12368 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.915786 12364 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.911456  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:46.927268 12471 raft_consensus.cc:3055] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:46.932230  8545 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:46.932587 12468 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:46.931281  8361 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:46.931974 12455 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:46.987476 12100 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.051041 12364 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.054391 12291 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:47.048915 12471 raft_consensus.cc:740] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:47.055627 12100 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.813253  8539 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 6.
I20260709 12:27:46.934562  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:47.056469  9044 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:47.007361 12435 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.021449 12466 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:47.057338 12466 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:46.936254  9042 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
W20260709 12:27:46.918520  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:47.060838  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 52693.6us
I20260709 12:27:46.886710 12474 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.063710 12474 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.064917 12468 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:47.065765 12296 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.916154 12475 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.066592 12475 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:46.867859  8291 rpcz_store.cc:269] 0709 12:27:31.052045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:31.055307 (+  3262us) service_pool.cc:224] Handling call
0709 12:27:46.718847 (+15663540us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:42.510798 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:42.730366 (+219568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:42.738985 (+  8619us) write_op.cc:435] Acquired schema lock
0709 12:27:42.739012 (+    27us) tablet.cc:662] Decoding operations
0709 12:27:43.091884 (+352872us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:43.095650 (+  3766us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:43.097330 (+  1680us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:27:43.100380 (+  3050us) tablet.cc:701] Row locks acquired
0709 12:27:43.100429 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:27:43.100621 (+   192us) write_op.cc:270] Start()
0709 12:27:43.100764 (+   143us) write_op.cc:276] Timestamp: P: 1783600063100553 usec, L: 0
0709 12:27:43.100790 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:27:43.101520 (+   730us) log.cc:844] Serialized 4107 byte log entry
0709 12:27:43.457655 (+356135us) op_driver.cc:464] REPLICATION: finished
0709 12:27:44.010467 (+552812us) spinlock_profiling.cc:243] Waited 3.44 ms on lock 0x7b18002583a0. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646129c3f3 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd 0000000000388634 0000000000388479 00007f646127f83a
0709 12:27:44.010652 (+   185us) write_op.cc:301] APPLY: starting
0709 12:27:44.010760 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:44.010991 (+   231us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:44.011024 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:44.088734 (+ 77710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:44.089112 (+   378us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:27:44.089160 (+    48us) write_op.cc:312] APPLY: finished
0709 12:27:44.089547 (+   387us) log.cc:844] Serialized 77 byte log entry
0709 12:27:44.090513 (+   966us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:44.090668 (+   155us) write_op.cc:454] Released schema lock
0709 12:27:44.090742 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:44.091164 (+   422us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:44.091191 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":98212,"apply.run_cpu_time_us":3588,"apply.run_wall_time_us":80496,"num_ops":10,"prepare.queue_time_us":299596,"prepare.run_cpu_time_us":33155,"prepare.run_wall_time_us":688192,"raft.queue_time_us":156327,"raft.run_cpu_time_us":47955,"raft.run_wall_time_us":98589,"replication_time_us":356702,"spinlock_wait_cycles":7905536,"thread_start_us":447235,"threads_started":4,"wal-append.queue_time_us":168189,"wal-append.run_cpu_time_us":52217,"wal-append.run_wall_time_us":2659101}]]}
I20260709 12:27:46.858666  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:47.068809 12475 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:46.931957 12315 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.869735 12458 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:46.973232  8292 catalog_manager.cc:5697] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 7 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.070394  8292 catalog_manager.cc:5697] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.072263  8292 catalog_manager.cc:5697] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 9 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:47.066607  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.073557  9049 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 6.
I20260709 12:27:47.073993  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 2095) took 3255 ms. Trace:
I20260709 12:27:47.073685  8292 catalog_manager.cc:5697] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 10 to 11, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 11 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:46.898869  8397 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:47.074349  8541 rpcz_store.cc:276] 0709 12:27:43.818606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.855047 (+3036441us) service_pool.cc:224] Handling call
0709 12:27:46.859283 (+  4236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:47.012674 (+153391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:47.073759 (+ 61085us) spinlock_profiling.cc:243] Waited 61.1 ms on lock 0x7b540006bdd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:47.073935 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140601088}
I20260709 12:27:46.975117  8542 rpcz_store.cc:276] 0709 12:27:43.616700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:43.616801 (+   101us) service_pool.cc:224] Handling call
0709 12:27:43.639741 (+ 22940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:46.831594 (+3191853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:46.835127 (+  3533us) spinlock_profiling.cc:243] Waited 3.03 s on lock 0x7b54001d60d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:46.835278 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6965123840}
I20260709 12:27:47.074990  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:46.982188  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.075738  9042 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:47.076015  8464 raft_consensus.cc:2410] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:47.076871  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.077858  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.078378  8464 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:46.854231  8469 raft_consensus.cc:1275] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:27:47.053823  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 122648us
I20260709 12:27:47.069443  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.080101  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.081115  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.081326  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:46.987604  9013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:46.997934  8544 pending_rounds.cc:85] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 8
I20260709 12:27:47.082058  8544 pending_rounds.cc:107] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 12:27:47.082350  8544 raft_consensus.cc:2889] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:46.988943  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 130936us
I20260709 12:27:47.082578  8361 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:47.082973  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49268 (request call id 2096) took 3264 ms. Trace:
I20260709 12:27:47.083305  8544 rpcz_store.cc:276] 0709 12:27:43.818818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:46.872424 (+3053606us) service_pool.cc:224] Handling call
0709 12:27:46.872700 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:47.082776 (+210076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:47.082926 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:46.999248  8435 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.000653  9047 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 12:27:47.001331 12472 log.cc:927] Time spent T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:27:47.001636  8567 debug-util.cc:398] Leaking SignalData structure 0x7b080011d940 after lost signal to thread 7261
I20260709 12:27:47.016038  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.085083 12072 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.085543  8537 raft_consensus.cc:2393] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:47.018666  8396 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:47.086133 12433 raft_consensus.cc:3060] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:47.021481  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 101964us
I20260709 12:27:46.852027 12144 raft_consensus.cc:740] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:47.023921  8389 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:47.090258  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.090845  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:47.082894  8438 connection.cc:256] RPC call timeout handler was delayed by -1.3756026169999132s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
I20260709 12:27:47.055936  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.091933  8470 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
W20260709 12:27:47.092147  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.078562  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:47.092670  8438 connection.cc:256] RPC call timeout handler was delayed by -1.2325026170001365s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 12:27:46.998991 12027 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:27:47.053082  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.053499 12452 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:47.063114  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.065840 12474 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.066900  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:47.096616  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:47.072288  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:47.097440  9043 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:47.091457  8463 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
W20260709 12:27:47.076884  8539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49268 (request call id 2085) took 3276 ms (client timeout 1602 ms). Trace:
I20260709 12:27:47.022027  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.099159  8468 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:46.998648 12218 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.079288 12108 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:47.055662 12364 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:47.100181  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.095000  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.100561  8545 raft_consensus.cc:2410] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:47.100881  8468 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:47.101069  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:46.985687 12436 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:47.085049  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000afe20 after lost signal to thread 7264
I20260709 12:27:47.092859  8467 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 4.
W20260709 12:27:47.093756  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1945329219997802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
W20260709 12:27:47.102900  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1857026170000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
I20260709 12:27:47.049911  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:46.994722 12432 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.045699 12419 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:47.095846  8544 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:47.095767  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.100721  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.105547  9050 raft_consensus.cc:2410] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:47.094864  9045 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:47.101440  8510 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:47.098560  8539 rpcz_store.cc:269] 0709 12:27:43.800870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:44.891854 (+1090984us) service_pool.cc:224] Handling call
0709 12:27:47.076691 (+2184837us) spinlock_profiling.cc:243] Waited 90.4 ms on lock 0x7b54003facd4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:47.076815 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207889664}
I20260709 12:27:47.090938  8537 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:47.074380  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:47.103112  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc060 after lost signal to thread 8329
W20260709 12:27:47.107721  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08001dc9c0 after lost signal to thread 8389
I20260709 12:27:47.096647  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:47.108372  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800149ac0 after lost signal to thread 8421
I20260709 12:27:47.088384  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:47.103555  8543 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:47.109146  9048 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:47.109336  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.103029  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:47.109787  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1497141289996762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
W20260709 12:27:47.110141  8438 connection.cc:256] RPC call timeout handler was delayed by -1.1486445780001304s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
I20260709 12:27:47.079145  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.096730 12452 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.107231  9049 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
W20260709 12:27:47.169634  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 58130.3us
I20260709 12:27:47.098834 12291 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:47.104836 12419 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:47.114566  9014 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:47.118057  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:47.176853  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 65733.6us
I20260709 12:27:47.176939 12318 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:47.104307  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:47.101625  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 165424us
I20260709 12:27:47.176036  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:47.133289  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.111678  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:47.111223  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800149be0 after lost signal to thread 8422
I20260709 12:27:47.111322 12434 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.179402  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:47.179253 12434 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.181018  8470 raft_consensus.cc:1275] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:47.181214  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:47.182911 12434 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:47.180127  9043 raft_consensus.cc:2468] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:47.169790  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:47.190672 12452 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:47.175935 12419 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:47.192487 12218 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:47.055773 12471 consensus_queue.cc:260] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.194984  9044 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:47.177171  8464 raft_consensus.cc:2410] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:27:47.181481 12291 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:47.178354  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.132696 12364 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:27:47.178630  8467 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:47.187927  8470 raft_consensus.cc:1275] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:27:47.205658  8470 pending_rounds.cc:85] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 5
I20260709 12:27:47.206077  8470 pending_rounds.cc:107] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:27:47.206589  8470 raft_consensus.cc:2889] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:47.188050  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:47.097498 12456 raft_consensus.cc:3060] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:47.136449  8292 catalog_manager.cc:5697] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 5 to 10, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.195974 12436 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:47.179752  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800158080 after lost signal to thread 8496
I20260709 12:27:47.199118  8463 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:47.199313  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.220424  8468 raft_consensus.cc:2410] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:27:47.204620  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.204702  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.221611  8471 raft_consensus.cc:2410] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:27:47.190815  8469 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:47.222532 12455 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:47.183437 12453 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:47.223169 12453 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:47.223335  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.222556 12432 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.224113 12432 consensus_queue.cc:1059] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:47.224840 12432 raft_consensus.cc:3055] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:27:47.225126 12432 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:47.225828 12432 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.226622  8471 raft_consensus.cc:1240] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:47.226944 12432 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:47.227648  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.104677 12144 consensus_queue.cc:260] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.228816 12144 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:47.229365 12419 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.207890 12364 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.225718  8464 raft_consensus.cc:1240] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:47.230378 12364 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:47.170074 12296 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
I20260709 12:27:47.234447 12453 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:47.240502 12477 log.cc:927] Time spent T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 12:27:47.241772 12464 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:47.242132  8469 raft_consensus.cc:2468] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
I20260709 12:27:47.245036  8510 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:47.247732  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.248540  8510 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:47.249205  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:47.249630  8361 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.248894  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.250921  8539 raft_consensus.cc:2468] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:47.251870  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.252629  8541 raft_consensus.cc:2410] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:27:47.252754  9043 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:47.244622  8292 catalog_manager.cc:5697] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 9 to 11, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 11 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:47.222404  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000b9f80 after lost signal to thread 8512
W20260709 12:27:47.255234  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000c87a0 after lost signal to thread 8540
W20260709 12:27:47.255537  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08001c96c0 after lost signal to thread 8543
W20260709 12:27:47.255760  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08001a29e0 after lost signal to thread 8544
W20260709 12:27:47.255973  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc940 after lost signal to thread 8545
W20260709 12:27:47.256168  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3ea0 after lost signal to thread 8546
W20260709 12:27:47.256632  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3b80 after lost signal to thread 8570
W20260709 12:27:47.257036  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08002ede00 after lost signal to thread 9016
W20260709 12:27:47.258033  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800349e00 after lost signal to thread 9074
W20260709 12:27:47.258327  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08002af680 after lost signal to thread 9075
W20260709 12:27:47.258561  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800358c80 after lost signal to thread 11903
W20260709 12:27:47.258801  8567 debug-util.cc:398] Leaking SignalData structure 0x7b080039b360 after lost signal to thread 12100
W20260709 12:27:47.258999  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08001a10c0 after lost signal to thread 12104
W20260709 12:27:47.259191  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003c1400 after lost signal to thread 12108
W20260709 12:27:47.259549  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 64397.9us
W20260709 12:27:47.266858  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003505c0 after lost signal to thread 12191
W20260709 12:27:47.267172  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5c40 after lost signal to thread 12218
W20260709 12:27:47.267400  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800234880 after lost signal to thread 12291
W20260709 12:27:47.267822  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08000574c0 after lost signal to thread 12293
W20260709 12:27:47.268114  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800347800 after lost signal to thread 12318
I20260709 12:27:47.287091  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:47.288854  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4ba0 after lost signal to thread 12323
W20260709 12:27:47.289170  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003343c0 after lost signal to thread 12344
I20260709 12:27:47.289090  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:47.289573  8567 debug-util.cc:398] Leaking SignalData structure 0x7b080032c140 after lost signal to thread 12362
W20260709 12:27:47.289839  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003df5e0 after lost signal to thread 12363
W20260709 12:27:47.290057  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800308be0 after lost signal to thread 12366
W20260709 12:27:47.290270  8567 debug-util.cc:398] Leaking SignalData structure 0x7b080039cea0 after lost signal to thread 12370
W20260709 12:27:47.290482  8567 debug-util.cc:398] Leaking SignalData structure 0x7b080037ee80 after lost signal to thread 12382
W20260709 12:27:47.290740  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003663e0 after lost signal to thread 12403
I20260709 12:27:47.290911  8539 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:47.291009  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800370be0 after lost signal to thread 12406
W20260709 12:27:47.293355  8512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.096628 12363 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.207975 12344 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:47.298030  8438 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:47.301126  8292 catalog_manager.cc:5697] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.302305  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.298513  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.304256  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.199553 12291 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:47.306326  8546 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:47.301641  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.306931  8538 raft_consensus.cc:1275] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:47.251627 12027 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:47.348284  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:47.360368  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 51423.9us
I20260709 12:27:47.309501  8292 catalog_manager.cc:5697] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 9 to 10, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.287557 12464 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:47.360718  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.395875  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:47.288130 12108 raft_consensus.cc:2804] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:27:47.343017  9013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.366595  8539 raft_consensus.cc:2468] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:47.302865 12443 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:47.405259  9015 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.286803  9041 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:47.397955  8467 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 12.
I20260709 12:27:47.310457  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:47.368685  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 64811.7us
I20260709 12:27:47.400602  8543 raft_consensus.cc:1240] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:27:47.407964  8292 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 3 to 6, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.410667  9015 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:47.416831  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:47.415966  8541 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:47.398468  8540 raft_consensus.cc:2468] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
W20260709 12:27:47.412319  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:47.380033  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.303897 12455 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:47.309064 12435 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:27:47.420042  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.398116 12464 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.401438 12027 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:47.424892  9015 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:47.424425  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.429247  8292 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 4 to 6, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 6 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.394379 12291 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:47.418519 12454 consensus_meta.cc:287] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.000s
W20260709 12:27:47.418279 12403 consensus_meta.cc:287] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.002s
I20260709 12:27:47.433550  8511 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:47.426872  8436 connection.cc:256] RPC call timeout handler was delayed by -2.3127581100002317s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 12:27:47.434849  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.436350 12486 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:47.431659  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.441874  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.309681 12458 consensus_queue.cc:1048] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
I20260709 12:27:47.308719 12440 consensus_queue.cc:1048] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 12:27:47.444532  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.445118  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.367647 12474 consensus_queue.cc:1059] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:27:47.360935 12468 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:27:47.303119 12446 consensus_queue.cc:1048] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 12:27:47.420687 12476 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:47.417300 12108 raft_consensus.cc:697] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:47.397812 12368 consensus_queue.cc:1048] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:27:47.360232 12475 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:27:47.418243 12443 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.421150 12293 consensus_queue.cc:1059] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:27:47.417577 12423 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:47.422516 12296 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:47.467808  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.553565  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.515429  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.534782  8510 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:47.518388  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.612789  8464 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
W20260709 12:27:47.520334 12478 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:27:47.441510 12419 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.465487 12318 raft_consensus.cc:2804] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:27:47.630066 12496 log.cc:927] Time spent T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:47.429481 12455 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.632184  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.632798  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.632802  8467 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:47.634249  8467 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:47.632144 12455 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:47.517428 12484 log.cc:927] Time spent T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:27:47.513520  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.488859  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:47.642352  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 44993.1us
W20260709 12:27:47.647243  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:47.613322  8436 connection.cc:256] RPC call timeout handler was delayed by -1.9005581100004747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
I20260709 12:27:47.577036  8546 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
W20260709 12:27:47.652012  8436 connection.cc:256] RPC call timeout handler was delayed by -1.7202441260001251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2118s for a response
W20260709 12:27:47.447269  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 338091us
W20260709 12:27:47.653663  8512 leader_election.cc:336] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:47.467777  8292 catalog_manager.cc:5697] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 6 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:47.654594  8512 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:47.511304  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.628667  8544 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:47.442132 12464 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:47.522318  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.659101  8539 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:47.656348  8543 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:47.659801  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.654922  8292 catalog_manager.cc:5697] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 8 to 9, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 9 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.647943  8541 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:47.660434  8542 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:47.661232 12423 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:47.663322  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.664063  8465 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:47.665125 12108 consensus_queue.cc:237] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:47.669269  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:47.669879  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.676090  8362 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:47.677408 12433 consensus_meta.cc:287] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.591s	user 0.003s	sys 0.006s
I20260709 12:27:47.678865 12456 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:47.680460  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.700133  8467 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:47.492440 12466 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.488772 12442 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.191s
W20260709 12:27:47.683104 12370 consensus_meta.cc:287] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.739s	user 0.006s	sys 0.000s
I20260709 12:27:47.623042 12486 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.706444  9041 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:27:47.708169  8468 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:47.684656  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:47.710549  8538 raft_consensus.cc:2393] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 13: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:47.685911  8546 raft_consensus.cc:1240] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:27:47.686110  8292 catalog_manager.cc:5697] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 6 to 9, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 9 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.637919 12443 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.507875 12344 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:47.624897 11903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.020s
I20260709 12:27:47.656883 12318 raft_consensus.cc:697] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:47.547075 12452 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.702242 12218 consensus_queue.cc:1059] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:27:47.720618 12364 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.721607 12452 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.722671 12318 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.723660  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.629959 12474 raft_consensus.cc:3055] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:47.555112  9046 raft_consensus.cc:2468] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:47.725942 12474 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:47.694454  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.719807 12344 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.728708 12466 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:47.694461 12468 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:47.729370 12468 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:47.729749 12468 raft_consensus.cc:3060] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:47.730479 12344 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.723196  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.661065  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:47.696557  8436 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:47.692819 12437 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:47.627120 12476 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.704654  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:47.717383 11903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.020s
W20260709 12:27:47.717540  8361 connection.cc:256] RPC call timeout handler was delayed by -2.3084679419998793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 12:27:47.753890  8361 connection.cc:256] RPC call timeout handler was delayed by -2.23466794199976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 12:27:47.754225  8361 connection.cc:256] RPC call timeout handler was delayed by -2.2184679419997337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
W20260709 12:27:47.754482  8361 connection.cc:256] RPC call timeout handler was delayed by -2.213067941999725s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 12:27:47.754729  8361 connection.cc:256] RPC call timeout handler was delayed by -2.2085679419997177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:27:47.754989  8361 connection.cc:256] RPC call timeout handler was delayed by -2.1923679419996915s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260709 12:27:47.755234  8361 connection.cc:256] RPC call timeout handler was delayed by -2.1752679419996639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 12:27:47.755506  8361 connection.cc:256] RPC call timeout handler was delayed by -2.1617679419996421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:27:47.755761  8361 connection.cc:256] RPC call timeout handler was delayed by -2.1518679419996261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
W20260709 12:27:47.756018  8361 connection.cc:256] RPC call timeout handler was delayed by -2.1482679419996202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:27:47.756256  8361 connection.cc:256] RPC call timeout handler was delayed by -2.14196794199961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 12:27:47.756498  8361 connection.cc:256] RPC call timeout handler was delayed by -2.1293679420000444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 12:27:47.756736  8361 connection.cc:256] RPC call timeout handler was delayed by -2.0654679419999411s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:27:47.756986  8361 connection.cc:256] RPC call timeout handler was delayed by -2.0420679419999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:27:47.757226  8361 connection.cc:256] RPC call timeout handler was delayed by -2.0321679419998873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 12:27:47.757468  8361 connection.cc:256] RPC call timeout handler was delayed by -2.0267679419998785s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
W20260709 12:27:47.757719  8361 connection.cc:256] RPC call timeout handler was delayed by -1.916967941999701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:27:47.757972  8361 connection.cc:256] RPC call timeout handler was delayed by -1.8944679419996646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 12:27:47.758229  8361 connection.cc:256] RPC call timeout handler was delayed by -1.8431679420000364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2037s for a response
W20260709 12:27:47.758490  8361 connection.cc:256] RPC call timeout handler was delayed by -1.711767941999824s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260709 12:27:47.758734  8361 connection.cc:256] RPC call timeout handler was delayed by -1.6946679419997963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 12:27:47.758994  8361 connection.cc:256] RPC call timeout handler was delayed by -1.62896794199969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2275s for a response
I20260709 12:27:47.707877 12486 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.719805 12443 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.700510 12454 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:47.733649  8292 catalog_manager.cc:5697] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.726773 12474 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.736304  8537 raft_consensus.cc:1240] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:47.714080  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.722671 12364 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:47.751281  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.752312  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.761552  8538 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:47.765843  8436 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:47.767372  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.767633  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:47.811292  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 45509.4us
W20260709 12:27:47.759243  8361 connection.cc:256] RPC call timeout handler was delayed by -1.2023679419999098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27490000000000003s for a response
I20260709 12:27:47.717161 12456 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:47.769181 12370 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:27:47.767216 12475 raft_consensus.cc:3055] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:47.813386 12475 raft_consensus.cc:740] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:47.766956 12454 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:47.804358  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 370841us
W20260709 12:27:47.783955  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 129380us
I20260709 12:27:47.749003 12100 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:47.785401  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.765511 12440 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:47.770495 12443 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.790694  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:47.812722  8436 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:47.835294  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 300579us
I20260709 12:27:47.836973  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:47.837594  9041 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:47.829780 12454 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:47.791316 12027 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:47.816705  8512 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:47.844023  8512 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:47.844467  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:47.817096  8511 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:47.845702  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:47.818149  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 404668us
W20260709 12:27:47.806721 12482 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.019s	sys 0.019s
I20260709 12:27:47.814100 12456 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.816102 12144 raft_consensus.cc:2804] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:47.814818  8361 leader_election.cc:400] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
W20260709 12:27:47.833281 12432 consensus_meta.cc:287] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.004s
I20260709 12:27:47.843640  8436 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:47.849099  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:47.849388  8511 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:47.851086  8361 leader_election.cc:403] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:47.817149 11903 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:27:47.853492  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:47.848169 12482 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.019s	sys 0.019s
W20260709 12:27:47.862040  8512 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:47.862715  8512 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:47.863082  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:47.842720 12100 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:47.864100  8512 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:47.855054 12437 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:47.839792 12291 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.851289 12364 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:47.867142  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:47.850696 12499 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:47.868027  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:47.868959 12453 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
W20260709 12:27:47.893221  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 43893.6us
I20260709 12:27:47.858876 12144 raft_consensus.cc:697] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:47.857215 12458 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:47.854908 12442 consensus_queue.cc:1048] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
W20260709 12:27:47.902923  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 88238.5us
I20260709 12:27:47.908169  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:47.900547  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:47.895318  8436 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:47.904280  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.912343  8471 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:47.867985 12446 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:47.858407 12293 consensus_queue.cc:1048] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:27:47.869719 12437 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:47.862272 12432 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:27:47.839628 12475 consensus_queue.cc:260] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.904074 12370 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:47.935906 12370 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.936273 12370 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:47.915319 12452 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.943849 12452 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.945885 12452 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:47.949251 12296 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:47.950106  9044 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:47.950978  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.951849  8471 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:47.952343 12456 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.958663 12459 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:47.959146 12459 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:47.922992 12437 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:47.985935  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 132358us
I20260709 12:27:47.923895 12144 consensus_queue.cc:237] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.905297 12458 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.893102 12502 consensus_queue.cc:1048] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:27:47.902987 12503 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:47.896469 12497 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.918669 12364 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:47.927290 12291 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:47.933336 12027 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:47.905404 12462 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:48.054775 12462 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:47.934268 12476 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:47.959861 12495 log.cc:927] Time spent T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:27:47.878072 12500 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:47.919936  8436 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:48.079336  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 159481us
I20260709 12:27:47.897712 12499 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.963150  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:47.960098 12370 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:47.936204 12475 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:48.023344  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 115244us
W20260709 12:27:48.052927  8438 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:47.982842 12468 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:47.986492 12459 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:48.084316  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:47.986213 12344 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:47.999253 12458 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:27:48.080571  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 182703us
I20260709 12:27:48.084216 12500 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.084275  8438 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.101123  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:48.064958  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:48.088162  8361 leader_election.cc:400] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 7 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 7. Current term is 8.
I20260709 12:27:48.085372 12363 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:48.107045  8465 raft_consensus.cc:2410] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:27:48.107990  8511 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:48.087860 12443 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.055256 12462 raft_consensus.cc:3060] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:48.083660 12499 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:48.099107  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 235007us
I20260709 12:27:48.110980  8511 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:48.114338  8512 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.064508 12497 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:48.116770  8512 leader_election.cc:336] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.117611  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:48.118953  8511 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:48.118110  8512 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.122480  8512 leader_election.cc:336] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.124935  8511 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:48.131644  8512 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.109572 12363 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.111529 12364 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:48.054167 12100 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.138944  8511 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.107771 12500 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.132274  8512 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:48.114866 12438 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:48.140614  8511 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.120188 12502 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:48.149123  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 96219.2us
I20260709 12:27:48.136571 12108 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:48.156868  8538 raft_consensus.cc:1275] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:27:48.156466  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 72343.6us
I20260709 12:27:48.158083  8361 leader_election.cc:400] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
I20260709 12:27:48.136127 12446 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:48.153206  8540 raft_consensus.cc:1275] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:27:48.158942  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:48.151775  8438 leader_election.cc:336] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.136940 12518 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:48.138989 12363 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.161989  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:48.143383 12438 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:48.169998  8511 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:48.171062  8362 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:48.149595 12502 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.177381  9041 raft_consensus.cc:2468] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 7.
W20260709 12:27:48.190389  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 58745.2us
W20260709 12:27:48.191291  8363 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:48.169766 12518 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.168576 12364 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:48.180882 12438 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:48.173177 12455 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:48.191763  8512 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.179674 12452 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:48.193269  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:48.169672 12218 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:48.187489 12344 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:27:48.201370 12519 log.cc:927] Time spent T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:48.181159 12502 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.190837 12446 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:48.206810  8512 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:48.199967 12364 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:48.214498 12468 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:48.214731 12466 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:48.200489 12518 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:48.215788 12471 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:48.210462 12452 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.219027 12344 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:48.293206 12344 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:48.210372 12455 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.295083 12468 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:48.295830 12468 consensus_queue.cc:1048] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:27:48.296173  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 123384us
I20260709 12:27:48.296926  8361 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.297132 12468 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:48.298136 12443 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:48.295588 12455 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.217139 12454 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.223552 12506 consensus_queue.cc:1048] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:27:48.190466 12464 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.227721 12364 raft_consensus.cc:3060] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:48.224360 12370 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.221087  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.298154  8361 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.326836 12497 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.327862  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:48.328972  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:48.195034 12524 consensus_queue.cc:1059] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:27:48.335047 12499 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.286419 12466 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.292378 12452 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:48.341125  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 120088us
I20260709 12:27:48.304826 12446 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:48.352188  8539 raft_consensus.cc:1240] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:48.348421  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50401.6us
I20260709 12:27:48.350035  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.356295 12527 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:48.356706 12527 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.356769  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.357095 12527 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:48.357877 12517 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:48.358271 12517 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.358573 12517 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.359854  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.361032  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.361825  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:48.362502  8539 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 14: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:48.363607  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:48.364068  8539 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:48.365592 12517 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.367668 12517 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.368966  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:48.369526  8538 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.374864  8539 raft_consensus.cc:2468] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
I20260709 12:27:48.376376  8540 raft_consensus.cc:1240] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 5. Current term is 6. Ops: []
I20260709 12:27:48.377403  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:48.346813 12455 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:48.378000  8539 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:27:48.380985  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.382813  8541 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:48.349314 12466 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.398165  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.369984 12370 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.399955 12497 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:48.429520  8538 raft_consensus.cc:2468] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:48.401942 12524 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.433843  8539 raft_consensus.cc:2468] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
I20260709 12:27:48.436537 12526 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:48.437038 12526 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.437388 12526 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:48.458431 12500 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.470544 12464 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:48.471525  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:48.416445 12370 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.415632 12443 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:48.462846 12502 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.491008  8539 raft_consensus.cc:1275] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:48.495338 12454 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:48.498265  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 107631us
W20260709 12:27:48.499790  8438 leader_election.cc:336] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.500406  8438 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:48.507920  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 148470us
W20260709 12:27:48.513695  8438 leader_election.cc:336] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.543228  8438 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.484614 12524 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:48.505128 12437 consensus_meta.cc:287] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
W20260709 12:27:48.536846  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:48.514276 12108 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:48.544837  8438 leader_election.cc:336] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.532105 12443 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:48.554436  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.546980  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.535117 12218 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:48.544448  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.555287  8470 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:48.574826  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 383057us
I20260709 12:27:48.541108 12454 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:48.580691  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 400074us
W20260709 12:27:48.587975  8512 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.578420  8438 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.553851 11903 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:48.588403  8510 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:48.588404  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:48.588728  8438 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.591339  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:48.591339  8512 leader_election.cc:336] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.591440  8438 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.592084  8512 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:48.589244 12475 consensus_meta.cc:287] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.501s	user 0.013s	sys 0.000s
I20260709 12:27:48.586838 12499 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.554150 12437 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:48.603593  8438 leader_election.cc:336] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.603801  8512 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.602082  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:48.614060  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 208517us
I20260709 12:27:48.586808 12455 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.618115 12475 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:48.618090 12455 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.618808  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:48.620066  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:48.620641  9041 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:48.621169  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:48.621624  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:48.575557 12452 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.575963 12459 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.622910  8438 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.597031 12108 raft_consensus.cc:2804] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:48.627913  8361 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:48.600031 12464 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:48.628640  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:48.630988  8538 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:48.631712  8438 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.634287  8438 leader_election.cc:336] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.634694  8438 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.605355 12144 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:27:48.637841 12144 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:48.639649 12530 log.cc:927] Time spent T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:27:48.640223 12452 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.642226 12459 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:48.644932  8438 leader_election.cc:336] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.645397  8438 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:48.646698  8438 leader_election.cc:336] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.647073  8438 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:48.654747 12144 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:48.655535 12144 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:48.657464 12507 log.cc:927] Time spent T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.559s	user 0.002s	sys 0.027s
I20260709 12:27:48.661458  8538 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:48.654660  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.663640  8472 raft_consensus.cc:3060] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:48.664924  9044 raft_consensus.cc:2468] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:48.589466 12454 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.655625  8465 raft_consensus.cc:1240] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:48.668547 12370 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.628630 12514 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:48.668756  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 124383us
W20260709 12:27:48.687919 12536 log.cc:927] Time spent T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:27:48.688467  9014 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:48.675292  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.689231  8471 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:48.689893 12437 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.690239 12482 raft_consensus.cc:3055] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:48.575874 12443 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.692334 12455 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:48.692852 12455 raft_consensus.cc:2804] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:48.693187 12455 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:48.693529 12455 raft_consensus.cc:3060] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:48.677845 12363 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.614187 12506 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:48.679605 12108 raft_consensus.cc:697] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:48.680464 12500 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:48.632206 11903 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:48.626382 12475 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:48.687070 12474 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:48.667780  8510 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:48.684270 12524 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:48.698927 12462 consensus_meta.cc:287] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
W20260709 12:27:48.700884  8438 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.709038 12527 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.706214  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:48.695731  8511 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:48.717062  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:48.717566 12527 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.707242  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.684948 12497 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:48.686220 12502 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.723352  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:48.694295 12443 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:48.710363  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:48.736783  8543 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:48.718114  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:48.720192  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 52494.1us
I20260709 12:27:48.732411  8542 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:48.724083  9014 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:48.741379  8464 raft_consensus.cc:2368] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13.
I20260709 12:27:48.722200  9041 raft_consensus.cc:2468] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:48.728963  8472 raft_consensus.cc:2468] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:48.743351  8510 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:48.729727  8438 leader_election.cc:336] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.723436 12452 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:48.731529 12464 raft_consensus.cc:2804] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:48.746449  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:48.746891 12027 raft_consensus.cc:2804] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:27:48.747058 12438 consensus_meta.cc:287] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.001s
I20260709 12:27:48.747710 12538 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:48.690665 12482 raft_consensus.cc:740] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:48.754951 12459 consensus_queue.cc:1048] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:48.754534 12535 raft_consensus.cc:2804] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:48.755399 12482 consensus_queue.cc:260] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.756685 12482 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:48.747771  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.758580 12464 raft_consensus.cc:697] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:48.759894  8464 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:48.759667 12464 consensus_queue.cc:237] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.751444  8438 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:48.752245  8471 raft_consensus.cc:2468] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 12.
I20260709 12:27:48.754536 12438 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.762380  8436 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.760916 12500 consensus_queue.cc:1048] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:48.690599 12454 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.718103 12527 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:48.766458  8511 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.787396  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:48.762406  8438 leader_election.cc:336] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.763615  8542 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:48.788110  8538 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
W20260709 12:27:48.697460 12458 consensus_meta.cc:287] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.003s
I20260709 12:27:48.727890 12363 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.791381  9015 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:48.810081  8436 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:48.847316  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 238908us
W20260709 12:27:48.849016  9016 leader_election.cc:336] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.850426  9016 leader_election.cc:336] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.790048 12370 raft_consensus.cc:2804] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:48.731953 12462 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.675299 12526 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.786332 12218 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:48.765054 12027 raft_consensus.cc:697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:48.765437 12497 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:48.765640 12506 raft_consensus.cc:2804] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:48.724133 12344 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:48.902724  8438 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:48.809688 12539 raft_consensus.cc:2804] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:48.763306 12443 consensus_queue.cc:1059] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 12:27:48.942682 12443 raft_consensus.cc:3055] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:48.943028 12443 raft_consensus.cc:740] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:48.943949 12462 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.943809 12443 consensus_queue.cc:260] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.908331 12547 raft_consensus.cc:2804] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:48.786113 12466 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:48.906108  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 55703.4us
I20260709 12:27:48.785447 12535 raft_consensus.cc:697] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 13 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:48.852001 12296 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 12:27:48.914247  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 104255us
I20260709 12:27:48.810096 12454 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:48.785179 12502 consensus_queue.cc:1059] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 12:27:48.936820  8539 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:48.940650 12526 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.940984 12344 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:48.941361 12506 raft_consensus.cc:697] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:48.967636  8540 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 10: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:48.852210 12525 consensus_queue.cc:1048] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.111s
W20260709 12:27:48.945640  9016 leader_election.cc:336] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:48.969928  9016 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:48.948624  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.945182 12370 raft_consensus.cc:697] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:48.921417  8543 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 14.
I20260709 12:27:48.927052 12524 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:27:48.936069 12518 consensus_meta.cc:287] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.001s
I20260709 12:27:48.951292  8436 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.929802 12144 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.978125  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:48.978566 12144 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.957496  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:48.982656 12364 consensus_meta.cc:287] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: Time spent flushing consensus metadata: real 0.639s	user 0.007s	sys 0.002s
I20260709 12:27:48.983083 12364 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.985127 12364 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.934475 12440 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.987661 12440 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.989619 12440 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:48.958166  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:48.994179  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:48.975728 12438 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:48.970890  8472 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:48.810001 12458 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.951809 12443 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:48.973116  9016 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:48.963828 12471 consensus_meta.cc:287] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.001s
I20260709 12:27:48.975576 12532 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:48.976060 12370 consensus_queue.cc:237] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.950060 12547 raft_consensus.cc:697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:48.969837 12525 consensus_queue.cc:1243] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:27:49.002586 12518 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:48.937502 12497 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.102519 12518 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:49.103062 12497 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:48.960757 12454 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.968104  8470 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
I20260709 12:27:48.999827 12535 consensus_queue.cc:237] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.913645 12108 consensus_queue.cc:237] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.001341 12506 consensus_queue.cc:237] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.005932 12027 consensus_queue.cc:237] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:48.946431 12452 consensus_queue.cc:1059] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:27:49.069307  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 91248.3us
I20260709 12:27:49.077021  8471 raft_consensus.cc:2468] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:49.078131  8510 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:49.088093  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.089893  9016 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:49.093122  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:49.096135  8469 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:49.096959  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.108419  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:49.119750  8472 raft_consensus.cc:3060] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:49.088640 12218 raft_consensus.cc:3055] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:49.089152 12368 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:49.088191 12502 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:49.112762  8465 raft_consensus.cc:2368] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:49.117630  8436 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:49.124516  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 151409us
I20260709 12:27:49.094321 12524 raft_consensus.cc:697] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:49.127945 12144 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:49.109539 12435 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:27:49.168109  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 50564.1us
W20260709 12:27:49.143181  9016 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.164405  8472 raft_consensus.cc:2468] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 5.
I20260709 12:27:49.175693  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:49.176819  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.177347  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.177834  9016 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.179024  8469 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39226 (request call id 2060) took 1744 ms (client timeout 2270 ms). Trace:
I20260709 12:27:49.179257  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.179901  8540 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:49.175086  8511 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:49.187280  8438 leader_election.cc:336] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.188228  8438 leader_election.cc:336] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.188617  8438 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:49.179493  8469 rpcz_store.cc:269] 0709 12:27:47.424048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:47.424165 (+   117us) service_pool.cc:224] Handling call
0709 12:27:49.168698 (+1744533us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001a6154. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:49.168803 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3803714432}
I20260709 12:27:49.190775  8537 raft_consensus.cc:1275] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:27:49.192119  8512 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.019s	sys 0.031s
I20260709 12:27:49.123435 12293 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:49.193492  8512 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.019s	sys 0.031s
I20260709 12:27:49.202450  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:49.203145  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 585793us
I20260709 12:27:49.195813  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.179944  9016 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:49.140825 12518 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:49.160964 12368 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.197091  8511 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:49.126379 12497 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:49.127637 12218 raft_consensus.cc:740] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
W20260709 12:27:49.198277  8438 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.220165  8438 leader_election.cc:336] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.220582  8438 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:49.203388  8465 raft_consensus.cc:2368] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:49.221954  8362 leader_election.cc:400] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13.
I20260709 12:27:49.222265  8362 leader_election.cc:403] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:49.203878  8544 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:49.155725 12454 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:49.215926  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.224263  8469 raft_consensus.cc:2393] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:49.160265 12502 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.150840 12538 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:49.192423 12300 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:27:49.230068  8438 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.230986  8438 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.231787  8438 leader_election.cc:336] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.232661  8438 leader_election.cc:336] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.233007  8438 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:49.196622 12500 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.197754 12459 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.210578 12452 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:49.183566 12419 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:49.216611  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.248986  8472 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
W20260709 12:27:49.226338  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.207983 12471 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:49.238901  8438 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.209651 12503 raft_consensus.cc:2804] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:27:49.216388 12499 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.019s	sys 0.028s
I20260709 12:27:49.219848 12368 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:49.222877  8362 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:49.265096  8438 leader_election.cc:336] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.228130 12502 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:49.274377  8438 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:49.228207 12344 raft_consensus.cc:3060] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:27:49.270116  8468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.018s	sys 0.038s
W20260709 12:27:49.277901  8468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.018s	sys 0.039s
I20260709 12:27:49.234061 12144 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:49.279280  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.280404  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:49.242340 12462 raft_consensus.cc:2804] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:49.235620 12466 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:49.281775  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 58962us
I20260709 12:27:49.278452  8537 pending_rounds.cc:85] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 3
I20260709 12:27:49.242132 12514 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:49.212862 12293 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.243573 12300 raft_consensus.cc:697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:49.229382 12497 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.269505 12555 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:49.273572 12499 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.020s	sys 0.028s
I20260709 12:27:49.285841  8362 leader_election.cc:400] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:49.302094  8362 leader_election.cc:403] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:27:49.242628 12500 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.269344 12539 raft_consensus.cc:697] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
W20260709 12:27:49.287238  8361 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.022s	sys 0.010s
W20260709 12:27:49.307641  8361 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.022s	sys 0.010s
I20260709 12:27:49.284184 12454 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:49.284372 12553 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:49.331156 12553 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.283070 12436 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:49.298940 12462 raft_consensus.cc:697] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:49.280510 12474 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:49.308182  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 681162us
I20260709 12:27:49.286064  8537 pending_rounds.cc:107] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:27:49.349516  8537 raft_consensus.cc:2889] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:49.274114 12524 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:49.281325  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.354421  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 73128.6us
I20260709 12:27:49.289328 12503 raft_consensus.cc:697] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:49.284722  8436 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:49.284623 12523 consensus_queue.cc:1048] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:27:49.239156 12547 consensus_queue.cc:237] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.246508 12459 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.351794  9044 raft_consensus.cc:1240] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:49.352617  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:49.334193 12455 consensus_meta.cc:287] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.001s
I20260709 12:27:49.381907  9043 raft_consensus.cc:1240] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: []
W20260709 12:27:49.381028  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.386377  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 189334us
W20260709 12:27:49.387976  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 103323us
I20260709 12:27:49.389400  9042 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:49.294844 12218 consensus_queue.cc:260] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.394809  9041 raft_consensus.cc:2376] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9. Re-sending same reply.
W20260709 12:27:49.398917  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:49.398034  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:49.385919 12548 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
W20260709 12:27:49.398387  8438 consensus_peers.cc:597] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:49.306746 12555 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.405510  8511 leader_election.cc:400] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:49.405829  8511 leader_election.cc:403] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:27:49.403512  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.406466  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.407001  8438 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.404505  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.407832  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.416016  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.416428  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.417889 12551 log.cc:927] Time spent T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:27:49.391760 12436 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:27:49.418395  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 68761.2us
I20260709 12:27:49.358397 12474 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:49.415315  9016 leader_election.cc:336] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.477509  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.477965  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 61177.6us
W20260709 12:27:49.478605  8438 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.478118  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 66247.2us
I20260709 12:27:49.479017  8438 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:49.472957  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:49.396222 12561 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:49.404788  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:49.482724  8540 raft_consensus.cc:2468] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:49.482331  8466 raft_consensus.cc:2468] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
W20260709 12:27:49.487640  9016 leader_election.cc:336] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.489224  9044 raft_consensus.cc:1275] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:27:49.515741  8360 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:49.418385 12527 raft_consensus.cc:3060] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:49.485100  8436 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:49.467286 12218 raft_consensus.cc:3060] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:49.397835 12455 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.469754 12436 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.393532 12300 consensus_queue.cc:237] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:49.619532 12558 log.cc:927] Time spent T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
W20260709 12:27:49.494994 12482 consensus_meta.cc:287] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.738s	user 0.007s	sys 0.004s
I20260709 12:27:49.526388 12503 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.356877 12539 consensus_queue.cc:237] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.414983 12437 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:49.523228 12475 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:49.546168  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 58565us
W20260709 12:27:49.535125  8438 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.668329  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 163193us
W20260709 12:27:49.669039  8438 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.669409  8438 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:49.670490  8438 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.530004 12553 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:49.622820 12562 log.cc:927] Time spent T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
W20260709 12:27:49.624161  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 139123us
I20260709 12:27:49.529563  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.495183 12462 consensus_queue.cc:237] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:49.638685 12559 log.cc:927] Time spent T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
W20260709 12:27:49.671310  8438 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.625027 12497 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:49.622618  9046 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:49.623378 12571 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.636318 11903 raft_consensus.cc:2804] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:49.635689 12436 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:49.667587 12437 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.674063 12296 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:49.674247 12525 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:27:49.688726  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 215848us
I20260709 12:27:49.635828 12454 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:49.719300  8361 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:49.720621  8361 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:49.690991 12500 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:49.692915 12553 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.705971 12437 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:49.691357 12579 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:49.716706 12554 log.cc:927] Time spent T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 12:27:49.706171 11903 raft_consensus.cc:697] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:49.735026  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:49.724238 12556 log.cc:927] Time spent T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
I20260709 12:27:49.738442  8539 raft_consensus.cc:1240] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:27:49.738972  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:49.742456 12555 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:49.743024 12555 raft_consensus.cc:2804] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:49.743345 12555 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:49.743676 12555 raft_consensus.cc:3060] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:49.747707 12459 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:49.741495 12474 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:49.714658 12296 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.725831 12576 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:49.699640 12571 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.737561 12580 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:49.773307 11903 consensus_queue.cc:237] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.771934 12454 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.740526 12497 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:49.780475 12455 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:49.772984 12569 log.cc:927] Time spent T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.004s
W20260709 12:27:49.781117 12564 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 12:27:49.786655 12560 log.cc:927] Time spent T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.306s	user 0.000s	sys 0.008s
W20260709 12:27:49.796859 12570 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:27:49.792002 12576 raft_consensus.cc:697] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
W20260709 12:27:49.788093 12572 log.cc:927] Time spent T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.004s
I20260709 12:27:49.803793 12576 consensus_queue.cc:237] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.737483 12579 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.783041 12555 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:49.794240 12443 consensus_meta.cc:287] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.700s	user 0.009s	sys 0.001s
I20260709 12:27:49.820576  8468 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39226 (request call id 2074) took 1366 ms. Trace:
I20260709 12:27:49.834632  8468 rpcz_store.cc:276] 0709 12:27:48.435266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:48.676221 (+240955us) service_pool.cc:224] Handling call
0709 12:27:48.676575 (+   354us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:48.718708 (+ 42133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:48.718738 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:27:48.719422 (+   684us) log.cc:844] Serialized 78 byte log entry
0709 12:27:49.278298 (+558876us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:27:49.294150 (+ 15852us) log.cc:844] Serialized 14 byte log entry
0709 12:27:49.401586 (+107436us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b180048d240. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6461216c0a 00007f646a956219 00007f646129ea40 00007f64612994e4 00007f6461299455 00007f6467d813c7 00007f64643939a7 00007f64643a30bf 00007f64643a3038
0709 12:27:49.404312 (+  2726us) log.cc:844] Serialized 14 byte log entry
0709 12:27:49.405951 (+  1639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:49.713894 (+307943us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b5400196254. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f6464389e01 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2 00007f64626c448c 00007f64626c38c6
0709 12:27:49.713954 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:49.801831 (+ 87877us) raft_consensus.cc:1685] finished
0709 12:27:49.801851 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:49.801992 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96860,"prepare.queue_time_us":246513,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":2642,"raft.queue_time_us":3896,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":23596,"spinlock_wait_cycles":100565888,"thread_start_us":558480,"threads_started":1,"wal-append.queue_time_us":667679}
W20260709 12:27:49.824195  8438 leader_election.cc:336] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:49.846120  8438 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:49.846726  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:49.797883 12318 raft_consensus.cc:3055] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:49.797065 12497 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.834127 12555 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:49.828926 12579 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:49.849895  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.850610  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.861336  8466 raft_consensus.cc:2368] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
I20260709 12:27:49.851841  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.861968  8472 raft_consensus.cc:2468] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 4.
I20260709 12:27:49.852823  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:49.853118  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.854064  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
W20260709 12:27:49.858536  8438 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.800434  9046 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
W20260709 12:27:49.872547  8438 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.879540  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:49.880380  8464 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:49.855803 12318 raft_consensus.cc:740] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
W20260709 12:27:49.878130 12564 log.cc:927] Time spent T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:27:49.883926 12556 log.cc:927] Time spent T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:27:49.889132  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 150226us
I20260709 12:27:49.919925  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:49.923655  8438 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:49.857064 12437 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.884409 12555 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.929581  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:49.930208  9042 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:49.932924  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:49.933837  8361 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:49.935973 12368 consensus_meta.cc:287] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.653s	user 0.005s	sys 0.009s
I20260709 12:27:49.936929  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:49.937623  9048 raft_consensus.cc:2393] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:49.936336  8545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58406 (request call id 449) took 1172 ms. Trace:
I20260709 12:27:49.920230 12474 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.940953  9050 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:49.938102  8545 rpcz_store.cc:276] 0709 12:27:48.764285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:48.764450 (+   165us) service_pool.cc:224] Handling call
0709 12:27:48.765461 (+  1011us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:48.765866 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:48.765894 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:48.789602 (+ 23708us) log.cc:844] Serialized 52 byte log entry
0709 12:27:49.310530 (+520928us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:49.331215 (+ 20685us) log.cc:844] Serialized 14 byte log entry
0709 12:27:49.331673 (+   458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:49.331745 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:49.936148 (+604403us) raft_consensus.cc:1685] finished
0709 12:27:49.936167 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:49.936286 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398,"prepare.queue_time_us":28065,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":710,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":7766,"thread_start_us":398061,"threads_started":1,"wal-append.queue_time_us":551176}
I20260709 12:27:49.873348 12497 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.945315 12553 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:49.945881 12497 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:49.945987 12566 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:49.924127 12454 raft_consensus.cc:2804] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:49.946491 12454 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:49.946899 12454 raft_consensus.cc:3060] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:49.948882  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:49.949631  9046 raft_consensus.cc:2368] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:49.950663  8541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49270 (request call id 2190) took 1459 ms. Trace:
I20260709 12:27:49.946494 12566 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:49.939179 12502 consensus_meta.cc:287] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.004s
I20260709 12:27:49.958134 12502 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:49.959131 12344 consensus_meta.cc:287] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.000s
I20260709 12:27:49.964912 12344 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13.
I20260709 12:27:49.960964  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:49.965356  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.966522  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.968683  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.969496  8467 raft_consensus.cc:2410] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:27:49.970362  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.971021  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.972195  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.973240  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.973933  8539 raft_consensus.cc:2393] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 13: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:49.974604  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.975211  8539 raft_consensus.cc:2393] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:49.975718  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.975484 12318 consensus_queue.cc:260] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.976085  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.961827 12527 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d for earlier term 10. Current term is 11.
I20260709 12:27:49.950500 12474 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.964265  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.960391 12502 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:49.971736  9045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:49.971032  8540 raft_consensus.cc:2368] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:49.977344  9042 raft_consensus.cc:2393] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 9: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:49.936406 12368 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.951000  8541 rpcz_store.cc:276] 0709 12:27:48.491696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:48.491835 (+   139us) service_pool.cc:224] Handling call
0709 12:27:48.493501 (+  1666us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:48.493878 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:48.493907 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:48.649252 (+155345us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b2c000688d8. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6462c82a11 00007f6462c92372 00007f64643c4a01 00007f646438943a 00007f646438883e 00007f646934d419 00007f64628c4bd4 00007f64628c4b62 00007f64628c4a91 00007f64628c4a0c 00007f64628c3cc2
0709 12:27:48.649780 (+   528us) log.cc:844] Serialized 52 byte log entry
0709 12:27:49.140431 (+490651us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:49.179427 (+ 38996us) log.cc:844] Serialized 14 byte log entry
0709 12:27:49.190479 (+ 11052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:49.190568 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:49.941764 (+751196us) raft_consensus.cc:1685] finished
0709 12:27:49.950467 (+  8703us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:49.950608 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10801,"prepare.queue_time_us":49061,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":18173,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":48016640,"thread_start_us":490280,"threads_started":1,"wal-append.queue_time_us":637910}
I20260709 12:27:49.978124  8362 leader_election.cc:400] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
I20260709 12:27:49.985774  8362 leader_election.cc:403] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:49.977639  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.979439  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.979482  8542 raft_consensus.cc:2368] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9.
I20260709 12:27:49.961637 12561 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:49.980496  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:49.981896  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.982795  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.988737  8362 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
I20260709 12:27:49.990688  8541 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:49.977989 12576 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:49.992923  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.993606  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:49.994892 12436 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.989871 12344 raft_consensus.cc:3060] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:27:49.996367 12454 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:49.937546 12555 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:49.997666  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.998915  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.999842  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:50.000597 12582 log.cc:927] Time spent T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:27:50.001176 12592 log.cc:927] Time spent T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:27:49.983188 12318 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:27:49.996299 12573 log.cc:927] Time spent T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.319s	user 0.003s	sys 0.000s
I20260709 12:27:50.001497 12368 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:49.997602 12497 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.004788  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.005622  8465 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:50.048439  8545 raft_consensus.cc:2368] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9.
I20260709 12:27:50.006851  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:49.991839 12584 raft_consensus.cc:2804] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:50.008145 12296 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.025259 12458 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.047391  8546 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:50.049221  9015 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:50.050977 12436 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.052667 12555 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.054055  8544 raft_consensus.cc:2468] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:50.068850 12296 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:27:50.049413  8541 raft_consensus.cc:2368] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:50.047912  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.070039  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:50.004755 12576 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.070581 12296 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:50.070803 12576 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.070356  8540 raft_consensus.cc:2368] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:50.050263  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.071969  8539 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
I20260709 12:27:50.072651 12296 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:27:50.047143  8538 raft_consensus.cc:2368] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:50.079097 12576 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.081801  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:50.082455 12296 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.051208 12584 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:50.083699 12584 raft_consensus.cc:3060] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:50.084079 12497 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.085254 12576 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:50.087759  8512 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.070143  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.046761 12435 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.091931  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.086571 12474 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.095863  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.096647  8537 raft_consensus.cc:2368] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13.
I20260709 12:27:50.101115  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.101622  8537 raft_consensus.cc:2368] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 13. Current term is 14.
I20260709 12:27:50.105288  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.106380  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.106964  8537 raft_consensus.cc:2393] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:50.107975  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.108556  8538 raft_consensus.cc:2410] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:27:50.100492 12563 consensus_queue.cc:1048] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:27:50.110059 12576 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.112239 12576 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.114758  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:50.119591 12576 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.117623  8511 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.122597 12563 raft_consensus.cc:2804] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:50.123066 12563 raft_consensus.cc:697] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:50.123925 12563 consensus_queue.cc:237] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.124612 12584 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.126806  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.126961 12584 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:50.128585 12591 log.cc:927] Time spent T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:27:50.138952  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.093669 12435 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.103303 12437 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:50.146373  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:50.143216  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 53512.4us
I20260709 12:27:50.143697  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:50.143718  9043 raft_consensus.cc:1275] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:27:50.149049  8512 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.149634  8361 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:50.149977  8512 leader_election.cc:336] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.150352  8512 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:50.150568  9016 leader_election.cc:336] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.151167  9016 leader_election.cc:336] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.151782  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.106177 12454 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:50.140273 12595 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:27:50.153016  8361 leader_election.cc:400] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:50.153270  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.155545  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.156147  8361 leader_election.cc:403] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:27:50.157708  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:50.156549  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.164072  9047 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:27:50.165373  8512 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.166134  8512 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.166429  8512 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.154971 12555 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.148543 12584 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:50.154356 12576 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.171283  8538 raft_consensus.cc:1275] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:50.159138 12454 raft_consensus.cc:3060] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.175436  8537 raft_consensus.cc:1240] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:50.175242 12437 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.176281 12437 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.177562  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:50.178669 12437 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:50.174072 12539 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.180763  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:50.181298  9041 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.182626  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.183576  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.184334 12497 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.184473 12555 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.184880  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:50.188349 12293 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.189080 12566 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:50.160048 12561 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:50.188653  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.191536  9016 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.191927  9016 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.183676  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:50.195005  8436 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.195243  8537 raft_consensus.cc:2410] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 12:27:50.195876  9016 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.197098  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:50.197947  8538 raft_consensus.cc:2393] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:50.181515 12584 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.198284  9015 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.199268 12474 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:50.204989 12571 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.201005 12344 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) with higher term. Message: Invalid argument: T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 11. Current term is 12.
I20260709 12:27:50.203269 12419 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:50.209165  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.209764  8543 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:50.208424 12446 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.210881 12446 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.212285 12435 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.212888 12108 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:50.213521 12446 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.208801  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.211254 12296 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.216652  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.215463  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.206256 12318 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.217687  9049 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:50.218581  8537 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 6.
I20260709 12:27:50.215161  8546 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:50.224241 12584 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.226068  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.226768  8543 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.227279  9041 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 12.
W20260709 12:27:50.232529  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 66408.6us
W20260709 12:27:50.233381  8512 leader_election.cc:336] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.233785  8512 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:50.234879  8512 leader_election.cc:336] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.235538  8512 leader_election.cc:336] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.236043  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:50.236205  8512 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.236634  8512 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.235381  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.243237  8541 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:50.237358 12506 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.237258  8545 raft_consensus.cc:2393] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:50.237202  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.239985  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.245560  8540 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.255621  8543 raft_consensus.cc:2468] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:50.259383  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.260675  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:50.255740  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 51606.5us
W20260709 12:27:50.267465  8512 leader_election.cc:336] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.232790 12440 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:50.268397  8512 leader_election.cc:336] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.276347  8512 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.269685  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.237381 12526 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:50.279585  8438 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.280270  8361 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.281306  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.242897 12584 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.281345  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.287428  9047 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:50.281925  9041 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 8.
I20260709 12:27:50.281872  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.284665  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
W20260709 12:27:50.284588  8512 leader_election.cc:336] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.288311  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:50.292713  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.288918  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:50.297214  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:50.289171  8542 raft_consensus.cc:2393] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 8: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:50.297782  8468 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.288568  8361 leader_election.cc:400] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:50.299155  8361 leader_election.cc:400] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9.
I20260709 12:27:50.299474  8361 leader_election.cc:403] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:50.290556  8512 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.300716  8512 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.301131  8512 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:50.302199  8512 leader_election.cc:336] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.302598  8512 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.283769 12446 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.268985 12344 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.275535 12561 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:50.310637  8464 raft_consensus.cc:1275] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:27:50.311018  8464 pending_rounds.cc:85] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 6
I20260709 12:27:50.311249  8464 pending_rounds.cc:107] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:27:50.311555  8464 raft_consensus.cc:2889] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:50.313983  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.275828 12506 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.303759  8540 raft_consensus.cc:2468] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
W20260709 12:27:50.306241  8512 leader_election.cc:336] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.306840  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:50.307066  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:50.316924  8470 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
W20260709 12:27:50.318054  8512 leader_election.cc:336] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.318882  8512 leader_election.cc:336] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.278414 12296 consensus_queue.cc:1048] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:27:50.287679 12553 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:50.288123 12497 raft_consensus.cc:3060] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.350457  9047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.351181  9047 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:50.319645  8436 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:27:50.319623  8512 leader_election.cc:336] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.324667  8511 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:50.325753  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.312726 12108 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.357379  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.319288 12579 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.342773  8469 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:27:50.305514 12440 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.358788  8512 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.287515 12526 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.361232  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.315377 12458 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.362886  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:27:50.369843  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 50228.4us
I20260709 12:27:50.337615 12344 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.297114 12584 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:50.370584  8512 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:50.374070  8512 leader_election.cc:336] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:50.374466  8512 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:50.357638 12293 raft_consensus.cc:2804] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:50.360212 12539 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:50.360172 12443 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:50.384866  8537 raft_consensus.cc:3060] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:50.384274 12503 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.368913 12482 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:50.366045 12553 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.392581  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:50.392746  9042 raft_consensus.cc:1240] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Rejecting Update request from peer 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 11. Current term is 12. Ops: [8.8-11.10]
I20260709 12:27:50.393343  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.393581  8540 raft_consensus.cc:1275] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:50.414994  8541 raft_consensus.cc:2410] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:27:50.386631 12539 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.400419 12293 raft_consensus.cc:697] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:50.401149 12526 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:50.371806 12458 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.406024  8537 raft_consensus.cc:2468] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 14.
I20260709 12:27:50.390537 12482 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.375725 12437 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.362025 12561 consensus_queue.cc:1059] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:27:50.386785 12502 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:27:50.429132  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.421739 12539 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:27:50.440263  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 82970.3us
I20260709 12:27:50.447953  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:50.424389 12218 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:50.430406 12482 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.424647 12475 consensus_queue.cc:1059] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:27:50.493664 12475 raft_consensus.cc:3055] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:50.494022 12475 raft_consensus.cc:740] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:50.495072  8542 raft_consensus.cc:1275] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:27:50.494817 12475 consensus_queue.cc:260] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.495990 12475 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.497422 12296 consensus_queue.cc:1048] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:50.498955  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:50.499729 12524 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:50.500139 12524 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.500509 12524 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.501619 12454 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019) with higher term. Message: Invalid argument: T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:50.447098 12526 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.455821  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.452502 12218 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.463781 12561 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:50.472836 12458 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.473326 12293 consensus_queue.cc:237] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.435945 12502 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.483564  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.517272  9048 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 14.
I20260709 12:27:50.484313  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.518397  8540 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 14.
I20260709 12:27:50.435524 12576 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:50.499864  8436 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.521158  8436 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.507221  8468 raft_consensus.cc:2468] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:50.510905  9047 raft_consensus.cc:1275] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:27:50.515630  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 59898.7us
I20260709 12:27:50.523470  8361 leader_election.cc:400] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9.
I20260709 12:27:50.523783  8361 leader_election.cc:403] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:27:50.499929 12584 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.511777 12218 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.525172  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:50.529487  8361 leader_election.cc:400] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:50.530006  8361 leader_election.cc:403] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:27:50.507835 12526 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.517477 12454 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:50.540289  8361 leader_election.cc:400] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:50.552256  8361 leader_election.cc:400] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:50.552552  8361 leader_election.cc:403] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:27:50.553447  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.518419 12502 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:50.564844  8361 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.524475 12300 raft_consensus.cc:2804] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:50.567478  8361 leader_election.cc:400] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13.
I20260709 12:27:50.525422 12458 raft_consensus.cc:2804] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:50.570200  8361 leader_election.cc:400] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 13. Current term is 14.
I20260709 12:27:50.571029  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.538759 12576 raft_consensus.cc:3060] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.585484  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.585420 12454 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.586294 12555 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:27:50.586694  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.536144 12368 consensus_queue.cc:1048] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:27:50.491295 12539 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.589458  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.549463 12584 raft_consensus.cc:3060] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:50.516641 12524 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.594022  8361 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.569391 12443 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:50.566171 12607 raft_consensus.cc:3060] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:50.571620 12344 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:50.549120 12568 consensus_queue.cc:1048] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:27:50.587888 12555 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.584285 12300 raft_consensus.cc:697] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:50.592710 12579 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9.
I20260709 12:27:50.595672 12454 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:27:50.636541  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 111858us
I20260709 12:27:50.637279  8436 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.609452 12443 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:50.659879  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 65837.8us
I20260709 12:27:50.662017  8361 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.668641  8540 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:50.651547 12344 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.670676  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.674185  8539 raft_consensus.cc:2393] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:50.676151  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.660177 12553 raft_consensus.cc:3055] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:50.678534  8537 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:27:50.680429  8537 pending_rounds.cc:85] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 6
I20260709 12:27:50.667950 12454 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.675845 12344 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.692490 12539 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.680505 12620 raft_consensus.cc:2804] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:50.680707  8537 pending_rounds.cc:107] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:27:50.696043  8537 raft_consensus.cc:2889] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:50.697992 12344 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.683629  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:50.683876  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 400431us
W20260709 12:27:50.700413  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.685153  8541 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:27:50.704902  8361 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:50.688377  8544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49270 (request call id 2210) took 1207 ms. Trace:
I20260709 12:27:50.708010  8544 rpcz_store.cc:276] 0709 12:27:49.480577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:49.529282 (+ 48705us) service_pool.cc:224] Handling call
0709 12:27:50.688198 (+1158916us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400388454. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f2571 00007f646438d2fa 00007f646934eb17 00007f64628c96d4 00007f64628c9662 00007f64628c9591 00007f64628c950c 00007f64628c87c2 00007f64626c448c 00007f64626c38c6 00007f64626c326f
0709 12:27:50.688301 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714794752}
I20260709 12:27:50.680337 12561 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:50.684453 12613 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:27:50.710119  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.716756  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:50.717402  9041 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:50.716702  8361 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:50.721514  8437 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:50.680292 12553 raft_consensus.cc:740] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:50.725068  9015 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.679188 12458 raft_consensus.cc:697] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:50.728338  8361 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:50.729682  8511 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.734198  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:50.736994  9043 raft_consensus.cc:1240] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 13 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:50.739639  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.714709 12584 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 9. Current term is 10.
I20260709 12:27:50.740330  8539 raft_consensus.cc:2468] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 14.
I20260709 12:27:50.714654 12626 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:50.719758 12344 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:27:50.726915 12620 raft_consensus.cc:697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:50.704087 12482 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.724052 12497 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.671589 12300 consensus_queue.cc:237] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.730728 12541 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:27:50.741993 12443 raft_consensus.cc:3060] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.740953 12555 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:50.754164 12318 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.744572 12527 raft_consensus.cc:2804] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:50.716393 12561 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.729261 12503 consensus_queue.cc:1048] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:27:50.771733  9041 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:50.729017 12539 consensus_queue.cc:1048] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:27:50.730684 12454 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:50.752398 12296 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:50.768188 12526 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:50.775276 12218 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:50.780225 12621 log.cc:927] Time spent T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:50.775295 12541 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:50.784174 12296 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.776800 12318 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.785166 12620 consensus_queue.cc:237] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.787020 12218 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.790409 12607 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 10. Current term is 11.
I20260709 12:27:50.769824 12584 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:27:50.778494 12458 consensus_queue.cc:237] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.788715 12443 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:50.790405 12502 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.750916 12553 consensus_queue.cc:260] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.800526 12502 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.801497 12576 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf for earlier term 8. Current term is 9.
I20260709 12:27:50.794170 12527 raft_consensus.cc:697] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:50.802820 12561 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.806406 12527 consensus_queue.cc:237] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.806942 12541 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.804059 12482 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.804913 12524 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.795621 12454 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:50.805496 12553 raft_consensus.cc:3060] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.811650 12454 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:50.856153  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 120423us
W20260709 12:27:50.754534  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 117345us
I20260709 12:27:50.864523  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.866694  8436 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
W20260709 12:27:50.877557  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 173401us
W20260709 12:27:50.879492  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.898679  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.899719  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.900605  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.901762  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.903677  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.904574  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.906332  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.907624  8538 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:50.909893  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.910953  8544 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:50.912585  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:50.913348 12218 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:50.913856 12218 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.932190 11903 raft_consensus.cc:2804] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:50.933029 11903 raft_consensus.cc:697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:50.906381  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.940127  8537 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:27:50.943816  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:50.944034  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:50.944334 12618 log.cc:927] Time spent T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:27:50.944947  9043 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.945904 12579 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:27:50.950644  9044 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:50.952926 12296 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.956573 12318 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:50.916435 12218 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:50.959179  8295 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:50.971004 12440 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:50.971429  8295 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 10 to 11, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:50.972059 12440 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.974861 12440 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.978118 12443 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:50.978252  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:50.978981 12443 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:50.980036 12561 raft_consensus.cc:2804] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:50.980472 12561 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:50.980798 12561 raft_consensus.cc:3060] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:50.981611 12443 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:50.984725 12440 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:50.987726 12440 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:50.991479  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:50.993288  8543 raft_consensus.cc:3060] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:50.974167  8295 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:51.010044  8538 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:51.010497  8537 raft_consensus.cc:2468] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 7.
I20260709 12:27:51.026326  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:51.027235  9049 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:50.934783 11903 consensus_queue.cc:237] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.043664 12368 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.044584 12368 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:51.024746  8512 leader_election.cc:336] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.053450  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 178264us
I20260709 12:27:51.055631 12579 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.056356 12579 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.056139  8295 catalog_manager.cc:5697] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 8 to 9, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:51.058104  8295 catalog_manager.cc:5697] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:51.058969 12579 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.059724 12576 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.060302 12576 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.062441 12576 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.062939 12576 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.063468  8537 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:27:51.064378  8544 raft_consensus.cc:1275] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:27:51.066838  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.022842 12443 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:51.077364  9043 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:51.047323 12368 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.087455  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:51.096681 12638 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.097308 12579 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.097388 12638 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:51.095400 12645 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:27:51.096705  8436 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:51.136207 12446 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.085436 12576 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.142446 12576 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:51.143237  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 56808.6us
I20260709 12:27:51.144091  8436 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:51.144225 12434 raft_consensus.cc:2804] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:27:51.147078 12434 raft_consensus.cc:697] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:51.149480  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.150379  8542 raft_consensus.cc:2393] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 13: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:51.150568  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.151364  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.156745  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.138939 12446 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.171192 12628 consensus_queue.cc:1048] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:51.172014 12440 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:51.172911  8540 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:51.171041 12474 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:27:51.177057  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.178256  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.179668  8544 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:27:51.180310  8470 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:27:51.181339  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.181615  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.182787 12526 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:51.151680  8512 leader_election.cc:336] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.184736  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:51.185487  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 100233us
I20260709 12:27:51.183064  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:51.186290  8512 leader_election.cc:336] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.188630 12368 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.189311 12368 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.190423  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.190176 12434 consensus_queue.cc:237] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.191227  8469 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 10.
I20260709 12:27:51.192355 12368 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.192377  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.193063 12370 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.154925  8295 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:51.098158 12579 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.151664 12443 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.204090  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:51.201448  8512 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.207144  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:51.209718 12649 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:27:51.210801 12443 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.211601  9043 raft_consensus.cc:1275] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:27:51.218988  8543 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:51.193707 12370 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.219942  8546 raft_consensus.cc:1240] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:27:51.220149  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.206195 12526 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.201277 12561 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.217679  8361 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:51.237130 12370 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.254019  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.254462  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.241616 12218 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.243374  8469 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:27:51.246122  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.244544  8468 raft_consensus.cc:1275] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:27:51.258455  8465 raft_consensus.cc:1275] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:27:51.246651  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:51.260596  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.261301  8472 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:51.266219 12458 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.266829 12458 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.264868  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.247529 12638 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:51.273463  8471 raft_consensus.cc:1275] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:27:51.260516 12368 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:51.275906 12370 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.298091  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:51.303685  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 116282us
I20260709 12:27:51.305970 12553 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:51.306581 12553 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.306995 12553 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:51.307950  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:51.308786  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 79610.3us
I20260709 12:27:51.310591 12296 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:51.311015 12296 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.311390 12296 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.288564  8436 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:51.299664 12300 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:27:51.318090 12555 consensus_queue.cc:1059] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:27:51.319011 12555 raft_consensus.cc:3055] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:27:51.323513  8464 raft_consensus.cc:1240] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Rejecting Update request from peer 21c151c99bcf4cbeb819de06e68d95bf for earlier term 6. Current term is 7. Ops: []
I20260709 12:27:51.324658  8466 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:51.332074 12218 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 15 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:51.332787 12300 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:51.333909 12300 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:51.349252  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 62877.6us
I20260709 12:27:51.302383 12370 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.319357 12555 raft_consensus.cc:740] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:51.326332 12579 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.336555 12458 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:51.360183  8512 leader_election.cc:336] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.347011 12561 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.369489 12649 raft_consensus.cc:2804] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:51.370440  8512 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:51.375783 12649 raft_consensus.cc:697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:51.379980 12649 consensus_queue.cc:237] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.385533 12503 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:51.386380 12526 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:51.401346 12370 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:51.418984 12648 log.cc:927] Time spent T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.214s	user 0.001s	sys 0.007s
I20260709 12:27:51.365017 12555 consensus_queue.cc:260] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:51.423507  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 95946.3us
W20260709 12:27:51.424386  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:51.425058  8512 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.425525  8512 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:51.425776  8295 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 8, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
W20260709 12:27:51.426976  8512 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.428228  8512 leader_election.cc:336] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.429302  8512 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.429755  8512 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:51.427466 12553 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.430609 12526 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:51.435057  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 228878us
I20260709 12:27:51.510404 12446 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:51.428949  8295 catalog_manager.cc:5697] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:51.426563 12442 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:27:51.431141  8512 leader_election.cc:336] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.435316 12555 raft_consensus.cc:3060] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:27:51.447109  8281 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet df155d204dc041d7b2ce5467f8825efd with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 2d99fb7f1afb4c958cdc302eb8ef165f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:51.448180  8292 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 254) took 23988 ms (client timeout 15000 ms). Trace:
I20260709 12:27:51.452744  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea8ca6961a884db3b196c76ca97b049a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.452792  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:51.532022  8281 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 85086.5us
W20260709 12:27:51.535960  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 104862us
W20260709 12:27:51.536715  8512 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.537118  8512 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:27:51.538432  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:51.540153 12442 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:51.454288  9049 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:27:51.460462  8438 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.465974  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:51.466670  8538 raft_consensus.cc:1275] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:27:51.466018  8546 raft_consensus.cc:1275] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:51.467545  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.470546  8539 raft_consensus.cc:1275] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:27:51.539252  8512 leader_election.cc:336] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.467135  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:51.480293 12656 log.cc:927] Time spent T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:27:51.483976  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.485438  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:51.489261 12561 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.494320  8467 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:27:51.545503  8467 pending_rounds.cc:85] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting all ops after (but not including) 9
I20260709 12:27:51.545823  8467 pending_rounds.cc:107] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:27:51.546087  8467 raft_consensus.cc:2889] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:51.547309  8537 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:51.495339  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:51.496652 12655 log.cc:927] Time spent T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:27:51.500517 12218 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:51.504498  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:51.512467 12502 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.435453  8466 raft_consensus.cc:1275] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:27:51.523725  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:51.524866  9016 leader_election.cc:336] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:51.544903  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 84497.6us
I20260709 12:27:51.554967  8537 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 15.
I20260709 12:27:51.552157  8295 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 10, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 10 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:51.555604  8438 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.545442 12561 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.560842 12502 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.561250 12561 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.562537 12458 consensus_queue.cc:1048] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:51.562911 12502 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.563545  9041 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:27:51.563707  8436 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:51.565017 12514 consensus_queue.cc:1048] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:51.567612  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.565013 12649 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:51.566365  8510 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:51.568078  8542 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:51.576548  8511 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:51.575321 12649 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 15 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:51.577368 12514 consensus_queue.cc:1048] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:51.578161 12649 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:51.580320  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 122722us
I20260709 12:27:51.581349 12440 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:51.581789 12440 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.582155 12440 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.581441 12526 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:51.590222 12027 consensus_queue.cc:1048] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:51.583289  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:51.595057 12514 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:51.595479 12514 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.595847 12514 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:51.596138  8295 catalog_manager.cc:5697] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 11 to 12, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 12 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:51.597534  8295 catalog_manager.cc:5697] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:51.595322 12218 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.601357 12218 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:51.603559  8463 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:27:51.606436  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:51.609272 12440 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.568861 12502 consensus_queue.cc:1048] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:27:51.612664 12502 consensus_queue.cc:1243] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Peer aef8c9f023564378a04e3e1e6171930d log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:27:51.614965  8543 pending_rounds.cc:85] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Aborting all ops after (but not including) 6
W20260709 12:27:51.620187  9016 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.620942  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:51.621294  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:51.619000  8543 pending_rounds.cc:107] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:27:51.626209  9049 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:51.626554  8543 raft_consensus.cc:2889] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:51.527918  8292 rpcz_store.cc:269] 0709 12:27:27.459856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:27.460033 (+   177us) service_pool.cc:224] Handling call
0709 12:27:30.550615 (+3090582us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b54004178d4. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f64642f3090 00007f6464391f3a 00007f646a147e9c 00007f646a24604e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc 00007f6468706392 00007f64626c448c 00007f64626c38c6
0709 12:27:51.447939 (+20897324us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:48.187872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:48.372174 (+184302us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:48.378276 (+  6102us) write_op.cc:435] Acquired schema lock
0709 12:27:48.380561 (+  2285us) tablet.cc:662] Decoding operations
0709 12:27:48.472270 (+ 91709us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:48.472329 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:48.472356 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:27:48.473490 (+  1134us) tablet.cc:701] Row locks acquired
0709 12:27:48.473509 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:27:48.473661 (+   152us) write_op.cc:270] Start()
0709 12:27:48.473776 (+   115us) write_op.cc:276] Timestamp: P: 1783600068473613 usec, L: 0
0709 12:27:48.473797 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:27:48.474464 (+   667us) log.cc:844] Serialized 6638 byte log entry
0709 12:27:49.282772 (+808308us) op_driver.cc:464] REPLICATION: finished
0709 12:27:49.677545 (+394773us) write_op.cc:301] APPLY: starting
0709 12:27:49.683178 (+  5633us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:49.736094 (+ 52916us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:49.751968 (+ 15874us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:49.753526 (+  1558us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:49.753802 (+   276us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 12:27:49.753847 (+    45us) write_op.cc:312] APPLY: finished
0709 12:27:49.754162 (+   315us) log.cc:844] Serialized 119 byte log entry
0709 12:27:49.772829 (+ 18667us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:49.777239 (+  4410us) write_op.cc:454] Released schema lock
0709 12:27:49.777298 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:49.779766 (+  2468us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:49.779797 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":387113,"reported_tablets":47,"spinlock_wait_cycles":4752497536,"child_traces":[["op",{"apply.queue_time_us":339450,"apply.run_cpu_time_us":4032,"apply.run_wall_time_us":116015,"num_ops":17,"prepare.queue_time_us":303293,"prepare.run_cpu_time_us":29188,"prepare.run_wall_time_us":450837,"raft.queue_time_us":509119,"raft.run_cpu_time_us":17544,"raft.run_wall_time_us":308999,"replication_time_us":769672,"thread_start_us":738273,"threads_started":4,"wal-append.queue_time_us":231132,"wal-append.run_cpu_time_us":16520,"wal-append.run_wall_time_us":2071766}]]}
I20260709 12:27:51.626246  9048 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
I20260709 12:27:51.648037  8546 raft_consensus.cc:2368] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10.
I20260709 12:27:51.599066  8295 catalog_manager.cc:5697] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf reported cstate change: term changed from 7 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:51.628758  9016 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:51.653163 12553 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:51.655598  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 63917us
I20260709 12:27:51.656028  8545 raft_consensus.cc:1275] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:51.657907  8469 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 8. Current term is 9. Ops: []
W20260709 12:27:51.660568  8438 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.572361 12561 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:27:51.618407  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ee35c47e0d403393cb03f68a432b98" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:51.617292  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:51.662601 11903 consensus_queue.cc:1048] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:51.665429  8438 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.665508  9042 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:51.664441  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 44290.7us
I20260709 12:27:51.667661 12419 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:51.616195 12440 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:51.679262  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 140043us
I20260709 12:27:51.679447  9042 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:51.681319  8510 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:51.662928 12555 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.613204 12514 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:51.684453 12419 consensus_queue.cc:1059] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:51.689083 12419 consensus_queue.cc:1243] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Peer 2d99fb7f1afb4c958cdc302eb8ef165f log is divergent from this leader: its last log entry 9.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:27:51.699874 12571 raft_consensus.cc:3055] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:27:51.700260 12571 raft_consensus.cc:740] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:51.701145 12571 consensus_queue.cc:260] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.702373 12571 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:51.709004 12442 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:27:51.709662 12660 log.cc:927] Time spent T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:27:51.711051 12555 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.716502  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:51.714211 12440 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:51.676004 12296 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.725776  8436 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:51.728957 12658 log.cc:927] Time spent T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:27:51.731457 12631 consensus_queue.cc:1048] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:27:51.734735 12514 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:51.742964 12440 raft_consensus.cc:697] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:51.743985 12440 consensus_queue.cc:237] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.750967  9049 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 15.
W20260709 12:27:51.763967  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 101991us
W20260709 12:27:51.764707  8438 leader_election.cc:336] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.765082  8438 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:51.766445  8438 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.766821  8438 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:51.767671 12435 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:51.770053 12579 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.770627 12579 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.748045 12502 raft_consensus.cc:2804] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:51.755882  8362 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:51.767606 12434 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:51.775944  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:51.782424  8540 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:51.772835 12579 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:51.756461 12458 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:51.785746  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:51.788590  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:51.789327  9049 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:51.795574 12443 raft_consensus.cc:3060] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:51.778383 12502 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:51.801429 12666 log.cc:927] Time spent T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:27:51.810693  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 251586us
I20260709 12:27:51.811812  8362 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:51.828927  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62492.5us
W20260709 12:27:51.831647  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:51.807180 12502 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:51.810222 12446 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:27:51.839859  8512 leader_election.cc:336] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.845587  8512 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:51.866226 12527 consensus_queue.cc:1048] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:27:51.866508 12539 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:51.876871 12553 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.877502 12553 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.878577  8436 leader_election.cc:400] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Vote denied by peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713) with higher term. Message: Invalid argument: T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2d99fb7f1afb4c958cdc302eb8ef165f for earlier term 9. Current term is 10.
I20260709 12:27:51.884771  8542 raft_consensus.cc:1275] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:27:51.886636  8545 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:27:51.887627  9042 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:27:51.887974  9042 pending_rounds.cc:85] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Aborting all ops after (but not including) 9
I20260709 12:27:51.888165  9042 pending_rounds.cc:107] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:27:51.888360  9042 raft_consensus.cc:2889] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:51.890060 12370 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.890544 12370 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:51.891307 12368 consensus_queue.cc:1048] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:51.893784 12370 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:51.842669 12446 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:51.828101 12579 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:27:51.837114 12631 consensus_queue.cc:1048] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:27:51.853916 12561 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:51.933836  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 122104us
I20260709 12:27:51.939203  8362 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:51.940307  8362 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:51.910457  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:51.952411  8463 raft_consensus.cc:1275] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:27:51.960474  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 128240us
W20260709 12:27:51.961272  8512 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.935909 12446 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:51.960830 12443 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:51.969620  8512 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:51.970062  8512 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:51.988696 12663 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:51.944013 12458 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:27:51.994925  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:51.993754 12443 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:52.017031  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 118022us
I20260709 12:27:51.991607 12561 raft_consensus.cc:3060] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:52.021340  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 81087.1us
I20260709 12:27:52.002182 12296 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:52.026823  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:52.040583  8362 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:52.043476  8362 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:52.044482  9043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:52.047086 12683 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:52.048556 12683 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:52.049957 12553 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:52.022886 12555 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:52.062994  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:52.063798  9044 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:52.067667  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:52.075464  9044 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:52.088106  8540 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 11.
I20260709 12:27:52.093178  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:52.093771  8465 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:52.092556  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:52.054306 12443 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:52.109138  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:52.112991  8541 raft_consensus.cc:1275] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:27:52.116904  8472 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:52.130357  8539 raft_consensus.cc:1275] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:52.133023 12689 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.133627 12689 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:52.140271  8436 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:52.126722 12553 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.134414 12555 raft_consensus.cc:493] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:52.122756 12218 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:27:52.170635 12689 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:52.148500 12683 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.173059  8465 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 11.
I20260709 12:27:52.148138  9042 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:27:52.180585 12690 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:52.181164 12690 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:52.182032 12690 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.214737 12692 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:27:52.215206  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:52.216094  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:52.187500 12443 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.219018  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:52.222610  9042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:52.177099 12300 consensus_queue.cc:1048] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:27:52.224187  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:52.186334 12555 raft_consensus.cc:515] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.234326  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:52.199568 12553 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.265110  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:52.235337 12443 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:52.264073  9016 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 211 similar messages]
I20260709 12:27:52.245236  8544 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21c151c99bcf4cbeb819de06e68d95bf in term 9.
I20260709 12:27:52.271390  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:52.272269  8541 raft_consensus.cc:2393] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 12: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:52.212560 12683 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:52.300638 12678 log.cc:927] Time spent T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.340s	user 0.003s	sys 0.000s
I20260709 12:27:52.304674  9042 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:52.306974 12539 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:27:52.321532 12218 consensus_queue.cc:1048] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:52.322845 12692 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:52.279385 12579 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.342062  8545 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 15 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:27:52.233227 12701 raft_consensus.cc:493] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
W20260709 12:27:52.368574  9016 leader_election.cc:336] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.388933 12555 leader_election.cc:290] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:52.376384 12561 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:52.405565  8537 raft_consensus.cc:1240] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Rejecting Update request from peer e3660d999c0a41658a1f1dbe7cc90746 for earlier term 8. Current term is 9. Ops: []
I20260709 12:27:52.343271 12579 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.414175 12690 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.414746 12690 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:52.416168 12699 log.cc:927] Time spent T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:27:52.416990 12690 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:52.424106 12705 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.425014  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:52.425746  8538 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 9.
W20260709 12:27:52.425854 12710 log.cc:927] Time spent T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:27:52.374598 12701 raft_consensus.cc:515] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.424785 12705 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.457273  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:52.457872  8538 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:52.475916 12502 consensus_meta.cc:287] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: Time spent flushing consensus metadata: real 0.614s	user 0.002s	sys 0.009s
I20260709 12:27:52.476429 12686 consensus_queue.cc:1048] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:27:52.479110 12435 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:52.479897  8436 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:52.481387 12514 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:52.481823 12514 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.482061 12446 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.483248  8542 raft_consensus.cc:2393] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:27:52.483022 12502 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:52.487550 12514 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:52.492585  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:52.499666  8438 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.544885  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:52.501581  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:52.548679  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 47139.1us
W20260709 12:27:52.549316  8438 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.550719 12443 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:52.553570  8469 raft_consensus.cc:3060] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:27:52.551075  8438 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:52.562966  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 70467.5us
I20260709 12:27:52.562976  8362 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:52.564571  8361 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:52.566082  8538 raft_consensus.cc:2468] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:27:52.566500  8362 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:52.578613 12446 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:52.572292  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:52.583336  8469 raft_consensus.cc:2468] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:27:52.583766  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:52.584367  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:52.583684  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:52.609156  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 58099.8us
I20260709 12:27:52.596321  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:52.574810  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:52.584096  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:52.611712  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:52.630107  9016 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:52.624390  8438 leader_election.cc:336] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.646880  8438 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:52.612818  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2219cc30a0424600b771d733ba9974e1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:52.653137  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 153484us
I20260709 12:27:52.573602 12443 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:27:52.566031 12689 raft_consensus.cc:493] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:52.655843  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 91345.7us
I20260709 12:27:52.662745  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:52.572077 12555 raft_consensus.cc:493] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.596104 12561 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:52.675740 12683 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:52.664017 12690 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:52.677106 12701 leader_election.cc:290] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:52.679162  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 209322us
W20260709 12:27:52.675669  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 279898us
I20260709 12:27:52.680445  8465 raft_consensus.cc:1275] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:27:52.665657  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:52.660359 12703 log.cc:927] Time spent T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:27:52.684402  8438 leader_election.cc:336] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.685118  8438 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:52.688482  8438 leader_election.cc:336] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.693972  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:52.694741  8471 raft_consensus.cc:2393] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate 21c151c99bcf4cbeb819de06e68d95bf in this term.
I20260709 12:27:52.691854  8438 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:52.684834 12561 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:52.705595  9014 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:52.688936 12687 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:52.690961 12725 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:52.696794 12555 raft_consensus.cc:515] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:52.695307 12701 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:52.720878  8438 leader_election.cc:336] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.721516  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:52.747911  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 64623.2us
W20260709 12:27:52.749158  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:52.749763  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:52.750312  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:52.703430 12443 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:52.689226 12689 raft_consensus.cc:515] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:52.751698  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 185253us
I20260709 12:27:52.773193  8362 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 
W20260709 12:27:52.762204  8438 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:52.695514 12683 raft_consensus.cc:493] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.773910  8438 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:52.788549  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 105175us
I20260709 12:27:52.852783  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:52.769667 12692 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:52.772504 12561 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.860718 12443 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:52.901088 12555 leader_election.cc:290] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:52.912582 12693 log.cc:927] Time spent T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:52.889012 12474 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:52.862521 12027 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:52.921025 12027 raft_consensus.cc:697] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:27:52.921972 12027 consensus_queue.cc:237] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:52.882102 12683 raft_consensus.cc:515] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:52.940670 12683 leader_election.cc:290] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:52.769873 12701 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:52.942803 12701 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:52.952281  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 289613us
I20260709 12:27:52.954072  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d; no voters: e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:52.886042 12561 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:52.950294 12704 log.cc:927] Time spent T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:27:52.997596  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 143181us
W20260709 12:27:52.996136  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 222691us
I20260709 12:27:52.963344 12701 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.009689 12735 raft_consensus.cc:493] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:53.010382 12735 raft_consensus.cc:515] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:53.011652  7261 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 8422)
W20260709 12:27:53.012195 12729 log.cc:927] Time spent T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:53.013625 12726 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:53.014448 12726 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.014843 12726 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.016989 12726 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.017498 12726 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.017880 12726 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.020223 12702 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:52.970851 12683 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:53.001703  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 301217us
I20260709 12:27:53.045840  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:52.966377 12514 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:53.048658  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 286480us
W20260709 12:27:53.071616  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.074822 12443 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 LEADER]: Becoming Leader. State: Replica: 21c151c99bcf4cbeb819de06e68d95bf, State: Running, Role: LEADER
I20260709 12:27:53.081947 12443 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.042059 12701 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.112062 12733 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:53.112460  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.114639  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.115677  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.116698  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.117352 12692 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:53.118624 12442 consensus_queue.cc:1048] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:53.121542  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.117954 12692 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.095842 12689 leader_election.cc:290] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:53.132805  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 178798us
I20260709 12:27:53.136940  8361 leader_election.cc:304] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.053668 12683 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.123781 12726 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.112723 12733 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.132373 12555 raft_consensus.cc:2804] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:27:53.169485  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 167810us
I20260709 12:27:53.172582 12555 raft_consensus.cc:493] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.210999  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.256026  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.256639  8284 maintenance_manager.cc:419] P fda1d6ce844f48669763ced7af1542be: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033400
I20260709 12:27:53.184922 12726 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.302680  8471 raft_consensus.cc:2393] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:53.235172 12555 raft_consensus.cc:3060] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:53.304463 12750 raft_consensus.cc:2749] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:53.336335  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 199452us
I20260709 12:27:53.210973 12735 leader_election.cc:290] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.353339 12730 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.353982 12730 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.356094 12749 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.313797 12726 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.356678 12749 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.358879 12726 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:53.360235 12709 log.cc:927] Time spent T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:53.361605 12758 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.362151 12758 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:53.365718  8438 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.367676 12752 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.368254 12752 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:53.375155  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.383196 11903 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.383738 11903 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.391858 12736 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:53.392416 12736 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:53.393380 12725 consensus_meta.cc:287] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: Time spent flushing consensus metadata: real 0.641s	user 0.003s	sys 0.005s
I20260709 12:27:53.390533 12750 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.395457 12759 raft_consensus.cc:493] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:53.409490  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 108012us
I20260709 12:27:53.411924 12751 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.412535 12751 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.413472  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47430 (request call id 427) took 1068 ms. Trace:
I20260709 12:27:53.413846  9044 rpcz_store.cc:276] 0709 12:27:52.345244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:52.350836 (+  5592us) service_pool.cc:224] Handling call
0709 12:27:52.351108 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:52.382102 (+ 30994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:52.382132 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:52.390131 (+  7999us) log.cc:844] Serialized 26 byte log entry
0709 12:27:52.666268 (+276137us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b18001cc780. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646126a2a6 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646127ee07 00007f646a0d99a9
0709 12:27:52.670981 (+  4713us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b18001cc780. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f6461216c0a 00007f646a956219 00007f646825d58f 00007f646129c571 00007f646129e7c1 00007f646129e779 00007f646129e709 00007f646129e6d1 00007f646129d9cd
0709 12:27:52.899311 (+228330us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18001cc780. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f646a164ab1 00007f646a171281 00007f646127ee07 00007f646a0d99a9 00007f646129b69b 00007f646129993f 00007f646129bc02 00007f6463f2320b 00007f6463f28d23 00007f6463f290d1 00007f6464344a0f
0709 12:27:53.077638 (+178327us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:53.077672 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:53.077734 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:53.413243 (+335509us) raft_consensus.cc:1685] finished
0709 12:27:53.413263 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:53.413400 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11171,"raft.queue_time_us":11664,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3406,"spinlock_wait_cycles":48829312,"thread_start_us":177785,"threads_started":1,"wal-append.queue_time_us":1021450}
I20260709 12:27:53.407671 12726 raft_consensus.cc:493] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.415839 12726 raft_consensus.cc:515] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.418823 12705 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:53.420912  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 670043us
W20260709 12:27:53.421573  8512 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:53.422411  8512 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.422786  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:53.423552 12740 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:53.426442 12683 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.427039 12759 raft_consensus.cc:515] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.429390 12759 leader_election.cc:290] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.429766 12751 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.407840 12701 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:53.434755 12753 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:27:53.404178 12725 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:53.438557 12701 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.439102 12701 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.447782 12725 raft_consensus.cc:493] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:53.448350 12725 raft_consensus.cc:515] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.409776 12750 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:53.472186  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 160875us
W20260709 12:27:53.478348  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 55956.1us
W20260709 12:27:53.479094  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.554286 12579 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.554584 12733 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.544745 12736 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.565882  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f4ad78594dd4320b4c04e2f4e775e85" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.567528  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.568290  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.569015  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d18f5c816314559a3727b41a178ee5c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.569613  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.570593  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.571254  8543 raft_consensus.cc:2393] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 11: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:53.573475 12752 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.574829 12749 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.567803  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.580862  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2e76be6a4cb43fdaee395073ab103da" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.581228  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.581578  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "605e001ede544f519292071c2eeb41fb" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.585356  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.588197  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.599561  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.605643  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.606879  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5fade2bf4064a129c23d8bb05ce09c7" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.608947  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.610160  8467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.611104  8471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.611199  8465 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.612239  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dec3215185474277adc36392bd1a7eda" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.608999  8463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.614760  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.623730  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.606514 12749 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.627719 12765 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:53.628001 12749 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.628340 12765 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:53.631652  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.564086 12555 raft_consensus.cc:515] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.637574  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.637627  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.638531  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.642858 12765 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:53.644593  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.648484  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:53.651113  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:53.652092  8438 consensus_peers.cc:597] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:53.653211  8438 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.653528 12752 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:53.655519 12752 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.657486 12752 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.658460 12749 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.658892 12692 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.655052  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbf9b71c617406c9d2be1cd987a6a94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.666877  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2310aee96e77479c812917bfcb775d66" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.668725  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6fb68f59621452b8e81b4fbe2cda697" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.669281  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec5712a692fb47d3aaf9c8440b1a75a1" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.669888  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.670964  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.671645  8546 raft_consensus.cc:2393] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 13: Already voted for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in this term.
I20260709 12:27:53.671802  8542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.672132  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d674c56f11d4d76a575c52d1a0e66bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:53.673226  8512 leader_election.cc:336] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.677524  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.678694  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.676183  8512 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:53.676949  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.680773  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.681777 12502 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.684345 12730 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.693571  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f27995e97dd24420a9a7efc50ed48941" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:53.708248  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 53400.3us
W20260709 12:27:53.713586  8512 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.709347 12695 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:53.710244  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c2e2eb7e2ca4c688fde6389b1c6a4ee" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.716500  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7de1dd05702461da4c0319fda01a7ca" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.718012  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.719499  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:53.720516  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a26f17e57344b8bba537d4b071c49be" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.721784  8361 leader_election.cc:304] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:53.722865 12730 raft_consensus.cc:2749] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:27:53.723778  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:53.726042  8361 leader_election.cc:304] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:53.726936 12730 raft_consensus.cc:2749] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:53.727905  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.685614 12555 leader_election.cc:290] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Requested vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.712001 12553 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.712288 12726 leader_election.cc:290] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.734952 12446 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:53.739502  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:53.751564  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 71469.5us
I20260709 12:27:53.753649 11903 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.756140 12701 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.756496  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.757216  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:53.758885  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.751060 12726 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:53.772755 12435 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:53.774495 12561 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.779074 12514 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.785775 12435 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.792433  8361 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.798580  8361 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:53.801752  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62480.4us
I20260709 12:27:53.805960  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.804241  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:53.807199  8546 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:53.808054  8361 leader_election.cc:304] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.806471  8543 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:53.814868  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73c51b6166884e0287dbdff730d29a1f" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.815284 12561 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:53.818223  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.777323 12758 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.823827 12726 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:53.830590  8361 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.831890  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78f588f9461a426ebd4a55bd3ade3583" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.833240  9014 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.835098  8361 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.837031  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016be601898642f5bfd00376e81080bd" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:53.838449  8361 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:53.836140 12736 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:53.841727 12750 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.843014  8539 raft_consensus.cc:2393] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 21c151c99bcf4cbeb819de06e68d95bf in current term 10: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:27:53.844082  8538 raft_consensus.cc:1275] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:27:53.845021 12561 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:53.837008 12758 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:53.856791  8546 raft_consensus.cc:2468] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 10.
I20260709 12:27:53.857555  8361 leader_election.cc:304] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.858605  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:53.859633 12774 log.cc:927] Time spent T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:27:53.860662 12701 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:53.861347 12701 raft_consensus.cc:2749] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:53.837395 12726 raft_consensus.cc:2749] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:53.869047  8362 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:53.870604  8512 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.871060 12750 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:53.871812 12750 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:53.871028  8512 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:53.872787  8361 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.874617 12726 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:53.875921  8361 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.876622 12726 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:53.878482 12296 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:53.879042 12296 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:53.880002 12776 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:27:53.881842 12296 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.882875  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:53.877933  8361 leader_election.cc:304] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:53.888827  8512 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.890111  8361 leader_election.cc:304] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.889218  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:53.893098  8361 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.891873 12726 raft_consensus.cc:2749] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:53.896322  8469 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:53.894107 12446 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:53.895038  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.897719  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:53.897842  8361 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.898922  8361 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.887722 12503 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:27:53.905014  8361 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.886636 12296 consensus_queue.cc:1048] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:27:53.905678 12553 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:53.905977 12725 leader_election.cc:290] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:53.906855 12419 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:53.907445 12419 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:53.909523 12419 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:53.899307 12701 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:27:53.894021 12758 raft_consensus.cc:2749] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:53.914471  8361 leader_election.cc:304] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.912608 12750 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:53.916100 12726 raft_consensus.cc:2749] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:53.918007  8438 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.919140  8438 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:53.919417  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:53.922674  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.923679  8470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:53.924230  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.918545  8361 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.915670 12561 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:53.917162 12758 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:53.929877  8361 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:53.927009  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:53.926149 12474 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:53.956532 12435 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:27:53.931334  8438 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.925997 12764 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:53.948242 12553 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:53.928500 12701 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 12:27:53.968622  8438 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.946280 12726 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:27:53.978420  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:53.984897 12296 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:53.930384 12750 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:53.969820  8438 leader_election.cc:336] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:53.928552 12712 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:53.932085  8361 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.008121  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ae3eef998ef416f8ebd3e8c21b20834" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
W20260709 12:27:54.012140  7261 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 8422)
W20260709 12:27:54.012876  8438 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:54.013865  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 81862us
I20260709 12:27:54.015276  8361 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.018575  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:54.019250  9044 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
I20260709 12:27:54.002807 12503 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:53.975900 12726 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:54.029145  8361 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.013677 12553 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.013312 12701 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.975800 12764 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:54.022541 12758 raft_consensus.cc:3060] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:54.035605 12725 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:54.039386 12553 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:54.029839 12750 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:54.053097 12553 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:54.040390 12691 raft_consensus.cc:493] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:54.055078  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.033509  8361 leader_election.cc:304] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:54.044034  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:54.071728  8295 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35636 (request call id 295) took 11249 ms. Trace:
I20260709 12:27:54.074776 12726 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:54.072173  8295 rpcz_store.cc:276] 0709 12:27:42.889740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:42.911495 (+ 21755us) service_pool.cc:224] Handling call
0709 12:27:54.071637 (+11160142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:52.070481 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:52.071104 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:52.071146 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:27:52.071164 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:52.072305 (+  1141us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:52.072403 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:52.072435 (+    32us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:27:52.073489 (+  1054us) tablet.cc:701] Row locks acquired
0709 12:27:52.073534 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:27:52.073700 (+   166us) write_op.cc:270] Start()
0709 12:27:52.073826 (+   126us) write_op.cc:276] Timestamp: P: 1783600072073636 usec, L: 0
0709 12:27:52.073860 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:27:52.074493 (+   633us) log.cc:844] Serialized 4784 byte log entry
0709 12:27:52.583860 (+509367us) op_driver.cc:464] REPLICATION: finished
0709 12:27:52.913536 (+329676us) write_op.cc:301] APPLY: starting
0709 12:27:52.913641 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:52.913920 (+   279us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:52.914068 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:52.915476 (+  1408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:52.915832 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:27:52.915889 (+    57us) write_op.cc:312] APPLY: finished
0709 12:27:52.916266 (+   377us) log.cc:844] Serialized 89 byte log entry
0709 12:27:52.916455 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:52.916589 (+   134us) write_op.cc:454] Released schema lock
0709 12:27:52.916650 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:52.917109 (+   459us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:52.917140 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":383202,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":329387,"apply.run_cpu_time_us":3567,"apply.run_wall_time_us":3569,"num_ops":12,"prepare.queue_time_us":234925,"prepare.run_cpu_time_us":44502,"prepare.run_wall_time_us":120918,"raft.queue_time_us":166184,"raft.run_cpu_time_us":16213,"raft.run_wall_time_us":280282,"replication_time_us":509842,"thread_start_us":599949,"threads_started":4,"wal-append.queue_time_us":135104,"wal-append.run_cpu_time_us":16269,"wal-append.run_wall_time_us":1707467}]]}
W20260709 12:27:54.127879  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 94452.8us
W20260709 12:27:54.130162  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 66547.2us
I20260709 12:27:54.128903  8361 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.132119  8436 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:54.140558  8361 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:54.142078  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 64958.2us
I20260709 12:27:54.145447  8361 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.146896  8546 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:27:54.041117 12701 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:54.036589 12503 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:54.128588 12691 raft_consensus.cc:515] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:54.131971 12726 raft_consensus.cc:2749] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:54.141934 12561 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:54.153069  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.155155  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.179157  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:54.166740  8436 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:54.209158  8436 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:54.210289  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:54.192831  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.199457  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:54.195024  8512 leader_election.cc:336] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.151202  8361 leader_election.cc:304] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:54.192211  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.187438  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:54.269076  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 58872.7us
W20260709 12:27:54.273320  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 52479us
W20260709 12:27:54.204388  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 54029.2us
I20260709 12:27:54.179891  8293 catalog_manager.cc:5697] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 8, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 8 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:54.276886  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62012.9us
I20260709 12:27:54.157286 12435 raft_consensus.cc:2804] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:54.156899 12553 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:54.154881 12725 raft_consensus.cc:3060] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:54.155726 12764 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:54.276299  8293 catalog_manager.cc:5697] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 11 to 13, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 13 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.279054  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.168663 12503 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:54.283249  8510 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:54.215801 12758 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:54.180109 12691 leader_election.cc:290] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:54.167102 12701 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:54.214326 12368 raft_consensus.cc:2749] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:54.214628 12561 raft_consensus.cc:493] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
W20260709 12:27:54.282289  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 131151us
I20260709 12:27:54.269459 12474 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:27:54.284024  8293 catalog_manager.cc:5697] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:54.329713  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e64f31022343538635c1fde40fe9d0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.284296 12523 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:54.333108  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d12c64e413ad46968034a527b5290316" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.333359  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "225b79a42b074c48a583a96802a0f532" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.283030 12750 raft_consensus.cc:2749] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:27:54.330705  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:54.340714  9016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 56558.8us
I20260709 12:27:54.286859 12458 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:27:54.335525 12523 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.343544 12523 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:54.328779  8293 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 8, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.346657  8293 catalog_manager.cc:5697] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 14, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 14 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.348110  8293 catalog_manager.cc:5697] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:54.349236  8293 catalog_manager.cc:5697] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:54.350696  8293 catalog_manager.cc:5697] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:54.352943  8293 catalog_manager.cc:5697] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 12, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 12 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:54.354400  8293 catalog_manager.cc:5697] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 11 to 12, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 12 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.359380  8293 catalog_manager.cc:5697] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:54.361431  8293 catalog_manager.cc:5697] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.363019  8293 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 6 to 10, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.286603 12553 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.286742 12764 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:54.369686  8293 catalog_manager.cc:5697] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 8, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.287976 12435 raft_consensus.cc:697] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:54.373981  8293 catalog_manager.cc:5697] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 10, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:54.341320  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:54.382675  8511 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:54.384676  8438 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:54.385120  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 96640.4us
I20260709 12:27:54.388069 12442 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:54.394929  8438 leader_election.cc:336] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.395437  8438 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.365198 12758 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.414355  8293 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:54.376794 12553 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:54.426945 12782 log.cc:927] Time spent T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:27:54.431982  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 46320.9us
I20260709 12:27:54.331099 12561 raft_consensus.cc:515] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:54.438282 12743 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:54.424791 12758 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:54.462208  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:54.458333  8293 catalog_manager.cc:5697] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 12, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 12 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:54.464298  8293 catalog_manager.cc:5697] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 11, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 11 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:54.465585  8293 catalog_manager.cc:5697] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 12 to 14, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 14 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:54.474403  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf567c52be7141c5b7edac250f385cc4" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:54.545440  8293 catalog_manager.cc:5697] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.447084 12435 consensus_queue.cc:237] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:54.549034  8293 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 11, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.544062  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:54.553788  7261 tablet_replica.cc:333] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:54.554913  7261 raft_consensus.cc:2243] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:54.555825  7261 raft_consensus.cc:2272] T a5fade2bf4064a129c23d8bb05ce09c7 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:54.558466 12785 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:27:54.559473 12783 log.cc:927] Time spent T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:27:54.560396  8293 catalog_manager.cc:5697] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:54.562300  8293 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 6 to 8, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 8 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:54.564509  8293 catalog_manager.cc:5697] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 11, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.567762  8293 catalog_manager.cc:5697] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:54.570603  8293 catalog_manager.cc:5697] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 9, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 9 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:54.573617  8293 catalog_manager.cc:5697] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:54.576602 12784 log.cc:927] Time spent T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 12:27:54.598507  8361 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.602005  8361 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:54.559522  7261 tablet_replica.cc:333] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:54.590515 12726 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.616932  7261 raft_consensus.cc:2243] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:54.619128  8538 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 21c151c99bcf4cbeb819de06e68d95bf: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:54.637256 12758 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:54.647194  7261 raft_consensus.cc:2272] T 9d18f5c816314559a3727b41a178ee5c P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:54.647532 12787 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:54.642336 12725 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:54.602880 12701 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.654963 12758 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:54.687853  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 86747.2us
I20260709 12:27:54.661772 12787 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.651492 12726 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:54.716310  8472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.716886  8466 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.660706 12523 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:54.746791  8361 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 144864us
W20260709 12:27:54.750262  9016 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.747736  8361 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:54.756108  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:54.712774 12561 leader_election.cc:290] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:54.670451 12701 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:54.770303 12553 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:54.778424  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 171384us
I20260709 12:27:54.780067  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:54.781798  9041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23e95bddd5b14e1b8e7f5bfe7a8f8392" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:54.741786 12446 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:54.762468 12725 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:54.795154  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 52959.1us
I20260709 12:27:54.720094 12787 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:54.801204 12539 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:27:54.821199 12726 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:54.795507 12794 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:27:54.828657  7261 tablet_replica.cc:333] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:54.829681  7261 raft_consensus.cc:2243] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:54.830263  7261 raft_consensus.cc:2272] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:54.831962 12523 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:54.835896  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.837589  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.793856 12446 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:54.847182  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 54664.3us
I20260709 12:27:54.850162  8436 leader_election.cc:304] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:54.842152 12539 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:54.853020 12788 log.cc:927] Time spent T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:27:54.855301 12539 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:54.871690 12692 raft_consensus.cc:2749] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:54.860862 12787 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:54.884033 12790 log.cc:927] Time spent T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 12:27:54.896873  7261 tablet_replica.cc:333] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:54.898532 12701 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:54.899663  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.900599 12701 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.901098 12701 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:54.901696  7261 raft_consensus.cc:2243] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:54.904299  7261 raft_consensus.cc:2272] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:54.907094 12446 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:27:54.875293  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:54.912744  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:54.913331  9048 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:54.915736  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:27:54.916275  8539 raft_consensus.cc:3060] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:54.915450  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:54.919077  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:54.912197 12701 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:54.919817  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:54.923194  8512 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:54.924541  8539 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:54.925534  9048 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
W20260709 12:27:54.925761  8512 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:54.899466  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 80608.8us
I20260709 12:27:54.927421  7261 tablet_replica.cc:333] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:54.933925  7261 raft_consensus.cc:2243] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:54.939858  7261 raft_consensus.cc:2272] T 1f4ad78594dd4320b4c04e2f4e775e85 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:54.940824  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 136027us
I20260709 12:27:54.943498  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "145eb7997c78480db629215c6acac8ef" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.966863  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8974a3bbc8c3420f95c2b151405bd386" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.966677  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:54.966768  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39e8dc02425a4fafb53164fd99fe0d0d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.988319  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "268ce46c10234969b0ee35600bf0a70d" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.999241  8543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "158edb8122f9489398444d919f25cbce" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.002540  8541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dabecae7023948069d48a04cefe25522" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:54.999838  8436 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:27:55.005311  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 223605us
I20260709 12:27:55.012159  8361 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.016916  8361 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:55.017364  8361 raft_consensus.cc:2686] T 268ce46c10234969b0ee35600bf0a70d P 21c151c99bcf4cbeb819de06e68d95bf: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:55.020056  8361 leader_election.cc:304] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:55.024305  8361 raft_consensus.cc:2686] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 21c151c99bcf4cbeb819de06e68d95bf: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:27:55.025108  8361 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.025990  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a231323db194487a6ca917e91cb1389" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:55.032302 12725 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:55.030793 12435 raft_consensus.cc:2804] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:55.033360 12435 raft_consensus.cc:697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:55.021688 12701 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:55.038766  8361 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.027199 12787 raft_consensus.cc:493] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.034873 12435 consensus_queue.cc:237] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:55.054402  8438 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 62644.8us
I20260709 12:27:55.062825  8511 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:55.044265 12758 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:27:55.072985  8361 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.074056  8361 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.077445 12503 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:55.079131 12804 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:55.080832 12804 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:55.061667 12787 raft_consensus.cc:515] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:55.093364 12787 leader_election.cc:290] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:55.104387  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:55.111608  7261 tablet_replica.cc:333] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
W20260709 12:27:55.111894  8438 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:55.112843  9048 consensus_queue.cc:237] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:55.119925  7261 raft_consensus.cc:2243] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.121583  7261 raft_consensus.cc:2272] T 2310aee96e77479c812917bfcb775d66 P 21c151c99bcf4cbeb819de06e68d95bf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.125644  7261 tablet_replica.cc:333] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.127214  7261 raft_consensus.cc:2243] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.127923  7261 raft_consensus.cc:2272] T 145eb7997c78480db629215c6acac8ef P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.145864  7261 tablet_replica.cc:333] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.155534  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:55.156508 12815 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:55.155591  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80def59f123c433b90d8ddb5d7e620c6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 11 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.168196  7261 raft_consensus.cc:2243] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.168851  7261 pending_rounds.cc:70] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 2 pending ops.
I20260709 12:27:55.169122  7261 pending_rounds.cc:77] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 8 index: 6 } timestamp: 7305625725679292416 op_type: NO_OP noop_request { }
I20260709 12:27:55.169684  7261 raft_consensus.cc:2889] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:55.170049  7261 pending_rounds.cc:77] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 7 index: 5 } timestamp: 7305625706365652992 op_type: NO_OP noop_request { }
I20260709 12:27:55.171576  7261 raft_consensus.cc:2889] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:55.171974  7261 raft_consensus.cc:2272] T 73c51b6166884e0287dbdff730d29a1f P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.173923  8361 leader_election.cc:304] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.178929 12787 raft_consensus.cc:2749] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:55.198638  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:55.208364  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.209005  8438 consensus_peers.cc:597] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.210039  8539 raft_consensus.cc:1275] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:55.211494 12810 consensus_queue.cc:1048] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:55.213972  7261 tablet_replica.cc:333] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.223681  7261 raft_consensus.cc:2243] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.224483  7261 raft_consensus.cc:2272] T 605e001ede544f519292071c2eeb41fb P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.227277  7261 tablet_replica.cc:333] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
W20260709 12:27:55.230468  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.246043  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.252645  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.266355  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.264108  7261 raft_consensus.cc:2243] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.267443  7261 raft_consensus.cc:2272] T 3d674c56f11d4d76a575c52d1a0e66bd P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:55.267007  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.268147 12787 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.268648 12787 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:55.270726 12787 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:55.272809  7261 tablet_replica.cc:333] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.273031 12810 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:55.276571  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.277397  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.276185  8546 raft_consensus.cc:2955] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 7 to 11, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:55.291872  7261 raft_consensus.cc:2243] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.292793  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:55.298395  7261 raft_consensus.cc:2272] T e78864d1ef6947eca56a20b30fc482a6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.298610  8362 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.301169 12787 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:55.306603  7261 tablet_replica.cc:333] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.308167  7261 raft_consensus.cc:2243] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.321652  8539 raft_consensus.cc:1275] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:27:55.322642  8293 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35638 (request call id 248) took 4435 ms. Trace:
I20260709 12:27:55.323779  7261 raft_consensus.cc:2272] T aeb63cbffbd24922b72419df5ee40899 P 21c151c99bcf4cbeb819de06e68d95bf [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.327630 12458 consensus_queue.cc:1048] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:27:55.323453  8293 rpcz_store.cc:276] 0709 12:27:50.885359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.885741 (+   382us) service_pool.cc:224] Handling call
0709 12:27:55.320752 (+4435011us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:54.823883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:54.824419 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:54.824447 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:27:54.824464 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:54.826190 (+  1726us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:54.826263 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:54.826291 (+    28us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:27:54.888161 (+ 61870us) tablet.cc:701] Row locks acquired
0709 12:27:54.888180 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:27:54.888315 (+   135us) write_op.cc:270] Start()
0709 12:27:54.888423 (+   108us) write_op.cc:276] Timestamp: P: 1783600074888271 usec, L: 0
0709 12:27:54.888450 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:27:54.889136 (+   686us) log.cc:844] Serialized 10545 byte log entry
0709 12:27:55.127489 (+238353us) op_driver.cc:464] REPLICATION: finished
0709 12:27:55.214599 (+ 87110us) write_op.cc:301] APPLY: starting
0709 12:27:55.214674 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:55.217078 (+  2404us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:55.217171 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:55.219311 (+  2140us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:55.235749 (+ 16438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=54
0709 12:27:55.235805 (+    56us) write_op.cc:312] APPLY: finished
0709 12:27:55.236301 (+   496us) log.cc:844] Serialized 182 byte log entry
0709 12:27:55.237390 (+  1089us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:55.237632 (+   242us) write_op.cc:454] Released schema lock
0709 12:27:55.237699 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:55.255677 (+ 17978us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:55.255706 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":452,"reported_tablets":51,"spinlock_wait_cycles":4480,"child_traces":[["op",{"apply.queue_time_us":86862,"apply.run_cpu_time_us":5891,"apply.run_wall_time_us":41045,"num_ops":27,"prepare.queue_time_us":101320,"prepare.run_cpu_time_us":21748,"prepare.run_wall_time_us":172552,"raft.queue_time_us":28531,"raft.run_cpu_time_us":7867,"raft.run_wall_time_us":91195,"replication_time_us":187854,"thread_start_us":231073,"threads_started":4,"wal-append.queue_time_us":132268}]]}
I20260709 12:27:55.355760  8280 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9ce4c75067748ad84434b89f28725b0 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 12:27:55.357520  8291 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 7 to 8, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.362686  7261 tablet_replica.cc:333] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.363684  7261 raft_consensus.cc:2243] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.364382  7261 raft_consensus.cc:2272] T 2bfca2ec0c4f47349d091a6486b08139 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.367066  7261 tablet_replica.cc:333] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.375308 12758 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.375981 12758 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:55.389040  7261 raft_consensus.cc:2243] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.392946  7261 pending_rounds.cc:70] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 2 pending ops.
I20260709 12:27:55.393242  7261 pending_rounds.cc:77] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 11 index: 6 } timestamp: 7305625853228572672 op_type: NO_OP noop_request { }
I20260709 12:27:55.393612  7261 raft_consensus.cc:2889] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:55.393932  7261 pending_rounds.cc:77] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 9 index: 5 } timestamp: 7305625780597170176 op_type: NO_OP noop_request { }
I20260709 12:27:55.394255  7261 raft_consensus.cc:2889] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:55.394601  7261 raft_consensus.cc:2272] T 2219cc30a0424600b771d733ba9974e1 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.403151  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:55.400921  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.418443 12758 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:55.421360  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:55.430271  8361 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.433707 12804 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:27:55.441488  8291 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:55.448378  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.455890  8539 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:55.457623 12758 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.458187 12758 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:55.461417  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:55.461781  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.463261 12804 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.463783 12804 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:55.465870 12804 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:55.467684  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.461339 12458 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:27:55.477233 12758 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:55.478322  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:55.479815  8361 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.480770 12804 raft_consensus.cc:493] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.481271 12804 raft_consensus.cc:515] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:55.484223  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.485055  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e2fa2b1330485fb8fbc9b08f54955b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:55.485831 12758 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:55.486136  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3594f197bee04c33b4ae361b87965bd6" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:55.488029  8361 leader_election.cc:304] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.488881  8362 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.490470 12758 raft_consensus.cc:2749] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:55.490546 12787 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:55.490442  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.503595  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:55.491039 12804 leader_election.cc:290] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:55.502307  8291 catalog_manager.cc:5697] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 9 to 11, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 11 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:55.516973  7261 tablet_replica.cc:333] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.528710  8291 catalog_manager.cc:5697] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 10 to 12, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 12 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:55.530967  7261 raft_consensus.cc:2243] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.539795  7261 raft_consensus.cc:2272] T 016be601898642f5bfd00376e81080bd P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:55.550496  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.569772  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.568969  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.580467  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.582293  7261 tablet_replica.cc:333] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
W20260709 12:27:55.581103  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.586103  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.587013  7261 raft_consensus.cc:2243] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.589008  7261 raft_consensus.cc:2272] T f7de1dd05702461da4c0319fda01a7ca P 21c151c99bcf4cbeb819de06e68d95bf [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.580128 12804 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.591988 12804 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:55.593612  7261 tablet_replica.cc:333] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.594097 12804 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:55.594451  7261 raft_consensus.cc:2243] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:55.602895  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.607148  7261 raft_consensus.cc:2272] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.609704  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaf1cdb4d1a4411f9717ef7b1d0b1b94" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:55.618250  9044 raft_consensus.cc:1275] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:27:55.606393 12804 raft_consensus.cc:493] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.629658  7261 tablet_replica.cc:333] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.630534  7261 raft_consensus.cc:2243] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.641326 12458 consensus_queue.cc:1048] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:55.642570  7261 raft_consensus.cc:2272] T 39e8dc02425a4fafb53164fd99fe0d0d P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.645797  8362 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.632642 12804 raft_consensus.cc:515] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:55.649209 12758 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:55.671352  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.704417 12758 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.704954 12758 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:55.706954 12758 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:55.708338  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.797050 12758 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.797645 12758 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:55.800278 12758 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:55.801815  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:55.804437  7261 tablet_replica.cc:333] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.804368 12758 raft_consensus.cc:493] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.805078 12758 raft_consensus.cc:515] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:55.805464  7261 raft_consensus.cc:2243] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.806318  7261 raft_consensus.cc:2272] T 80def59f123c433b90d8ddb5d7e620c6 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.807175 12758 leader_election.cc:290] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:55.808463  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:55.809407 12804 leader_election.cc:290] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:55.817245 12787 raft_consensus.cc:493] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:55.820982  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.849198 12787 raft_consensus.cc:515] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:55.851073  7261 tablet_replica.cc:333] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.829782  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:55.851732 12787 leader_election.cc:290] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:55.853068  8361 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.854387  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:27:55.854656  8438 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:55.855237  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.856010 12787 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:55.857563  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e353e593608d40f283a70e6dab6c4d3a" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:55.860503  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:55.863842  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ddabc2a2d42405c9f529c8489fdf71b" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:55.866603  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.867358  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.867849  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.870124  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f6deaf14d94befa991497fcc0de1f5" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:55.871608  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.874055  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7efab53f2634a5abbadd798832d128c" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
W20260709 12:27:55.874946  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:55.876863  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.876071  8362 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.877662 12804 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:55.880805  8362 leader_election.cc:304] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.881572 12804 raft_consensus.cc:2749] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:55.882875  8362 leader_election.cc:304] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:55.881613  7261 raft_consensus.cc:2243] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.883857 12804 raft_consensus.cc:2749] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:55.884835  7261 raft_consensus.cc:2272] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.888428  8362 leader_election.cc:304] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:55.889132 12804 raft_consensus.cc:2749] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:27:55.894186  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.894946  7261 tablet_replica.cc:333] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.895874  7261 raft_consensus.cc:2243] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.896445  7261 raft_consensus.cc:2272] T abbf9b71c617406c9d2be1cd987a6a94 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.899147  7261 tablet_replica.cc:333] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.899926  7261 raft_consensus.cc:2243] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.900496  7261 raft_consensus.cc:2272] T 158edb8122f9489398444d919f25cbce P 21c151c99bcf4cbeb819de06e68d95bf [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.910408  7261 tablet_replica.cc:333] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.911187  7261 raft_consensus.cc:2243] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.911778  7261 pending_rounds.cc:70] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:55.912001  7261 pending_rounds.cc:77] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 12 index: 7 } timestamp: 7305625852815831040 op_type: NO_OP noop_request { }
I20260709 12:27:55.912350  7261 raft_consensus.cc:2889] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:55.912683  7261 raft_consensus.cc:2272] T f27995e97dd24420a9a7efc50ed48941 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.915073  7261 tablet_replica.cc:333] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.915835  7261 raft_consensus.cc:2243] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.916333  7261 pending_rounds.cc:70] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:55.916568  7261 pending_rounds.cc:77] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 8 index: 6 } timestamp: 7305625816838262784 op_type: NO_OP noop_request { }
I20260709 12:27:55.916887  7261 raft_consensus.cc:2889] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:55.917198  7261 raft_consensus.cc:2272] T 225b79a42b074c48a583a96802a0f532 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.926354  7261 tablet_replica.cc:333] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:55.927110  7261 raft_consensus.cc:2243] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.927676  7261 pending_rounds.cc:70] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:55.927882  7261 pending_rounds.cc:77] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7305625843982729216 op_type: NO_OP noop_request { }
I20260709 12:27:55.928191  7261 raft_consensus.cc:2889] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:55.928500  7261 raft_consensus.cc:2272] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:55.935639  7261 tablet_replica.cc:333] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
W20260709 12:27:55.980628  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:55.982204  8294 catalog_manager.cc:5697] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 8 to 11, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 11 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:55.981496  7261 raft_consensus.cc:2243] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:55.988808  7261 raft_consensus.cc:2272] T ec5712a692fb47d3aaf9c8440b1a75a1 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:55.993228  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.003094  7261 tablet_replica.cc:333] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.004757  8294 catalog_manager.cc:5697] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 7 to 8, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.013304  7261 raft_consensus.cc:2243] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.022258  7261 raft_consensus.cc:2272] T d2e76be6a4cb43fdaee395073ab103da P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.042933  7261 tablet_replica.cc:333] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.023857  8294 catalog_manager.cc:5697] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.052382  7261 raft_consensus.cc:2243] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.053136  7261 raft_consensus.cc:2272] T c6fb68f59621452b8e81b4fbe2cda697 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.049604  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.060046  8294 catalog_manager.cc:5697] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.062229  8294 catalog_manager.cc:5697] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.072002  7261 tablet_replica.cc:333] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.072907  7261 raft_consensus.cc:2243] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.073495  7261 raft_consensus.cc:2272] T d12c64e413ad46968034a527b5290316 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.079026  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.099587  7261 tablet_replica.cc:333] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.100529  7261 raft_consensus.cc:2243] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.101487  7261 raft_consensus.cc:2272] T b9ce4c75067748ad84434b89f28725b0 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.104431  7261 tablet_replica.cc:333] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.105345  7261 raft_consensus.cc:2243] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.124516  7261 pending_rounds.cc:70] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:56.124802  7261 pending_rounds.cc:77] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 8 index: 5 } timestamp: 7305625696809410560 op_type: NO_OP noop_request { }
I20260709 12:27:56.125133  7261 raft_consensus.cc:2889] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:56.125475  7261 raft_consensus.cc:2272] T ea8ca6961a884db3b196c76ca97b049a P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.119948  8283 maintenance_manager.cc:643] P fda1d6ce844f48669763ced7af1542be: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 2.784s	user 0.150s	sys 0.039s Metrics: {"bytes_written":30503,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":26903,"dirs.run_cpu_time_us":377,"dirs.run_wall_time_us":917,"drs_written":1,"lbm_read_time_us":401,"lbm_reads_lt_1ms":4,"lbm_write_time_us":25616,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":15564,"threads_started":1,"update_count":31}
I20260709 12:27:56.121985  8291 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35652 (request call id 255) took 5664 ms. Trace:
I20260709 12:27:56.131074  8284 maintenance_manager.cc:419] P fda1d6ce844f48669763ced7af1542be: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10645 bytes on disk
I20260709 12:27:56.139132  8283 maintenance_manager.cc:643] P fda1d6ce844f48669763ced7af1542be: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":328,"lbm_reads_lt_1ms":4}
I20260709 12:27:56.132356  8294 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46076 (request call id 133) took 5105 ms. Trace:
I20260709 12:27:56.141088  8294 rpcz_store.cc:276] 0709 12:27:51.026813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:51.027082 (+   269us) service_pool.cc:224] Handling call
0709 12:27:51.210468 (+183386us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400210610. stack: 00007f646126a343 00007f646126a240 00007f6460bf91d4 00007f646a937304 00007f646a937299 00007f6461124db1 00007f6461264b71 00007f64612650b2 00007f646a1de759 00007f646a176a76 00007f646a147d58 00007f646a24604e 00007f64687072a4 00007f6468707232 00007f6468707161 00007f64687070dc
0709 12:27:56.132298 (+4921830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:56.090500 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:56.100983 (+ 10483us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:56.101017 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:27:56.101035 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:56.101671 (+   636us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:56.101732 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:56.101759 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:27:56.102303 (+   544us) tablet.cc:701] Row locks acquired
0709 12:27:56.102320 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:27:56.102456 (+   136us) write_op.cc:270] Start()
0709 12:27:56.102562 (+   106us) write_op.cc:276] Timestamp: P: 1783600076102416 usec, L: 0
0709 12:27:56.102581 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:27:56.103183 (+   602us) log.cc:844] Serialized 2039 byte log entry
0709 12:27:56.105350 (+  2167us) op_driver.cc:464] REPLICATION: finished
0709 12:27:56.105802 (+   452us) write_op.cc:301] APPLY: starting
0709 12:27:56.105882 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:56.109183 (+  3301us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:56.109274 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:56.112442 (+  3168us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:56.112625 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:27:56.112667 (+    42us) write_op.cc:312] APPLY: finished
0709 12:27:56.112894 (+   227us) log.cc:844] Serialized 57 byte log entry
0709 12:27:56.113588 (+   694us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:56.113681 (+    93us) write_op.cc:454] Released schema lock
0709 12:27:56.113732 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:56.117426 (+  3694us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:56.117453 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45003,"reported_tablets":18,"spinlock_wait_cycles":46939392,"child_traces":[["op",{"apply.queue_time_us":242,"apply.run_cpu_time_us":7641,"apply.run_wall_time_us":11566,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20890,"cfile_init":1,"lbm_read_time_us":373,"lbm_reads_lt_1ms":4,"num_ops":5,"prepare.queue_time_us":435,"prepare.run_cpu_time_us":3031,"prepare.run_wall_time_us":14771,"replication_time_us":2644}]]}
I20260709 12:27:56.129259  8291 rpcz_store.cc:276] 0709 12:27:50.457382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:50.457612 (+   230us) service_pool.cc:224] Handling call
0709 12:27:56.121924 (+5664312us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:55.811489 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:55.812076 (+   587us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:55.812114 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:27:55.812132 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:55.812794 (+   662us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:55.812864 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:55.812893 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:55.813303 (+   410us) tablet.cc:701] Row locks acquired
0709 12:27:55.813319 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:27:55.813445 (+   126us) write_op.cc:270] Start()
0709 12:27:55.813593 (+   148us) write_op.cc:276] Timestamp: P: 1783600075813407 usec, L: 0
0709 12:27:55.813623 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:27:55.814294 (+   671us) log.cc:844] Serialized 1667 byte log entry
0709 12:27:55.872340 (+ 58046us) op_driver.cc:464] REPLICATION: finished
0709 12:27:55.896256 (+ 23916us) write_op.cc:301] APPLY: starting
0709 12:27:55.896338 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:55.896750 (+   412us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:55.896846 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:55.941799 (+ 44953us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:55.941995 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=8
0709 12:27:55.942037 (+    42us) write_op.cc:312] APPLY: finished
0709 12:27:55.953888 (+ 11851us) log.cc:844] Serialized 65 byte log entry
0709 12:27:55.955864 (+  1976us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:55.955971 (+   107us) write_op.cc:454] Released schema lock
0709 12:27:55.956013 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:55.956394 (+   381us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:55.956419 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":678429,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":23656,"apply.run_cpu_time_us":8378,"apply.run_wall_time_us":60147,"cfile_cache_hit":6,"cfile_cache_hit_bytes":6267,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6216,"cfile_init":1,"lbm_read_time_us":10033,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":7,"num_ops":4,"prepare.queue_time_us":140571,"prepare.run_cpu_time_us":3152,"prepare.run_wall_time_us":101025,"replication_time_us":58559,"spinlock_wait_cycles":2432,"thread_start_us":121173,"threads_started":2}]]}
I20260709 12:27:56.154646 12804 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.155206 12804 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:56.156908  7261 tablet_replica.cc:333] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.157493 12804 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:56.157721  7261 raft_consensus.cc:2243] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.158322  7261 raft_consensus.cc:2272] T dabecae7023948069d48a04cefe25522 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.164459  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:56.176393  8293 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.177933  8293 catalog_manager.cc:5697] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 11 to 13, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 13 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.180804  8293 catalog_manager.cc:5697] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 3 to 5, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 5 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
W20260709 12:27:56.182760  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.208196  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d00e01c4bf4fa69c5d6648a287de68" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:56.208485  8293 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 11, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 11 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:56.210462  8293 catalog_manager.cc:5697] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 10, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.212236  8293 catalog_manager.cc:5697] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 10, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.217068  7261 tablet_replica.cc:333] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.217991  7261 raft_consensus.cc:2243] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.216418  8293 catalog_manager.cc:5697] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 9 to 13, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 13 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.218611  7261 raft_consensus.cc:2272] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.219851  8293 catalog_manager.cc:5697] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 9 to 13, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 13 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.221958  8293 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 12 to 15, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 15 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.224511  8293 catalog_manager.cc:5697] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.227759  8293 catalog_manager.cc:5697] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 10 to 14, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 14 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.230365  8293 catalog_manager.cc:5697] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 10, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 10 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.231873  8293 catalog_manager.cc:5697] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 9, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 9 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:56.233072  8293 catalog_manager.cc:5697] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 12, leader changed from aef8c9f023564378a04e3e1e6171930d (127.7.23.67) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 12 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:56.236845  8293 catalog_manager.cc:5697] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 10, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:56.238121  8293 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 6 to 9, leader changed from e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 9 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.240325  8293 catalog_manager.cc:5697] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.241938  8293 catalog_manager.cc:5697] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.243765  8293 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 11 to 12, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65). New cstate: current_term: 12 leader_uuid: "21c151c99bcf4cbeb819de06e68d95bf" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.245010  8293 catalog_manager.cc:5697] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 7 to 8, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } }
I20260709 12:27:56.256587 12300 raft_consensus.cc:493] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3660d999c0a41658a1f1dbe7cc90746)
I20260709 12:27:56.257187 12300 raft_consensus.cc:515] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:56.260089 12300 leader_election.cc:290] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:56.260460  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:56.263680  9044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9ce4c75067748ad84434b89f28725b0" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:56.265004  8436 leader_election.cc:304] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:56.265695 12829 raft_consensus.cc:2749] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:56.283218  7261 tablet_replica.cc:333] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.287426  7261 raft_consensus.cc:2243] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.288110  7261 raft_consensus.cc:2272] T e353e593608d40f283a70e6dab6c4d3a P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.290635  7261 tablet_replica.cc:333] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.295509  8362 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:56.312072 12804 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:27:56.312989  8362 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 82569.5us
I20260709 12:27:56.291338  7261 raft_consensus.cc:2243] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.332069  7261 raft_consensus.cc:2272] T 8974a3bbc8c3420f95c2b151405bd386 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.334702  7261 tablet_replica.cc:333] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.351699  7261 raft_consensus.cc:2243] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.353783 12804 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.360544  7261 raft_consensus.cc:2272] T 2a26f17e57344b8bba537d4b071c49be P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.362243  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.361433 12804 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:56.366022 12804 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:56.368759  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:56.370692  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5d246a744e484fa3414c038a792b99" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:56.366006  7261 tablet_replica.cc:333] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.380263  7261 raft_consensus.cc:2243] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.380816  7261 pending_rounds.cc:70] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 2 pending ops.
I20260709 12:27:56.381071  7261 pending_rounds.cc:77] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 10 index: 8 } timestamp: 7305625835956101120 op_type: NO_OP noop_request { }
I20260709 12:27:56.381407  7261 raft_consensus.cc:2889] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:56.381704  7261 pending_rounds.cc:77] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 9 index: 7 } timestamp: 7305625802718658560 op_type: NO_OP noop_request { }
I20260709 12:27:56.382019  7261 raft_consensus.cc:2889] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:56.382341  7261 raft_consensus.cc:2272] T dec3215185474277adc36392bd1a7eda P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.384858  7261 tablet_replica.cc:333] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.385574  7261 raft_consensus.cc:2243] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.386138  7261 raft_consensus.cc:2272] T 28f6deaf14d94befa991497fcc0de1f5 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.386857  8438 leader_election.cc:336] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:56.388726  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.399716  8362 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:56.400522 12804 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:27:56.412796  8294 catalog_manager.cc:5697] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 7 to 10, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 10 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.416492  8294 catalog_manager.cc:5697] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 7 to 11, VOTER 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) evicted. New cstate: current_term: 13 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:56.425849  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.446062  7261 tablet_replica.cc:333] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.453147  8468 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:56.456084  7261 raft_consensus.cc:2243] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.456703  7261 pending_rounds.cc:70] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:56.456931  7261 pending_rounds.cc:77] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 12 index: 11 } timestamp: 7305625876509618176 op_type: NO_OP noop_request { }
I20260709 12:27:56.457237  7261 raft_consensus.cc:2889] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:56.457535  7261 raft_consensus.cc:2272] T 15e2fa2b1330485fb8fbc9b08f54955b P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.476248  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.478461  7261 tablet_replica.cc:333] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.479321  7261 raft_consensus.cc:2243] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.479954  7261 raft_consensus.cc:2272] T 9a231323db194487a6ca917e91cb1389 P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.480690  8458 tablet_service.cc:1558] Processing DeleteTablet for tablet b9ce4c75067748ad84434b89f28725b0 with delete_type TABLET_DATA_TOMBSTONED (TS 2d99fb7f1afb4c958cdc302eb8ef165f not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:39212
I20260709 12:27:56.482694  7261 tablet_replica.cc:333] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.483469  7261 raft_consensus.cc:2243] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.484233  7261 raft_consensus.cc:2272] T 5164be0f063b4907aae5b6f874361ca3 P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:56.501238  8438 consensus_peers.cc:597] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.508917 12835 tablet_replica.cc:333] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
W20260709 12:27:56.512547  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:56.512791  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:56.516929  7261 tablet_replica.cc:333] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.517764  7261 raft_consensus.cc:2243] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.518453  7261 raft_consensus.cc:2272] T c9d00e01c4bf4fa69c5d6648a287de68 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.519361  9044 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:27:56.520937 12829 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:56.521898 12835 raft_consensus.cc:2243] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.522984 12835 raft_consensus.cc:2272] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.524324  8546 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:27:56.530382 12829 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:56.530752  7261 tablet_replica.cc:333] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.531806  7261 raft_consensus.cc:2243] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.532408  7261 raft_consensus.cc:2272] T 3594f197bee04c33b4ae361b87965bd6 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.565079  7261 tablet_replica.cc:333] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.565927  7261 raft_consensus.cc:2243] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.566854  7261 raft_consensus.cc:2272] T 046c03262b594a9c8af1b19c581fb4b6 P 21c151c99bcf4cbeb819de06e68d95bf [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.567759 12804 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.568303 12804 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:56.570427 12804 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:56.571342  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:56.576622  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "688c3b409a5a44acae5413866342b3c4" candidate_uuid: "21c151c99bcf4cbeb819de06e68d95bf" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:56.590164 12829 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Committing config change with OpId 8.10: config changed from index 7 to 10, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.593079  8362 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21c151c99bcf4cbeb819de06e68d95bf; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:56.594405 12804 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:56.597388  7261 tablet_replica.cc:333] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.598255  7261 raft_consensus.cc:2243] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:27:56.599224  7261 raft_consensus.cc:2272] T 0f58d6d40fe4445e95211f397d2e4e00 P 21c151c99bcf4cbeb819de06e68d95bf [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.598608  9048 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 7 to 10, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.600108 12835 ts_tablet_manager.cc:1916] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:56.602070  7261 tablet_replica.cc:333] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.601267  8546 raft_consensus.cc:2955] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Committing config change with OpId 8.10: config changed from index 7 to 10, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.602864  7261 raft_consensus.cc:2243] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.607542  7261 pending_rounds.cc:70] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:56.607805  7261 pending_rounds.cc:77] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 7 index: 5 } timestamp: 7305625770122665984 op_type: NO_OP noop_request { }
I20260709 12:27:56.608134  7261 raft_consensus.cc:2889] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:56.608464  7261 raft_consensus.cc:2272] T 04e64f31022343538635c1fde40fe9d0 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.610930  7261 tablet_replica.cc:333] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.613850  8291 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 7 to 10, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 8 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:56.633150  7261 raft_consensus.cc:2243] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.633834  7261 raft_consensus.cc:2272] T 78f588f9461a426ebd4a55bd3ade3583 P 21c151c99bcf4cbeb819de06e68d95bf [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.636413  7261 tablet_replica.cc:333] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.637145  7261 raft_consensus.cc:2243] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.637657  7261 raft_consensus.cc:2272] T 5899a880ee09417eb2739689c0d74579 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.639897  8281 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 046c03262b594a9c8af1b19c581fb4b6 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:56.657210  7261 tablet_replica.cc:333] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.658190  7261 raft_consensus.cc:2243] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.658782  7261 raft_consensus.cc:2272] T c7efab53f2634a5abbadd798832d128c P 21c151c99bcf4cbeb819de06e68d95bf [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.678575  7261 tablet_replica.cc:333] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.679332  7261 raft_consensus.cc:2243] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.679889  7261 pending_rounds.cc:70] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:56.680109  7261 pending_rounds.cc:77] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 10 index: 9 } timestamp: 7305625852769808384 op_type: NO_OP noop_request { }
I20260709 12:27:56.680430  7261 raft_consensus.cc:2889] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:56.680766  7261 raft_consensus.cc:2272] T 9ddabc2a2d42405c9f529c8489fdf71b P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.683604  7261 tablet_replica.cc:333] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.685883  7261 raft_consensus.cc:2243] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.686349  7261 pending_rounds.cc:70] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Trying to abort 1 pending ops.
I20260709 12:27:56.686568  7261 pending_rounds.cc:77] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf: Aborting op as it isn't in flight: id { term: 6 index: 5 } timestamp: 7305625886026727424 op_type: NO_OP noop_request { }
I20260709 12:27:56.687844  7261 raft_consensus.cc:2889] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:56.688174  7261 raft_consensus.cc:2272] T ea5d246a744e484fa3414c038a792b99 P 21c151c99bcf4cbeb819de06e68d95bf [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.690861  7261 tablet_replica.cc:333] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
I20260709 12:27:56.691967 12835 ts_tablet_manager.cc:1929] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.10
W20260709 12:27:56.693110  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 046c03262b594a9c8af1b19c581fb4b6: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 12:27:56.694533  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.691531  7261 raft_consensus.cc:2243] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.702924  7261 raft_consensus.cc:2272] T df155d204dc041d7b2ce5467f8825efd P 21c151c99bcf4cbeb819de06e68d95bf [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.702978 12835 log.cc:1199] T b9ce4c75067748ad84434b89f28725b0 P 2d99fb7f1afb4c958cdc302eb8ef165f: Deleting WAL directory at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/wals/b9ce4c75067748ad84434b89f28725b0
I20260709 12:27:56.704993  8281 catalog_manager.cc:5028] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): tablet b9ce4c75067748ad84434b89f28725b0 (table test-workload [id=b639b805973747cc8958558a0e295d8e]) successfully deleted
I20260709 12:27:56.706169  7261 tablet_replica.cc:333] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf: stopping tablet replica
W20260709 12:27:56.707041  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.709326  7261 raft_consensus.cc:2243] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:56.709944  7261 raft_consensus.cc:2272] T 688c3b409a5a44acae5413866342b3c4 P 21c151c99bcf4cbeb819de06e68d95bf [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:56.756438 12810 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:56.756992 12810 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:56.762069  9016 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.765528 12810 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:56.765717  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:56.767213  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:27:56.768265 12810 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:56.777107  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:56.811962  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:56.900278  8438 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:56.929661  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:56.937959 12300 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:56.938519 12300 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:56.940752 12300 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:56.942888  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:27:56.943569  9048 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 12.
W20260709 12:27:56.944453  8438 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:56.950464  8436 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:56.951675 12502 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:56.952041 12502 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:56.952454 12502 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.961292 12502 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:56.963364 12502 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:27:56.964349  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a180f2cda394b6eb7ca0ecbbc583c75" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:27:56.964947  9048 raft_consensus.cc:3060] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:56.971637  9048 raft_consensus.cc:2468] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d99fb7f1afb4c958cdc302eb8ef165f in term 13.
I20260709 12:27:56.982481  8436 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:27:56.983376 12502 raft_consensus.cc:2804] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:56.983913 12502 raft_consensus.cc:697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Becoming Leader. State: Replica: 2d99fb7f1afb4c958cdc302eb8ef165f, State: Running, Role: LEADER
I20260709 12:27:56.984810 12502 consensus_queue.cc:237] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:56.989923  8438 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:27:57.028393  8293 catalog_manager.cc:5697] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: term changed from 12 to 13, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66). New cstate: current_term: 13 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:57.030894  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.076347  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.274302  8438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111) [suppressed 371 similar messages]
W20260709 12:27:57.377594  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.448333  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.487509  9048 raft_consensus.cc:1275] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:57.488921 12300 consensus_queue.cc:1048] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:27:57.502626  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.523267  8438 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.623441  8464 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:57.659119  8539 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:27:57.661121  8436 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e78864d1ef6947eca56a20b30fc482a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.661396 12300 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:27:57.668402  8438 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.708405 12848 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:27:57.710296  8546 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:27:57.729991  8293 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index -1 to 7, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:27:57.737439  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.774211  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.825915  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.843444 12300 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:57.844039 12300 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:57.847687  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.847294  8546 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:57.851040 12300 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:27:57.852159  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:27:57.852851  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.860163  8438 leader_election.cc:336] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:27:57.861490  8438 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:27:57.862738 12300 raft_consensus.cc:2749] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:27:57.899122  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.900614  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:57.917934  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:57.930917  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.946717  8468 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:27:57.947527  8510 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d12c64e413ad46968034a527b5290316. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:57.948418 12852 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:57.949621  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:57.961606  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:57.962683  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.976585 12764 raft_consensus.cc:2955] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:27:57.978498  8464 raft_consensus.cc:2955] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index -1 to 8, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:27:57.991446  7261 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8418)
I20260709 12:27:57.996021 12814 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:57.996655 12814 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:57.998387  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:57.998811 12814 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:58.001418  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:58.002059  8468 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
W20260709 12:27:58.004890  8343 auto_rebalancer.cc:629] Failed to schedule move for tablet 5164be0f063b4907aae5b6f874361ca3: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:27:58.004585  8291 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 8, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:27:58.003334  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
I20260709 12:27:58.008111 12764 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:58.008490 12764 raft_consensus.cc:493] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:58.008816 12764 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:58.009013  8512 leader_election.cc:336] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:27:58.010316  8546 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:58.010713 12773 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:58.022912 12773 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:58.024026  8282 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 94561.9us
W20260709 12:27:58.026538  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 046c03262b594a9c8af1b19c581fb4b6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:27:58.029258  8438 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:27:58.031023  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:27:58.037010 12764 raft_consensus.cc:515] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:58.040323  8464 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5164be0f063b4907aae5b6f874361ca3" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:58.040867  8464 raft_consensus.cc:3060] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:58.042069 12814 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:58.042825 12764 leader_election.cc:290] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:58.042573 12814 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:58.043560  8512 leader_election.cc:336] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:27:58.044862 12814 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:58.046684  8468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" is_pre_election: true
I20260709 12:27:58.049589  8436 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:27:58.050045  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.050489  8512 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:27:58.047278  8468 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:27:58.054153  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:58.055541 12852 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:58.055930 12852 raft_consensus.cc:493] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 21c151c99bcf4cbeb819de06e68d95bf)
I20260709 12:27:58.056265 12852 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.058917  8464 raft_consensus.cc:2468] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 13.
I20260709 12:27:58.065186  8511 leader_election.cc:304] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf
I20260709 12:27:58.064759 12848 raft_consensus.cc:2749] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:58.067935 12773 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:58.079066  8510 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019): Couldn't send request to peer e3660d999c0a41658a1f1dbe7cc90746. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c9d00e01c4bf4fa69c5d6648a287de68. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:58.078317 12814 raft_consensus.cc:2804] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:58.089634 12814 raft_consensus.cc:697] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 13 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:58.090680 12814 consensus_queue.cc:237] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:58.103251  8464 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:27:58.105660 12764 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:27:58.117061  8291 catalog_manager.cc:5697] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 12 to 13, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 13 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.113269 12852 raft_consensus.cc:515] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:27:58.139976  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.141453 12852 leader_election.cc:290] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:58.142738  8469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f58d6d40fe4445e95211f397d2e4e00" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f"
I20260709 12:27:58.143322  8469 raft_consensus.cc:3060] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:58.144591 12866 raft_consensus.cc:2955] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:27:58.147078  8464 raft_consensus.cc:2955] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
I20260709 12:27:58.150105  8469 raft_consensus.cc:2468] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:27:58.151276  8511 leader_election.cc:304] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d; no voters: 
W20260709 12:27:58.151924  8438 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:58.152359 12864 raft_consensus.cc:2804] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:58.152879 12864 raft_consensus.cc:697] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:27:58.153657 12864 consensus_queue.cc:237] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:27:58.180060  8291 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index -1 to 7, NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) added. New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } } }
W20260709 12:27:58.196892  8436 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 109367us
W20260709 12:27:58.202672  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.203440  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:58.205894  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.206364  8512 leader_election.cc:336] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:27:58.216418  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.224412 12871 ts_tablet_manager.cc:933] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:27:58.233726 12871 tablet_copy_client.cc:323] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.66:41641
I20260709 12:27:58.235718  8482 tablet_copy_service.cc:140] P 2d99fb7f1afb4c958cdc302eb8ef165f: Received BeginTabletCopySession request for tablet e78864d1ef6947eca56a20b30fc482a6 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:59088)
I20260709 12:27:58.236328  8482 tablet_copy_service.cc:161] P 2d99fb7f1afb4c958cdc302eb8ef165f: Beginning new tablet copy session on tablet e78864d1ef6947eca56a20b30fc482a6 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:59088: session id = e3660d999c0a41658a1f1dbe7cc90746-e78864d1ef6947eca56a20b30fc482a6
I20260709 12:27:58.249800  8291 catalog_manager.cc:5697] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 11 to 12, leader changed from 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 12 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.253777  8482 tablet_copy_source_session.cc:215] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:27:58.254364  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.257540 12871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e78864d1ef6947eca56a20b30fc482a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:58.287760 12871 tablet_copy_client.cc:806] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:58.288394 12871 tablet_copy_client.cc:670] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:58.298470 12871 tablet_copy_client.cc:538] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:27:58.308398  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.315722 12871 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
W20260709 12:27:58.374339  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.408236 12871 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:58.409296 12871 tablet_bootstrap.cc:492] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:27:58.410068 12871 ts_tablet_manager.cc:1403] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.103s	user 0.027s	sys 0.011s
I20260709 12:27:58.417088 12871 raft_consensus.cc:359] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:58.417954 12871 raft_consensus.cc:740] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:27:58.418671 12871 consensus_queue.cc:260] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:58.422674 12871 ts_tablet_manager.cc:1434] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:27:58.426321  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.432134  8482 tablet_copy_service.cc:342] P 2d99fb7f1afb4c958cdc302eb8ef165f: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-e78864d1ef6947eca56a20b30fc482a6 received from {username='slave'} at 127.0.0.1:59088
I20260709 12:27:58.432631  8482 tablet_copy_service.cc:434] P 2d99fb7f1afb4c958cdc302eb8ef165f: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-e78864d1ef6947eca56a20b30fc482a6 on tablet e78864d1ef6947eca56a20b30fc482a6 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:58.455578 12871 ts_tablet_manager.cc:933] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:58.463107  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.465674  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.524654  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.572793  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.584036 12875 ts_tablet_manager.cc:933] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: Initiating tablet copy from peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:27:58.591889  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:58.602248 12875 tablet_copy_client.cc:323] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:27:58.611896 12871 tablet_copy_client.cc:323] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Beginning tablet copy session from remote peer at address 127.7.23.67:37713
I20260709 12:27:58.613873  8556 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet c9d00e01c4bf4fa69c5d6648a287de68 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:27:58.614441  8556 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet c9d00e01c4bf4fa69c5d6648a287de68 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-c9d00e01c4bf4fa69c5d6648a287de68
I20260709 12:27:58.619856  8555 tablet_copy_service.cc:140] P aef8c9f023564378a04e3e1e6171930d: Received BeginTabletCopySession request for tablet d12c64e413ad46968034a527b5290316 from peer e3660d999c0a41658a1f1dbe7cc90746 ({username='slave'} at 127.0.0.1:58406)
I20260709 12:27:58.620509  8555 tablet_copy_service.cc:161] P aef8c9f023564378a04e3e1e6171930d: Beginning new tablet copy session on tablet d12c64e413ad46968034a527b5290316 from peer e3660d999c0a41658a1f1dbe7cc90746 at {username='slave'} at 127.0.0.1:58406: session id = e3660d999c0a41658a1f1dbe7cc90746-d12c64e413ad46968034a527b5290316
W20260709 12:27:58.654934  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.660840  8464 raft_consensus.cc:1275] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:27:58.662410 12865 consensus_queue.cc:1048] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:27:58.684806  8555 tablet_copy_source_session.cc:215] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:58.704324  8469 raft_consensus.cc:1275] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:27:58.692231  8556 tablet_copy_source_session.cc:215] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:27:58.694373  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:58.714632  9048 raft_consensus.cc:1217] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
W20260709 12:27:58.746541  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 52205.5us
I20260709 12:27:58.727733 12864 consensus_queue.cc:1048] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:58.736931 12871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d00e01c4bf4fa69c5d6648a287de68. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:58.754943  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.761519  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.766093 12875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d12c64e413ad46968034a527b5290316. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:58.816759  8510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:37019, user_credentials={real_user=slave}} blocked reactor thread for 84854.7us
W20260709 12:27:58.819070  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 59208.3us
W20260709 12:27:58.829941  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.830526  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.842972  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:58.849175  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:58.894704 12871 tablet_copy_client.cc:806] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:58.895376 12871 tablet_copy_client.cc:670] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:58.936616 12871 tablet_copy_client.cc:538] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:58.950819 12871 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
W20260709 12:27:58.991937  7261 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8418)
I20260709 12:27:58.995528 12875 tablet_copy_client.cc:806] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:58.996150 12875 tablet_copy_client.cc:670] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Starting download of 1 WAL segments...
W20260709 12:27:59.004710  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:59.006501 12875 tablet_copy_client.cc:538] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:27:59.030059  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.031816 12875 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap starting.
W20260709 12:27:59.062048  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.126047 12773 raft_consensus.cc:1064] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:27:59.128758 12773 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:59.159819 12871 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:59.160801 12871 tablet_bootstrap.cc:492] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:27:59.161501 12871 ts_tablet_manager.cc:1403] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.211s	user 0.033s	sys 0.013s
W20260709 12:27:59.189438  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.196105 12871 raft_consensus.cc:359] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:59.196967 12871 raft_consensus.cc:740] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:27:59.197525 12871 consensus_queue.cc:260] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
W20260709 12:27:59.212550  8282 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 75972.5us
I20260709 12:27:59.214613 12871 ts_tablet_manager.cc:1434] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 12:27:59.218624  8555 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-c9d00e01c4bf4fa69c5d6648a287de68 received from {username='slave'} at 127.0.0.1:58406
I20260709 12:27:59.219084  8555 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-c9d00e01c4bf4fa69c5d6648a287de68 on tablet c9d00e01c4bf4fa69c5d6648a287de68 with peer e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:27:59.242144  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 046c03262b594a9c8af1b19c581fb4b6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:27:59.243866  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.245404  8546 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:27:59.246536  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.247315 12884 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:59.248766  8438 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:59.249492  9044 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEARNER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:27:59.254834 12773 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:27:59.258172  8438 consensus_peers.cc:597] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.299383 12773 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:59.322160  9044 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:59.332432  8546 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:59.356612  9048 raft_consensus.cc:1217] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
W20260709 12:27:59.373926  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:59.374763  8291 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f reported cstate change: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.399593 12875 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:59.403678 12875 tablet_bootstrap.cc:492] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: Bootstrap complete.
I20260709 12:27:59.408080 12875 ts_tablet_manager.cc:1403] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: Time spent bootstrapping tablet: real 0.377s	user 0.026s	sys 0.012s
I20260709 12:27:59.416725 12875 raft_consensus.cc:359] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:59.425496 12875 raft_consensus.cc:740] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Initialized, Role: LEARNER
I20260709 12:27:59.426206 12875 consensus_queue.cc:260] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: NON_VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: true } }
I20260709 12:27:59.430366 12875 ts_tablet_manager.cc:1434] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.003s
I20260709 12:27:59.436264  8555 tablet_copy_service.cc:342] P aef8c9f023564378a04e3e1e6171930d: Request end of tablet copy session e3660d999c0a41658a1f1dbe7cc90746-d12c64e413ad46968034a527b5290316 received from {username='slave'} at 127.0.0.1:58406
I20260709 12:27:59.436717  8555 tablet_copy_service.cc:434] P aef8c9f023564378a04e3e1e6171930d: ending tablet copy session e3660d999c0a41658a1f1dbe7cc90746-d12c64e413ad46968034a527b5290316 on tablet d12c64e413ad46968034a527b5290316 with peer e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:27:59.501366  8469 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:27:59.518271  8546 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:59.520900 12849 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:59.536007 12849 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:59.541208  8546 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:59.543339  9044 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Refusing update from remote peer 2d99fb7f1afb4c958cdc302eb8ef165f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:27:59.571925 12773 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:59.578209  9044 raft_consensus.cc:2955] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:27:59.613447  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:59.622311  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:59.638217  8291 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 8 to 9, VOTER 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65) evicted. New cstate: current_term: 11 leader_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:27:59.643294  8281 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e78864d1ef6947eca56a20b30fc482a6 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:59.686837  9044 raft_consensus.cc:1217] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.7->[10.8-10.8]   Dedup: 10.8->[]
W20260709 12:27:59.777714  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:59.815271  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:59.856917  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:59.980297 12883 raft_consensus.cc:1064] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
I20260709 12:27:59.982986 12883 consensus_queue.cc:237] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:27:59.992388  7261 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8418)
I20260709 12:28:00.016607  9048 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:00.026199 12880 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:28:00.047883  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.048241  8468 raft_consensus.cc:1275] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:28:00.073050 12880 consensus_queue.cc:1048] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:28:00.084895  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:00.107257 12880 raft_consensus.cc:2955] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:28:00.112556  9048 raft_consensus.cc:2955] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:28:00.120885  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:00.134840  8469 raft_consensus.cc:2955] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:28:00.182906  8294 catalog_manager.cc:5697] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: config changed from index 7 to 8, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:28:00.201296  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.220667  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.244172  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.258191  8438 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:00.310145 12814 raft_consensus.cc:1064] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: attempting to promote NON_VOTER e3660d999c0a41658a1f1dbe7cc90746 to VOTER
W20260709 12:28:00.315901  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e78864d1ef6947eca56a20b30fc482a6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:00.316396 12814 consensus_queue.cc:237] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:00.320398  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.324303  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:00.368242  9048 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEARNER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:00.370347 12883 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:28:00.371126  8469 raft_consensus.cc:1275] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:28:00.373216 12880 consensus_queue.cc:1048] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:28:00.378883  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:00.459718  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:00.470786 12900 raft_consensus.cc:2955] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:28:00.473825  8464 raft_consensus.cc:2955] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
W20260709 12:28:00.485760  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:00.488511  9048 raft_consensus.cc:2955] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } } }
I20260709 12:28:00.508455  8291 catalog_manager.cc:5697] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d reported cstate change: config changed from index 8 to 9, e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:00.513015  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.537791  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.540519  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.558740  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:00.656579  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.716707  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.729692  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.755385  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.757903  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.901547  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.968405  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.988049  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:00.991472  8438 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:00.992833  7261 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:00.995242  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.040824  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.196130  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:01.196923  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.259439  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.267580  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.258984  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.304190  8512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:38641, user_credentials={real_user=slave}} blocked reactor thread for 45203.5us
W20260709 12:28:01.317116  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.336215  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.347030  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 046c03262b594a9c8af1b19c581fb4b6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:01.369696  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.383607  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.400753  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:01.474989  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.495651  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:01.556396  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.596800  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.621605  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.622189  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.723376  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.783227  8438 consensus_peers.cc:597] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:01.951894  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:01.993419  7261 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:02.207346  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.235591  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:02.278947  9016 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111) [suppressed 523 similar messages]
W20260709 12:28:02.289919  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.290935  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.681880  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.700579  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:02.704413  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.704970  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.718801  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.722325  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:02.727690  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:02.736776  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.784502  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.802872  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.833413  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.857725  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.866523  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.964906  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:02.993902  7261 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:03.053439  8438 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:03.094354  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:03.117497  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.149490  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.150722  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.163231  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.217242  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.236683  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.302902  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.304347  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.352490  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.466893  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.494062  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.508071  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.605132  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.606094  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.642638  8438 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:03.665349  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:03.676337  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:03.810325  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.812242  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.868822  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.914721  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.916584  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:03.919936  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:03.994385  7261 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:04.011829  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.090930  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.133725  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.138595  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.164618  8438 consensus_peers.cc:597] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.225153  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:04.253695  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.273366  9015 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 48208.2us
W20260709 12:28:04.336858  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e78864d1ef6947eca56a20b30fc482a6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:04.449120  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.656638  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:04.733916  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:04.742311  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 93742us
W20260709 12:28:04.796525  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:04.912806  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:04.994886  7261 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:05.085040  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.142287  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:05.152397  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.171022  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.217275  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.263520  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.266795  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.278492  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.310792  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.332050  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.383205  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.437240  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.443956  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.518671  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.520316  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 046c03262b594a9c8af1b19c581fb4b6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:05.523350  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.544934  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.606357  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:05.639840  8438 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:05.674196  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:05.692452  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.884361  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.922374  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.933090  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.984911  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:05.985932  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:05.995365  7261 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:06.005348  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.011004  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.039882  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.092018  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.159653  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:06.203934  8438 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:06.306437  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.308899  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.387887  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:06.551601  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.607285  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.608621  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.614035  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.660702  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.673245  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.685482  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.698691  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.713732  8438 consensus_peers.cc:597] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.737066  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.796612  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.826601  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:06.969112  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:06.995817  7261 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:07.145397  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.255429  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.280175  9016 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111) [suppressed 503 similar messages]
W20260709 12:28:07.292198  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:07.408365  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:07.493513  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.532512  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.626312  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.718938  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.821856  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.825752  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:07.915300  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.930918  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.937490  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 49518.7us
W20260709 12:28:07.944015  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.962723  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:07.996315  7261 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:08.009399  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.037809  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.046065  8438 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:08.071331  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.071939  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.076905  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.133157  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:08.144891  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.231267  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:08.260018  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.274986  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.284967  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.318976  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.329998  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.449954  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.451722  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.463022  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.464216  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:08.474591  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.489148  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e78864d1ef6947eca56a20b30fc482a6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:08.547919  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 51129.1us
W20260709 12:28:08.571367  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:08.797057  8438 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:08.805588  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.860841  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.885310  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.914077  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.980873  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:08.996811  7261 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:09.023188  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.077335  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.138015  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.212407  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.214392  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.240000  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:09.245540  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.282261  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.394209  8438 consensus_peers.cc:597] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.454720  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.567574  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.568375  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.751334  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:09.791450  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:09.798067  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.816841  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.969075  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.983532  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:09.997272  7261 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 8418)
W20260709 12:28:10.004127  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.282956  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.290153  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:10.349967  8438 consensus_peers.cc:597] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.505355  8438 consensus_peers.cc:597] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.506309  8438 consensus_peers.cc:597] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.514222  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.515974  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.521344  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.560065  8438 consensus_peers.cc:597] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.579706  8438 consensus_peers.cc:597] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.580164  8438 consensus_peers.cc:597] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.590437  8438 consensus_peers.cc:597] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.611620  8438 consensus_peers.cc:597] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:10.636451  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:28:10.695298  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:10.728672  8438 consensus_peers.cc:597] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.738843  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.755892  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.850986  8438 consensus_peers.cc:597] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.919422  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:10.969142  8438 consensus_peers.cc:597] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.039947  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.046939  8438 consensus_peers.cc:597] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:11.074091  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:11.100250  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:11.170499  8438 consensus_peers.cc:597] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.251834  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:28:11.260598  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
W20260709 12:28:11.314829  9014 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:37713, user_credentials={real_user=slave}} blocked reactor thread for 51265.4us
W20260709 12:28:11.356580  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.368222  8438 consensus_peers.cc:597] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.407775  8438 consensus_peers.cc:597] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.458021  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.549132  8438 consensus_peers.cc:597] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.627866  8438 consensus_peers.cc:597] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.631335  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:11.674928  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:11.679158  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
W20260709 12:28:11.701449  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.702042  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.731673  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.731876  9015 consensus_peers.cc:597] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:11.732569  8511 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:11.746393  8511 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:11.770169  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.777992  8438 consensus_peers.cc:597] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.791435  8511 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:11.794255  8438 consensus_peers.cc:597] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.827364  9015 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:11.866132  8438 consensus_peers.cc:597] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:11.877324  8511 consensus_peers.cc:597] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:11.892872  8511 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:11.933909  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:11.936720  7261 tablet_replica.cc:333] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:11.937815  7261 raft_consensus.cc:2243] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:11.939901  7261 raft_consensus.cc:2272] T a5fade2bf4064a129c23d8bb05ce09c7 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:11.952301  7261 tablet_replica.cc:333] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:11.953161  7261 raft_consensus.cc:2243] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:11.953823  7261 raft_consensus.cc:2272] T 9d18f5c816314559a3727b41a178ee5c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:11.959264  8511 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:11.969731  7261 tablet_replica.cc:333] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:11.978435  7261 raft_consensus.cc:2243] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:11.979377  7261 raft_consensus.cc:2272] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:11.987376  8511 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:11.990847  7261 tablet_replica.cc:333] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:11.993760  7261 raft_consensus.cc:2243] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Raft consensus shutting down.
W20260709 12:28:11.994526  9015 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.003490  8511 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.004631  7261 raft_consensus.cc:2272] T 268ce46c10234969b0ee35600bf0a70d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.007557  7261 tablet_replica.cc:333] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
W20260709 12:28:12.013461  8511 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.024668  9015 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.030330  9015 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.030946  7261 raft_consensus.cc:2243] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:28:12.052603  8511 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.053362  8511 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.065184  8511 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.066018  8511 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.066874  7261 raft_consensus.cc:2272] T 1f4ad78594dd4320b4c04e2f4e775e85 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.074235  7261 tablet_replica.cc:333] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.077282  7261 raft_consensus.cc:2243] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.079440  7261 raft_consensus.cc:2272] T 2310aee96e77479c812917bfcb775d66 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.099810  8511 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.109304  7261 tablet_replica.cc:333] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.115949  7261 raft_consensus.cc:2243] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.117123  7261 raft_consensus.cc:2272] T 73c51b6166884e0287dbdff730d29a1f P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.120086  7261 tablet_replica.cc:333] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.130306  7261 raft_consensus.cc:2243] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.138873  7261 raft_consensus.cc:2272] T 605e001ede544f519292071c2eeb41fb P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.141469  7261 tablet_replica.cc:333] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.148619  7261 raft_consensus.cc:2243] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:28:12.152175  8511 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.160727  8511 consensus_peers.cc:597] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.163785  8511 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.168354  7261 raft_consensus.cc:2272] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.177868  7261 tablet_replica.cc:333] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.194376  7261 raft_consensus.cc:2243] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:28:12.194994  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:12.196921  9015 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.199119  7261 raft_consensus.cc:2272] T ec5712a692fb47d3aaf9c8440b1a75a1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.202009  7261 tablet_replica.cc:333] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.203927  7261 raft_consensus.cc:2243] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Raft consensus shutting down.
W20260709 12:28:12.204438  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:28:12.208736  7261 raft_consensus.cc:2272] T 225b79a42b074c48a583a96802a0f532 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.232069  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:12.232748  7261 tablet_replica.cc:333] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.235225  7261 raft_consensus.cc:2243] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.236018  7261 raft_consensus.cc:2272] T 2219cc30a0424600b771d733ba9974e1 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.248399  7261 tablet_replica.cc:333] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.249421  7261 raft_consensus.cc:2243] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.250721  7261 raft_consensus.cc:2272] T e78864d1ef6947eca56a20b30fc482a6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.253545  7261 tablet_replica.cc:333] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.254357  7261 raft_consensus.cc:2243] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.255754  7261 raft_consensus.cc:2272] T 3d674c56f11d4d76a575c52d1a0e66bd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.281360  8512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111) [suppressed 537 similar messages]
I20260709 12:28:12.287218  7261 tablet_replica.cc:333] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.288651  7261 raft_consensus.cc:2243] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.292958  7261 raft_consensus.cc:2272] T bf567c52be7141c5b7edac250f385cc4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.300369  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:28:12.302455  7261 tablet_replica.cc:333] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.310909  7261 raft_consensus.cc:2243] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.313397  7261 raft_consensus.cc:2272] T 6a180f2cda394b6eb7ca0ecbbc583c75 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.316154  7261 tablet_replica.cc:333] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.317028  7261 raft_consensus.cc:2243] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.317659  7261 raft_consensus.cc:2272] T f7de1dd05702461da4c0319fda01a7ca P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.320206  7261 tablet_replica.cc:333] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.325939  7261 raft_consensus.cc:2243] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.326639  7261 raft_consensus.cc:2272] T 80def59f123c433b90d8ddb5d7e620c6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.329365  7261 tablet_replica.cc:333] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.336609  7261 raft_consensus.cc:2243] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.339526  7261 raft_consensus.cc:2272] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.360484  7261 tablet_replica.cc:333] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.363550  7261 raft_consensus.cc:2243] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.370599  7261 raft_consensus.cc:2272] T 158edb8122f9489398444d919f25cbce P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.375243  8438 consensus_peers.cc:597] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:12.371236  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:12.384747  7261 tablet_replica.cc:333] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.403228  7261 raft_consensus.cc:2243] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.418185  7261 raft_consensus.cc:2272] T 39e8dc02425a4fafb53164fd99fe0d0d P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.421000  7261 tablet_replica.cc:333] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.421821  7261 raft_consensus.cc:2243] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.422415  7261 raft_consensus.cc:2272] T 88ee35c47e0d403393cb03f68a432b98 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.439074  7261 tablet_replica.cc:333] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.439939  7261 raft_consensus.cc:2243] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.441164  7261 raft_consensus.cc:2272] T f27995e97dd24420a9a7efc50ed48941 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.443604  7261 tablet_replica.cc:333] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.454083  7261 raft_consensus.cc:2243] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.454766  7261 raft_consensus.cc:2272] T d2e76be6a4cb43fdaee395073ab103da P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.459323  7261 tablet_replica.cc:333] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.467988  7261 raft_consensus.cc:2243] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.468560  7261 raft_consensus.cc:2272] T c6fb68f59621452b8e81b4fbe2cda697 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.471000  7261 tablet_replica.cc:333] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.471764  7261 raft_consensus.cc:2243] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.472538  7261 raft_consensus.cc:2272] T 5164be0f063b4907aae5b6f874361ca3 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.491679  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:12.491796  8438 consensus_peers.cc:597] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:28:12.475121  7261 tablet_replica.cc:333] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.504396  7261 raft_consensus.cc:2243] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.508421  7261 raft_consensus.cc:2272] T 28f6deaf14d94befa991497fcc0de1f5 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.511384  7261 tablet_replica.cc:333] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.512152  7261 raft_consensus.cc:2243] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.521175  7261 raft_consensus.cc:2272] T 7ae3eef998ef416f8ebd3e8c21b20834 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.534049  7261 tablet_replica.cc:333] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.537462  7261 raft_consensus.cc:2243] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.538585  7261 raft_consensus.cc:2272] T dec3215185474277adc36392bd1a7eda P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.541409  7261 tablet_replica.cc:333] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.542129  7261 raft_consensus.cc:2243] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.543576  7261 raft_consensus.cc:2272] T 9a231323db194487a6ca917e91cb1389 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.559643  7261 tablet_replica.cc:333] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.560468  7261 raft_consensus.cc:2243] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:12.565078  8438 consensus_peers.cc:597] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:12.609207  7261 raft_consensus.cc:2272] T 9ddabc2a2d42405c9f529c8489fdf71b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.634045  7261 tablet_replica.cc:333] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.634977  7261 raft_consensus.cc:2243] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.642165  7261 raft_consensus.cc:2272] T ea5d246a744e484fa3414c038a792b99 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.656370  7261 tablet_replica.cc:333] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
W20260709 12:28:12.680838  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:12.682339  7261 raft_consensus.cc:2243] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.686707  7261 raft_consensus.cc:2272] T d12c64e413ad46968034a527b5290316 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.702082  7261 tablet_replica.cc:333] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.712154  7261 raft_consensus.cc:2243] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.715472  7261 raft_consensus.cc:2272] T ea8ca6961a884db3b196c76ca97b049a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.723708  7261 tablet_replica.cc:333] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.724568  7261 raft_consensus.cc:2243] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.725759  7261 raft_consensus.cc:2272] T dabecae7023948069d48a04cefe25522 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.732995  7261 tablet_replica.cc:333] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.734647  7261 raft_consensus.cc:2243] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.737648  7261 raft_consensus.cc:2272] T e353e593608d40f283a70e6dab6c4d3a P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.743335  7261 tablet_replica.cc:333] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.744182  7261 raft_consensus.cc:2243] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.759871 12940 raft_consensus.cc:493] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:12.763679 12940 raft_consensus.cc:515] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:28:12.770403  8438 leader_election.cc:336] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:12.772481 12940 leader_election.cc:290] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:12.772779  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5899a880ee09417eb2739689c0d74579" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:12.774924  8436 leader_election.cc:304] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:12.777108 12956 raft_consensus.cc:2749] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:12.780669  7261 raft_consensus.cc:2272] T d3541cfbddb54a3dbef569666e60ffb4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.785457  7261 tablet_replica.cc:333] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.789628  7261 raft_consensus.cc:2243] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.790614  7261 raft_consensus.cc:2272] T c9d00e01c4bf4fa69c5d6648a287de68 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.793125  7261 tablet_replica.cc:333] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.803879  7261 raft_consensus.cc:2243] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.820678  7261 raft_consensus.cc:2272] T 688c3b409a5a44acae5413866342b3c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.823348  7261 tablet_replica.cc:333] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.826581  7261 raft_consensus.cc:2243] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.835644  7261 raft_consensus.cc:2272] T 3594f197bee04c33b4ae361b87965bd6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.839882  7261 tablet_replica.cc:333] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.841614  7261 raft_consensus.cc:2243] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.842790  7261 raft_consensus.cc:2272] T fea9eaca8b50473cb6788b0928b3f8c4 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.846715  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:12.854142  7261 tablet_replica.cc:333] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.855019  7261 raft_consensus.cc:2243] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.856664  7261 raft_consensus.cc:2272] T 5899a880ee09417eb2739689c0d74579 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.860302  7261 tablet_replica.cc:333] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.872052  7261 raft_consensus.cc:2243] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.873203  7261 raft_consensus.cc:2272] T c7efab53f2634a5abbadd798832d128c P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.875813  7261 tablet_replica.cc:333] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.877625  7261 raft_consensus.cc:2243] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.881001  7261 raft_consensus.cc:2272] T 145eb7997c78480db629215c6acac8ef P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.891814  7261 tablet_replica.cc:333] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.892609  7261 raft_consensus.cc:2243] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.893905  7261 raft_consensus.cc:2272] T f2739228b32f48d7a73d1704fa1bfe5b P 2d99fb7f1afb4c958cdc302eb8ef165f [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.905121  7261 tablet_replica.cc:333] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.905910  7261 raft_consensus.cc:2243] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.907456  7261 raft_consensus.cc:2272] T df155d204dc041d7b2ce5467f8825efd P 2d99fb7f1afb4c958cdc302eb8ef165f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.914973  7261 tablet_replica.cc:333] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.915836  7261 raft_consensus.cc:2243] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.916930  7261 raft_consensus.cc:2272] T 046c03262b594a9c8af1b19c581fb4b6 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.930395  7261 tablet_replica.cc:333] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.932168  7261 raft_consensus.cc:2243] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.932873  7261 raft_consensus.cc:2272] T 0f58d6d40fe4445e95211f397d2e4e00 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.935708 12940 raft_consensus.cc:493] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:12.936154 12940 raft_consensus.cc:515] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:12.937964 12940 leader_election.cc:290] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:12.941263  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bfca2ec0c4f47349d091a6486b08139" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:28:12.945962  8438 leader_election.cc:336] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:12.946355  8438 leader_election.cc:304] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:12.951609 12940 raft_consensus.cc:2749] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:12.963523  7261 tablet_replica.cc:333] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.964376  7261 raft_consensus.cc:2243] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.965626  7261 raft_consensus.cc:2272] T 04e64f31022343538635c1fde40fe9d0 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.968302  7261 tablet_replica.cc:333] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:12.975503  7261 raft_consensus.cc:2243] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.978668  7261 raft_consensus.cc:2272] T 78f588f9461a426ebd4a55bd3ade3583 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.983055 12940 raft_consensus.cc:493] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:12.983560 12940 raft_consensus.cc:515] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:12.985435 12940 leader_election.cc:290] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:12.989449  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aeb63cbffbd24922b72419df5ee40899" candidate_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
W20260709 12:28:12.992666  8438 leader_election.cc:336] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:12.993055  8438 leader_election.cc:304] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2d99fb7f1afb4c958cdc302eb8ef165f; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:12.994148 12940 raft_consensus.cc:2749] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:28:13.000103  7261 tablet_replica.cc:333] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:13.000953  7261 raft_consensus.cc:2243] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:13.001735  7261 raft_consensus.cc:2272] T 2bfca2ec0c4f47349d091a6486b08139 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:13.006289  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:13.006433  7261 tablet_replica.cc:333] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f: stopping tablet replica
I20260709 12:28:13.010605  7261 raft_consensus.cc:2243] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:13.011292  7261 raft_consensus.cc:2272] T aeb63cbffbd24922b72419df5ee40899 P 2d99fb7f1afb4c958cdc302eb8ef165f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:13.061278 12959 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.061832 12959 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:28:13.069142  8511 leader_election.cc:336] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:28:13.076134  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:13.076968 12959 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.079875  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:13.080298  8512 leader_election.cc:336] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.080660  8512 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.089718 12967 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:13.092136  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:13.110788 12959 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.111349 12959 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.113435 12959 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.117779  8511 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:28:13.118525  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:28:13.122351  8512 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.122763  8512 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.123432 12959 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:13.183910  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:13.192420 12967 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.193027 12967 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:28:13.200688  8511 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:28:13.195245 12967 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.201643  8512 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.202051  8512 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.203895 12967 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:13.259366 12967 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.259896 12967 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.261860 12967 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.266232  8511 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:13.276612  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:13.277099  8512 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.277482  8512 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.278659 12959 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:13.306634 12959 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.307178 12959 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.309378 12959 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.314268  8512 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:13.319851  8511 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.320271  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.321367 12959 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:13.353395 12959 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.353957 12959 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:13.357460 12959 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:13.358667  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:28:13.362898  8511 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.363294  8511 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:28:13.364095 12959 raft_consensus.cc:2749] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:13.405851 12959 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.406423 12959 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:13.410513  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:28:13.418681  8512 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.419077 12959 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:13.419132  8512 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:28:13.420594  8511 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.423269 12967 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:13.423460 12959 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.424166 12959 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:28:13.430064  8512 leader_election.cc:336] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.434508 12959 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.440250  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:13.448051  8511 leader_election.cc:336] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.448524  8511 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.449193 12953 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:13.473047  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:13.484809  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:13.493863 12969 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.494472 12969 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:13.496622 12969 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.500720  9015 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.523613 12962 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.524190 12962 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:13.526520 12962 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:13.534471  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:13.535110  8540 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 11.
W20260709 12:28:13.540933  9015 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.543660  9014 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.544909 12962 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:13.545339 12962 raft_consensus.cc:493] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.550119 12962 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:13.561280 12953 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.561834 12953 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.564000 12953 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.580703  8512 leader_election.cc:336] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:13.586571  8511 leader_election.cc:336] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.587448  8511 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.588392 12953 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:13.588608 12962 raft_consensus.cc:515] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:13.593349 12962 leader_election.cc:290] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:13.598240  9015 leader_election.cc:336] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.601788  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e78864d1ef6947eca56a20b30fc482a6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:28:13.602385  8540 raft_consensus.cc:3060] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:28:13.616976  8540 raft_consensus.cc:2468] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 12.
I20260709 12:28:13.619814  9014 leader_election.cc:304] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.620886 12962 raft_consensus.cc:2804] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:13.621644 12962 raft_consensus.cc:697] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:28:13.622661 12962 consensus_queue.cc:237] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:13.626118  9016 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.626585  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.628024 12969 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:13.639341 12953 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.639991 12953 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.642244 12953 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:13.644372  8293 catalog_manager.cc:5697] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 11 to 12, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 12 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:13.655360  8511 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.656019 12953 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.657226 12953 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.660171 12953 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.677425  8512 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.678632  8512 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.681875 12953 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:13.684945  8511 leader_election.cc:336] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:13.687753  8512 leader_election.cc:336] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.688215  8512 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.688910 12953 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:13.689716 12953 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.690145 12953 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.692070 12953 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.699931  8511 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:13.704777 12953 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.705418 12953 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.707769 12953 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:13.714437  8512 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.723096  8512 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.730954 12953 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:13.724965  8511 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:13.736363  8512 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.736850  8512 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.739791 12953 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:13.743728 12953 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:13.746073 12953 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:13.749445 12953 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:28:13.760215  8511 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:13.765108  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:13.769198  8512 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:13.769598  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:13.770283 12953 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:13.877091  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 046c03262b594a9c8af1b19c581fb4b6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.091446 12959 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.092155 12959 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.094405 12959 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:14.094933 12959 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.095367 12959 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.113751 12959 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:14.267421  7261 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8493)
I20260709 12:28:14.283324 12959 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.283943 12959 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.286101 12959 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:14.470923 12959 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.471561 12959 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.473865 12959 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:28:14.530285  8512 leader_election.cc:336] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:14.532692  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:14.534734  8512 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:14.535239  8512 leader_election.cc:336] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.547150 12959 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.549127 12959 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.551657 12959 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:14.556377 12981 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.556958 12981 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.559604 12981 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.562170 12981 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.562639 12981 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:14.565689  8512 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.566435 12981 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.581203 12971 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.581748 12971 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.584159 12983 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.584676 12971 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.584679 12983 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.589251 12983 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.597164 12979 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.597709 12979 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.604182 12979 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:14.605695  8512 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.606505 12950 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.607017 12950 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.608933 12950 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:14.609514 12959 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.610049 12959 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.611995 12959 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:14.610327 12986 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.612697 12986 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.613515 12950 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.614899 12967 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.617072 12967 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:14.620277  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:14.620810  8512 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.624115 12967 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:14.625533  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:14.620760 12950 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.626170  8537 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 8.
I20260709 12:28:14.626438 12980 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.626883 12980 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.627573  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:14.627825 12950 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:14.628132  8537 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 15.
I20260709 12:28:14.628793 12980 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:14.629577  8537 raft_consensus.cc:1275] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:28:14.631031 12981 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.631426 12983 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.631562 12981 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.631933 12983 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.632863 12980 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.633352 12980 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.636260  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:14.636636 12971 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.636889  8537 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
I20260709 12:28:14.636840 12980 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:14.637259 12971 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.638397  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:14.638990  8537 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 9.
I20260709 12:28:14.633785 12986 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:14.634974 12981 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.635219 12983 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:14.640466 12971 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.642298  8539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:14.642871  8539 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
I20260709 12:28:14.647822  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:14.648463  8538 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
I20260709 12:28:14.659601  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:28:14.660272  9046 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 8.
I20260709 12:28:14.664995  9014 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:14.665839  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:14.666285  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:28:14.666906  9048 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:28:14.667347 12982 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:28:14.666904  9014 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:14.667876 12982 raft_consensus.cc:493] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.667573 12981 consensus_queue.cc:1048] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:28:14.667093 12971 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:28:14.670413  8511 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.668458 12983 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:14.668581  9014 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:14.670634 12982 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.671799 12983 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.672259 12983 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:14.672595 12984 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:14.672959 12984 raft_consensus.cc:493] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.673301 12984 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:14.670837 12971 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.674531 12971 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:14.678990  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
W20260709 12:28:14.660372  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:14.680198  9049 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:28:14.680524  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:28:14.682359 12984 raft_consensus.cc:515] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.683588  9046 raft_consensus.cc:2393] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 10: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:28:14.683615  9049 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 13.
I20260709 12:28:14.683815  8510 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:14.684717 12986 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:28:14.685037 12986 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.685416 12986 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:28:14.686170 12971 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.688434 12984 leader_election.cc:290] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:14.690606  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:14.691068  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:14.691434  8512 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:14.691864  8512 leader_election.cc:336] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.692263 12986 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:14.692977  9016 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:14.693562  9016 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.688108 12983 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.696121 12986 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:14.671301  8511 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:28:14.697085  8511 leader_election.cc:336] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.697311 12980 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:14.697556  8511 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.698383 12980 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:14.698485  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:28:14.698647  8511 leader_election.cc:336] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.699297 12950 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:28:14.699249  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.699729 12950 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.700464 12950 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:28:14.700404 12982 raft_consensus.cc:515] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:14.692263  8512 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.702466 12983 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.703685  9048 raft_consensus.cc:2393] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 16: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:28:14.707561 12980 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:14.709486 12950 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:14.709903  9016 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:14.710479  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:14.701445  8511 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.711880  8511 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.712284  8511 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.712698 12950 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:14.713248 12950 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:14.715260 12971 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:14.713303  8511 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:14.716729  8511 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.717108  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.717765 12986 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:28:14.718729  8511 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.719082  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.719722 12986 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:14.720516  8511 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.721163  8511 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:14.726707  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:28:14.727399  8537 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 11: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:28:14.728798  8537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:28:14.729027  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2739228b32f48d7a73d1704fa1bfe5b" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:28:14.729471  8537 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3660d999c0a41658a1f1dbe7cc90746 in current term 9: Already voted for candidate aef8c9f023564378a04e3e1e6171930d in this term.
I20260709 12:28:14.729735  8540 raft_consensus.cc:3060] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:14.734488  8511 leader_election.cc:336] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.734979  8511 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.735291  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.736013 12986 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:14.736987  8511 leader_election.cc:336] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.737358  8511 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.737983 12986 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:14.739074  8540 raft_consensus.cc:2468] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 10.
W20260709 12:28:14.739239  8511 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.740836  8511 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.741503 12986 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:14.741460  8511 leader_election.cc:336] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.744839  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:28:14.745599  9014 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:14.745573  9048 raft_consensus.cc:2393] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 9: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
I20260709 12:28:14.746451 12971 raft_consensus.cc:2804] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:14.746937 12971 raft_consensus.cc:697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:28:14.747776 12971 consensus_queue.cc:237] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:14.751523  8510 leader_election.cc:304] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:28:14.751693  8511 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.752641  8510 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
W20260709 12:28:14.752143  8511 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.753683 12950 raft_consensus.cc:2749] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:14.754376 12950 raft_consensus.cc:3060] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:28:14.759852  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:28:14.760941  9046 raft_consensus.cc:2393] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate aef8c9f023564378a04e3e1e6171930d in current term 11: Already voted for candidate e3660d999c0a41658a1f1dbe7cc90746 in this term.
W20260709 12:28:14.761900  9015 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:14.762542  9015 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.767071  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:28:14.768858  9015 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.769258  9015 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.769994 12984 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:14.770727 12984 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:28:14.766561 12950 raft_consensus.cc:2749] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:28:14.770151  9015 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.778015  9015 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:28:14.779141  9015 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:14.779553  9015 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.780366  9015 consensus_peers.cc:597] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:14.780800  9015 leader_election.cc:336] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.779512 12982 leader_election.cc:290] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:14.782366  8538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fea9eaca8b50473cb6788b0928b3f8c4" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d"
I20260709 12:28:14.783169  8293 catalog_manager.cc:5697] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 9 to 10, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 10 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:28:14.782335  9015 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.782752 12990 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:14.787758  9015 leader_election.cc:336] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.790169  8510 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:28:14.790904 12950 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:28:14.792399  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, e3660d999c0a41658a1f1dbe7cc90746
I20260709 12:28:14.793105 12950 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:28:14.793283  8538 raft_consensus.cc:2468] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 16.
I20260709 12:28:14.795709  9014 leader_election.cc:304] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
W20260709 12:28:14.796020  9015 leader_election.cc:336] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:14.796489 12982 raft_consensus.cc:2804] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:28:14.803891 12982 raft_consensus.cc:697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 16 LEADER]: Becoming Leader. State: Replica: e3660d999c0a41658a1f1dbe7cc90746, State: Running, Role: LEADER
I20260709 12:28:14.804791 12982 consensus_queue.cc:237] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:14.796860  9015 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.799714  8326 debug-util.cc:398] Leaking SignalData structure 0x7b08003b0400 after lost signal to thread 7264
I20260709 12:28:14.806470  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:14.807243 12990 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:28:14.808591  8326 debug-util.cc:398] Leaking SignalData structure 0x7b0800034820 after lost signal to thread 8329
W20260709 12:28:14.809901  8326 debug-util.cc:398] Leaking SignalData structure 0x7b08003972a0 after lost signal to thread 8570
W20260709 12:28:14.810626  9015 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.811105  8326 debug-util.cc:398] Leaking SignalData structure 0x7b08000ccca0 after lost signal to thread 9074
I20260709 12:28:14.811134  9015 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:14.816161 12990 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:28:14.816358  9015 leader_election.cc:336] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.822656  8511 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:14.852442 12950 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.853024 12950 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.855028 12950 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:14.863471  8511 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:14.864157  8512 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:14.864555  8512 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:14.866060  8293 catalog_manager.cc:5697] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 reported cstate change: term changed from 15 to 16, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68). New cstate: current_term: 16 leader_uuid: "e3660d999c0a41658a1f1dbe7cc90746" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:28:14.869557 12950 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:14.969554  9015 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:14.982935  9015 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:14.991940 12950 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:14.992533 12950 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:14.994719 12950 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.004454  8511 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:15.005189  8512 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:15.005594  8512 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.006654 12950 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:15.027606 12979 raft_consensus.cc:493] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.028110 12979 raft_consensus.cc:515] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.030333 12979 leader_election.cc:290] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.033361  8511 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.041972  8512 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:15.044642  8511 leader_election.cc:336] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.045043  8511 leader_election.cc:304] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.046610 12959 raft_consensus.cc:2749] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:15.055184  8511 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.055640  8511 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.056247  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:15.059516  8511 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.065088  8511 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.083428  8511 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.085846  8511 consensus_peers.cc:597] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.092917  9015 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.096124  8511 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:15.100232 12950 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.100732 12950 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.102810 12950 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.107254  8511 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.108664  8512 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:15.110540  8511 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.110939  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.112018 12950 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:15.124974  8511 consensus_peers.cc:597] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.133446  9015 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:15.144318  8538 raft_consensus.cc:1275] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:28:15.146490 12982 consensus_queue.cc:1048] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:28:15.150261  8511 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.177999  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:15.193531  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.194593  8511 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.212925  8511 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:15.220016 12950 raft_consensus.cc:493] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.220750 12950 raft_consensus.cc:515] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.222875 12950 leader_election.cc:290] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.230953  9015 consensus_peers.cc:597] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:15.236133  8512 leader_election.cc:336] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:15.239642  8511 leader_election.cc:336] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.240077  8511 leader_election.cc:304] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.241509 12959 raft_consensus.cc:2749] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:28:15.244925  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:15.245472  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:28:15.251616  8511 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:15.267971  7261 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 8493)
I20260709 12:28:15.278491 12950 raft_consensus.cc:493] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.279086 12950 raft_consensus.cc:515] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.281297 12950 leader_election.cc:290] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.290217  8511 leader_election.cc:336] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:15.290920  8512 leader_election.cc:336] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:15.291327  8512 leader_election.cc:304] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.292874 12979 raft_consensus.cc:2749] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:15.303532  9015 consensus_peers.cc:597] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:15.343084 12950 raft_consensus.cc:493] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.343712 12950 raft_consensus.cc:515] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.345800 12950 leader_election.cc:290] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:15.349113  8538 raft_consensus.cc:1275] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 16 FOLLOWER]: Refusing update from remote peer e3660d999c0a41658a1f1dbe7cc90746: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:28:15.352674 12990 consensus_queue.cc:1048] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:28:15.355562  8512 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:15.359302 12979 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.359838 12979 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.362114 12979 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.363978  8511 leader_election.cc:336] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.364444  8511 leader_election.cc:304] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.367295 12950 raft_consensus.cc:2749] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:28:15.371016  8512 leader_election.cc:336] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:15.376574  8511 leader_election.cc:336] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.376984  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.378968 12979 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:15.458590 12979 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.459105 12979 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.461182 12979 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.469476  8512 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:15.470189  8511 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.470593  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.472083 12950 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:15.499388  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.604930  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:15.608453 12979 raft_consensus.cc:493] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.609004 12979 raft_consensus.cc:515] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.611078 12979 leader_election.cc:290] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.616551  8511 leader_election.cc:336] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:15.617331  8512 leader_election.cc:336] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:15.617717  8512 leader_election.cc:304] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.618829 12979 raft_consensus.cc:2749] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:15.629215  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:15.687209 12950 raft_consensus.cc:493] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.687822 12950 raft_consensus.cc:515] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:15.689903 12950 leader_election.cc:290] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.692780  8512 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:15.694444  8511 leader_election.cc:336] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.694852  8511 leader_election.cc:304] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.696014 12950 raft_consensus.cc:2749] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:15.702725 12981 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.703296 12981 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:15.705395 12981 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.717746  8512 consensus_peers.cc:597] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.720813  9015 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:15.731520  9016 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:15.733397  9016 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.735013 12983 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:15.763985 12950 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:15.764554 12950 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:28:15.768489  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.771068  8511 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:15.771526 12950 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:15.781775  8512 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.785733  8512 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:15.786162  8512 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:15.786862 12950 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:15.883605  8512 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.921468  8512 consensus_peers.cc:597] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:15.986603  8512 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:16.038167  8512 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:28:16.141247  8512 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.162326  8512 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:16.241959 12979 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.242499 12979 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:16.244733 12979 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:16.252629  8511 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:16.253523  8512 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:16.253937  8512 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.254980 12979 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:16.269176  7261 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 8493)
I20260709 12:28:16.477698 12950 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.478253 12950 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.480235 12950 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:16.482777  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:28:16.483381  9046 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 11.
I20260709 12:28:16.484699  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:16.486369 12979 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:28:16.486742 12979 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.487066 12979 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:16.492043  8511 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.496655 12950 raft_consensus.cc:493] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.498170 12950 raft_consensus.cc:515] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:16.501013 12950 leader_election.cc:290] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:16.503320  8512 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.514183  8512 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.514719  8512 leader_election.cc:336] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:16.515141  8511 leader_election.cc:336] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.515664  8511 leader_election.cc:304] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.515395 12979 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.518553 13004 raft_consensus.cc:2749] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:16.518571  9046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3541cfbddb54a3dbef569666e60ffb4" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:28:16.517534 12979 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:16.519402  9046 raft_consensus.cc:3060] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:28:16.525573  8511 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.526713  9046 raft_consensus.cc:2468] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 12.
I20260709 12:28:16.528095  8510 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.529964 13004 raft_consensus.cc:2804] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:28:16.530697 13004 raft_consensus.cc:697] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:28:16.531550 13004 consensus_queue.cc:237] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.548753  8293 catalog_manager.cc:5697] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 10 to 12, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 12 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.580806 13004 raft_consensus.cc:493] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.581390 13004 raft_consensus.cc:515] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:28:16.589095  8512 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:16.587713 13004 leader_election.cc:290] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:16.601197  8511 leader_election.cc:336] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.601662  8511 leader_election.cc:304] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.603137 12979 raft_consensus.cc:2749] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:28:16.606026 12983 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.606622 12983 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.610307  8540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c0c82b4eaa64a08af0a1f0c7ddaaef0" candidate_uuid: "e3660d999c0a41658a1f1dbe7cc90746" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "aef8c9f023564378a04e3e1e6171930d" is_pre_election: true
I20260709 12:28:16.610952  8540 raft_consensus.cc:2468] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3660d999c0a41658a1f1dbe7cc90746 in term 13.
W20260709 12:28:16.620224  9016 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:16.621023  9015 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.621475  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.622196 12981 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:16.634268 13004 raft_consensus.cc:493] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.634852 13004 raft_consensus.cc:515] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:16.636986 13004 leader_election.cc:290] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:16.609408 12983 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:16.646015  8512 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:16.650555  8511 leader_election.cc:336] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.650977  8511 leader_election.cc:304] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:28:16.654206  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:28:16.654889 12979 raft_consensus.cc:493] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.655472 12979 raft_consensus.cc:515] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:16.657498 12979 leader_election.cc:290] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:16.657963 12979 raft_consensus.cc:2749] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:16.661970 13005 raft_consensus.cc:493] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.662551 13005 raft_consensus.cc:515] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:16.665074 13005 leader_election.cc:290] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:16.666038 13005 raft_consensus.cc:493] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.666560 13005 raft_consensus.cc:515] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
W20260709 12:28:16.667376  8512 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:16.668486 13004 raft_consensus.cc:493] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.670511 13004 raft_consensus.cc:515] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:16.672435 13004 leader_election.cc:290] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:16.668825 13005 leader_election.cc:290] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:16.686839  8512 leader_election.cc:336] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:16.696596  8512 leader_election.cc:336] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:16.697144  8512 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:16.699626  8511 leader_election.cc:336] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.700052  8511 leader_election.cc:304] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:28:16.700987  8511 leader_election.cc:336] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.701375  8511 leader_election.cc:304] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.701995 12979 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:16.702529 12979 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.704227 12950 raft_consensus.cc:2749] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:16.704828 12950 raft_consensus.cc:2749] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:16.705029 12979 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:28:16.702178  8511 leader_election.cc:336] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.707295  8511 leader_election.cc:304] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
W20260709 12:28:16.708668  8511 leader_election.cc:336] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.709052  8511 leader_election.cc:304] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.709707 12950 raft_consensus.cc:2749] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:16.710255 12950 raft_consensus.cc:2749] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:16.711428  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:28:16.712047  9048 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 9.
I20260709 12:28:16.719192  8510 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 
I20260709 12:28:16.720016 13004 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:28:16.720402 13004 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:16.720706 13004 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:28:16.722091  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e78864d1ef6947eca56a20b30fc482a6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:16.734477  8511 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:16.737198  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:28:16.767011 13004 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.770231 13004 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Requested vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
W20260709 12:28:16.773718  8511 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:16.779254  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "046c03262b594a9c8af1b19c581fb4b6" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746"
I20260709 12:28:16.780156  9048 raft_consensus.cc:3060] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:28:16.797873  9048 raft_consensus.cc:2468] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 10.
I20260709 12:28:16.800199  8510 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.801491 13005 raft_consensus.cc:2804] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:28:16.802356 12979 raft_consensus.cc:493] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.802841 12979 raft_consensus.cc:515] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:16.804925 12979 leader_election.cc:290] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:16.809688  8511 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:16.810405  8512 leader_election.cc:336] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:16.810489 13005 raft_consensus.cc:697] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Becoming Leader. State: Replica: aef8c9f023564378a04e3e1e6171930d, State: Running, Role: LEADER
I20260709 12:28:16.810843  8512 leader_election.cc:304] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.811622 13014 raft_consensus.cc:2749] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:16.813295 13005 consensus_queue.cc:237] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:16.821415  8511 consensus_peers.cc:597] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:16.837920  8293 catalog_manager.cc:5697] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d reported cstate change: term changed from 8 to 10, leader changed from 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66) to aef8c9f023564378a04e3e1e6171930d (127.7.23.67). New cstate: current_term: 10 leader_uuid: "aef8c9f023564378a04e3e1e6171930d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.840690 13005 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.841244 13005 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.844759  9048 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df155d204dc041d7b2ce5467f8825efd" candidate_uuid: "aef8c9f023564378a04e3e1e6171930d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3660d999c0a41658a1f1dbe7cc90746" is_pre_election: true
I20260709 12:28:16.844918 13005 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), e3660d999c0a41658a1f1dbe7cc90746 (127.7.23.68:37019)
I20260709 12:28:16.845372  9048 raft_consensus.cc:2468] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aef8c9f023564378a04e3e1e6171930d in term 13.
W20260709 12:28:16.848486  8511 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:16.850093  8512 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:16.850919  8512 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d, e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.851636 13005 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:16.895895  8512 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:16.932348 13009 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:16.932992 13009 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:16.935214 13009 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:16.940742  8512 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:16.944909  9015 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:16.945653  9016 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:16.946055  9016 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:16.947121 13009 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:16.996476  8511 consensus_peers.cc:597] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.035840  8511 consensus_peers.cc:597] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:17.083884  9048 raft_consensus.cc:1275] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:28:17.088373  9015 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.089303 12950 consensus_queue.cc:1048] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:28:17.091208  8512 consensus_peers.cc:597] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:17.172588  9015 consensus_peers.cc:597] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.250669  9015 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:17.253242  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:17.256250  9015 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.258198  9046 raft_consensus.cc:1275] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Refusing update from remote peer aef8c9f023564378a04e3e1e6171930d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:28:17.260020 12950 consensus_queue.cc:1048] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:28:17.281669  8512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111) [suppressed 602 similar messages]
W20260709 12:28:17.298873  8511 consensus_peers.cc:597] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:17.313480  8512 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:17.314916  9015 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.318816  8512 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:17.358995  8512 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 12:28:17.368314  8511 consensus_peers.cc:597] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.459968  8511 consensus_peers.cc:597] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.481868  9015 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.483350 13005 raft_consensus.cc:493] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:17.483980 13005 raft_consensus.cc:515] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:17.486121 13005 leader_election.cc:290] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:17.493794  8512 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:17.506496  8511 leader_election.cc:336] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:17.506960  8511 leader_election.cc:304] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:17.510776 13005 raft_consensus.cc:2749] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:17.516734  8511 consensus_peers.cc:597] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.526362  8511 consensus_peers.cc:597] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.631341 12979 raft_consensus.cc:493] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:17.631953 12979 raft_consensus.cc:515] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:17.634033 12979 leader_election.cc:290] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:17.650452  8512 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:17.662842 13020 raft_consensus.cc:493] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:17.663554 13020 raft_consensus.cc:515] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:17.666069 13020 leader_election.cc:290] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
I20260709 12:28:17.685257  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
W20260709 12:28:17.738890  8511 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:41641, user_credentials={real_user=slave}} blocked reactor thread for 201839us
W20260709 12:28:17.740185  8512 leader_election.cc:336] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:17.740759  8512 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:17.742787 12979 raft_consensus.cc:493] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:17.743335 13020 raft_consensus.cc:493] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:17.743916 13020 raft_consensus.cc:515] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:17.745890 13020 leader_election.cc:290] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:17.749722  8511 consensus_peers.cc:597] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.743307 12979 raft_consensus.cc:515] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:17.759491 12979 leader_election.cc:290] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:17.765789  8512 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:28:17.766271  8512 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:17.777150  9015 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.777760  8512 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:17.783327  8511 consensus_peers.cc:597] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.785151  8511 leader_election.cc:336] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:17.787096  8511 leader_election.cc:304] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:17.787928 12979 raft_consensus.cc:2749] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:17.789367  8511 consensus_peers.cc:597] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.789865  8511 consensus_peers.cc:597] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.790305  8511 consensus_peers.cc:597] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.790812  8511 leader_election.cc:336] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:17.791206  8511 leader_election.cc:304] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:17.791960 12979 raft_consensus.cc:2749] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:17.792961  8511 consensus_peers.cc:597] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.793418  8511 consensus_peers.cc:597] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.804685  8511 leader_election.cc:336] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:17.805229  8511 leader_election.cc:304] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:17.806126 12979 raft_consensus.cc:2749] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:17.807117  8511 leader_election.cc:336] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:17.807672  8511 leader_election.cc:304] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:17.808429 12979 raft_consensus.cc:2749] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:17.816641  9015 consensus_peers.cc:597] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:17.816593  8511 consensus_peers.cc:597] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:17.817729  8511 consensus_peers.cc:597] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.864241  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
W20260709 12:28:17.882265  9014 consensus_peers.cc:597] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:17.925525  9016 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:28:17.946854  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:28:17.949815  8511 consensus_peers.cc:597] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.951465  7261 tablet_replica.cc:333] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
W20260709 12:28:17.952945  9014 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:17.953011  7261 raft_consensus.cc:2243] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.954228  7261 raft_consensus.cc:2272] T a5fade2bf4064a129c23d8bb05ce09c7 P aef8c9f023564378a04e3e1e6171930d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.957093  7261 tablet_replica.cc:333] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
W20260709 12:28:17.957892  9016 consensus_peers.cc:597] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:17.957893  7261 raft_consensus.cc:2243] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:17.960397  7261 raft_consensus.cc:2272] T 9d18f5c816314559a3727b41a178ee5c P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:17.961782  9014 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:17.963794  7261 tablet_replica.cc:333] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:17.964702  7261 raft_consensus.cc:2243] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.965363  7261 raft_consensus.cc:2272] T 268ce46c10234969b0ee35600bf0a70d P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.967993  7261 tablet_replica.cc:333] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:17.968815  7261 raft_consensus.cc:2243] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.969447  7261 raft_consensus.cc:2272] T 73c51b6166884e0287dbdff730d29a1f P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.971835  7261 tablet_replica.cc:333] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:17.972643  7261 raft_consensus.cc:2243] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.973320  7261 raft_consensus.cc:2272] T 1f4ad78594dd4320b4c04e2f4e775e85 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:17.975757  7261 tablet_replica.cc:333] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:17.978497  7261 raft_consensus.cc:2243] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.981122  7261 raft_consensus.cc:2272] T 605e001ede544f519292071c2eeb41fb P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:17.989791  8511 consensus_peers.cc:597] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:17.992347  7261 tablet_replica.cc:333] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:17.993956  7261 raft_consensus.cc:2243] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.995303  7261 raft_consensus.cc:2272] T 3d674c56f11d4d76a575c52d1a0e66bd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:17.995232  9014 consensus_peers.cc:597] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:17.998353  7261 tablet_replica.cc:333] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:17.999207  7261 raft_consensus.cc:2243] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:17.999851  7261 raft_consensus.cc:2272] T bf567c52be7141c5b7edac250f385cc4 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.002384  7261 tablet_replica.cc:333] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.003237  7261 raft_consensus.cc:2243] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.004314  7261 raft_consensus.cc:2272] T e78864d1ef6947eca56a20b30fc482a6 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.006913  7261 tablet_replica.cc:333] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.007694  7261 raft_consensus.cc:2243] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.009047  7261 raft_consensus.cc:2272] T eaf1cdb4d1a4411f9717ef7b1d0b1b94 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.011535  7261 tablet_replica.cc:333] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.012320  7261 raft_consensus.cc:2243] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.012928  7261 raft_consensus.cc:2272] T ec5712a692fb47d3aaf9c8440b1a75a1 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.015380  7261 tablet_replica.cc:333] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.016433  7261 raft_consensus.cc:2243] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.017102  7261 raft_consensus.cc:2272] T 225b79a42b074c48a583a96802a0f532 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.019508  7261 tablet_replica.cc:333] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.020269  7261 raft_consensus.cc:2243] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.020841  7261 raft_consensus.cc:2272] T 016be601898642f5bfd00376e81080bd P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.023480  7261 tablet_replica.cc:333] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.024251  7261 raft_consensus.cc:2243] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.026014  7261 raft_consensus.cc:2272] T 2219cc30a0424600b771d733ba9974e1 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:18.027443  9014 consensus_peers.cc:597] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:18.029912  7261 tablet_replica.cc:333] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.030833  7261 raft_consensus.cc:2243] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.031986  7261 raft_consensus.cc:2272] T 80def59f123c433b90d8ddb5d7e620c6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.034368  7261 tablet_replica.cc:333] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.035135  7261 raft_consensus.cc:2243] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.036082  7261 raft_consensus.cc:2272] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:18.038010  9016 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:28:18.038935  7261 tablet_replica.cc:333] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.039791  7261 raft_consensus.cc:2243] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.041002  7261 raft_consensus.cc:2272] T abbf9b71c617406c9d2be1cd987a6a94 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.043387  7261 tablet_replica.cc:333] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.044191  7261 raft_consensus.cc:2243] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.044817  7261 raft_consensus.cc:2272] T 158edb8122f9489398444d919f25cbce P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.047119  7261 tablet_replica.cc:333] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.047885  7261 raft_consensus.cc:2243] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.048929  7261 raft_consensus.cc:2272] T 88ee35c47e0d403393cb03f68a432b98 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.051105  7261 tablet_replica.cc:333] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.051836  7261 raft_consensus.cc:2243] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.052578  7261 raft_consensus.cc:2272] T f27995e97dd24420a9a7efc50ed48941 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.054744  7261 tablet_replica.cc:333] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.055461  7261 raft_consensus.cc:2243] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.056119  7261 raft_consensus.cc:2272] T 39e8dc02425a4fafb53164fd99fe0d0d P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.058518  7261 tablet_replica.cc:333] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.059242  7261 raft_consensus.cc:2243] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.059928  7261 raft_consensus.cc:2272] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.062212  7261 tablet_replica.cc:333] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.063012  7261 raft_consensus.cc:2243] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.064073  7261 raft_consensus.cc:2272] T 7ae3eef998ef416f8ebd3e8c21b20834 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.066519  7261 tablet_replica.cc:333] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
W20260709 12:28:18.067011  9015 consensus_peers.cc:597] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:18.067307  7261 raft_consensus.cc:2243] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.068009  7261 raft_consensus.cc:2272] T e353e593608d40f283a70e6dab6c4d3a P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.070674  7261 tablet_replica.cc:333] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.071475  7261 raft_consensus.cc:2243] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.072557  7261 raft_consensus.cc:2272] T d3541cfbddb54a3dbef569666e60ffb4 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.076587  7261 tablet_replica.cc:333] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.077662 12950 raft_consensus.cc:493] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:18.078197 12950 raft_consensus.cc:515] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } }
I20260709 12:28:18.080053 12950 leader_election.cc:290] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:18.087083  8512 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:18.088796  8511 leader_election.cc:336] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:18.089169  8511 leader_election.cc:304] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aef8c9f023564378a04e3e1e6171930d; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:18.090199 12979 raft_consensus.cc:2749] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:28:18.077348  7261 raft_consensus.cc:2243] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.093209  7261 raft_consensus.cc:2272] T 5164be0f063b4907aae5b6f874361ca3 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.096104  7261 tablet_replica.cc:333] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
W20260709 12:28:18.099222  9014 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:18.100243  7261 raft_consensus.cc:2243] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.103492  7261 raft_consensus.cc:2272] T d12c64e413ad46968034a527b5290316 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.109084  7261 tablet_replica.cc:333] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.109901  7261 raft_consensus.cc:2243] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.110834  7261 raft_consensus.cc:2272] T b9ce4c75067748ad84434b89f28725b0 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.113190  7261 tablet_replica.cc:333] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.113922  7261 raft_consensus.cc:2243] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.114517  7261 raft_consensus.cc:2272] T ea8ca6961a884db3b196c76ca97b049a P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:18.119690  9016 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:28:18.130796  7261 tablet_replica.cc:333] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.131668  7261 raft_consensus.cc:2243] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.133912  7261 raft_consensus.cc:2272] T dabecae7023948069d48a04cefe25522 P aef8c9f023564378a04e3e1e6171930d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.136461  7261 tablet_replica.cc:333] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.138403  7261 raft_consensus.cc:2243] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.139081  7261 raft_consensus.cc:2272] T ea5d246a744e484fa3414c038a792b99 P aef8c9f023564378a04e3e1e6171930d [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.141705  7261 tablet_replica.cc:333] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.142437  7261 raft_consensus.cc:2243] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.143507  7261 raft_consensus.cc:2272] T 2a26f17e57344b8bba537d4b071c49be P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.145764  7261 tablet_replica.cc:333] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.146466  7261 raft_consensus.cc:2243] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.147796  7261 raft_consensus.cc:2272] T 8974a3bbc8c3420f95c2b151405bd386 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.150096  7261 tablet_replica.cc:333] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.150871  7261 raft_consensus.cc:2243] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.151891  7261 raft_consensus.cc:2272] T dec3215185474277adc36392bd1a7eda P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.154309  7261 tablet_replica.cc:333] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.155055  7261 raft_consensus.cc:2243] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.156193  7261 raft_consensus.cc:2272] T 5899a880ee09417eb2739689c0d74579 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.158780  7261 tablet_replica.cc:333] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.159536  7261 raft_consensus.cc:2243] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.160128  7261 raft_consensus.cc:2272] T 15e2fa2b1330485fb8fbc9b08f54955b P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.162324  7261 tablet_replica.cc:333] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.163048  7261 raft_consensus.cc:2243] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.164093  7261 raft_consensus.cc:2272] T 28f6deaf14d94befa991497fcc0de1f5 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.166438  7261 tablet_replica.cc:333] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.167105  7261 raft_consensus.cc:2243] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.167662  7261 raft_consensus.cc:2272] T 3594f197bee04c33b4ae361b87965bd6 P aef8c9f023564378a04e3e1e6171930d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.169926  7261 tablet_replica.cc:333] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.170648  7261 raft_consensus.cc:2243] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.171217  7261 raft_consensus.cc:2272] T fea9eaca8b50473cb6788b0928b3f8c4 P aef8c9f023564378a04e3e1e6171930d [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.173563  7261 tablet_replica.cc:333] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.174232  7261 raft_consensus.cc:2243] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.174759  7261 raft_consensus.cc:2272] T 145eb7997c78480db629215c6acac8ef P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.176957  7261 tablet_replica.cc:333] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.177619  7261 raft_consensus.cc:2243] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.178118  7261 raft_consensus.cc:2272] T f2739228b32f48d7a73d1704fa1bfe5b P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.181854  7261 tablet_replica.cc:333] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.182600  7261 raft_consensus.cc:2243] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.183233  7261 raft_consensus.cc:2272] T df155d204dc041d7b2ce5467f8825efd P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.185771  7261 tablet_replica.cc:333] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.186462  7261 raft_consensus.cc:2243] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.187767  7261 raft_consensus.cc:2272] T 046c03262b594a9c8af1b19c581fb4b6 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:18.191725  9014 consensus_peers.cc:597] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:18.194691  7261 tablet_replica.cc:333] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.195495  7261 raft_consensus.cc:2243] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.196790  7261 raft_consensus.cc:2272] T 0f58d6d40fe4445e95211f397d2e4e00 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.199169  7261 tablet_replica.cc:333] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.199970  7261 raft_consensus.cc:2243] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.200582  7261 raft_consensus.cc:2272] T 04e64f31022343538635c1fde40fe9d0 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.202963  7261 tablet_replica.cc:333] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.203646  7261 raft_consensus.cc:2243] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.204191  7261 raft_consensus.cc:2272] T 78f588f9461a426ebd4a55bd3ade3583 P aef8c9f023564378a04e3e1e6171930d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.206816  7261 tablet_replica.cc:333] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.207472  7261 raft_consensus.cc:2243] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.208560  7261 raft_consensus.cc:2272] T 2bfca2ec0c4f47349d091a6486b08139 P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.210865  7261 tablet_replica.cc:333] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.211565  7261 raft_consensus.cc:2243] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.212560  7261 raft_consensus.cc:2272] T aeb63cbffbd24922b72419df5ee40899 P aef8c9f023564378a04e3e1e6171930d [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.214928  7261 tablet_replica.cc:333] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.215556  7261 raft_consensus.cc:2243] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.216646  7261 raft_consensus.cc:2272] T d2e76be6a4cb43fdaee395073ab103da P aef8c9f023564378a04e3e1e6171930d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.218943  7261 tablet_replica.cc:333] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.219578  7261 raft_consensus.cc:2243] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.220583  7261 raft_consensus.cc:2272] T c6fb68f59621452b8e81b4fbe2cda697 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:18.221674  9016 consensus_peers.cc:597] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 12:28:18.222707  7261 tablet_replica.cc:333] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.223209  7261 raft_consensus.cc:2243] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:18.223688  7261 raft_consensus.cc:2272] T 688c3b409a5a44acae5413866342b3c4 P aef8c9f023564378a04e3e1e6171930d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:18.225545  7261 tablet_replica.cc:333] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d: stopping tablet replica
I20260709 12:28:18.225960  7261 raft_consensus.cc:2243] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:18.227046  7261 raft_consensus.cc:2272] T c9d00e01c4bf4fa69c5d6648a287de68 P aef8c9f023564378a04e3e1e6171930d [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:18.247584  9014 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:18.336616  9016 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 12:28:18.657581  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6540 after lost signal to thread 7264
W20260709 12:28:18.658684  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08002dff80 after lost signal to thread 8329
W20260709 12:28:18.659951  8567 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd360 after lost signal to thread 8570
W20260709 12:28:18.661087  8567 debug-util.cc:398] Leaking SignalData structure 0x7b0800306360 after lost signal to thread 9074
I20260709 12:28:18.811775 13025 raft_consensus.cc:493] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:18.812398 13025 raft_consensus.cc:515] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:18.814517 13025 leader_election.cc:290] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:18.826685  9016 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:18.843032  9015 leader_election.cc:336] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:18.844496  9015 leader_election.cc:304] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:18.846349 13025 raft_consensus.cc:2749] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:18.872797  9016 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
I20260709 12:28:19.226145 13025 raft_consensus.cc:493] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.226712 13025 raft_consensus.cc:515] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.228905 13025 leader_election.cc:290] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:19.231065 13024 raft_consensus.cc:493] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.231729 13024 raft_consensus.cc:515] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.233703 13024 leader_election.cc:290] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:19.239466  9014 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
W20260709 12:28:19.240208  9014 leader_election.cc:336] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
I20260709 12:28:19.256950 13025 raft_consensus.cc:493] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.258142 13009 raft_consensus.cc:493] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.257732 13025 raft_consensus.cc:515] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.258718 13009 raft_consensus.cc:515] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.260913 13009 leader_election.cc:290] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:19.264123 13025 leader_election.cc:290] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:19.267639  9016 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:19.284628  9015 leader_election.cc:336] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:19.285207 13009 raft_consensus.cc:493] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.288537 13009 raft_consensus.cc:515] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.291288 13009 leader_election.cc:290] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:19.287546 13025 raft_consensus.cc:493] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.292927 13025 raft_consensus.cc:515] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.293956  9015 leader_election.cc:304] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:28:19.298566  9016 leader_election.cc:336] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:19.299018  9014 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
W20260709 12:28:19.301249  9014 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
I20260709 12:28:19.301720 13009 raft_consensus.cc:2749] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:28:19.302363  9015 leader_election.cc:336] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:19.303673  9015 leader_election.cc:304] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:19.309101 13009 raft_consensus.cc:2749] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:19.304737 13025 leader_election.cc:290] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
I20260709 12:28:19.303138  9014 leader_election.cc:304] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:19.315609 13009 raft_consensus.cc:2749] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:19.316210 13009 raft_consensus.cc:493] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.316653 13009 raft_consensus.cc:515] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.318565 13009 leader_election.cc:290] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:19.318960  7261 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 8567)
W20260709 12:28:19.326562  9014 leader_election.cc:336] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
W20260709 12:28:19.334558  9016 leader_election.cc:336] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:19.335347  9014 leader_election.cc:304] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
W20260709 12:28:19.342890  9014 leader_election.cc:336] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
I20260709 12:28:19.345160  9014 leader_election.cc:304] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:19.343461 13025 raft_consensus.cc:2749] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:28:19.346364 13009 raft_consensus.cc:2749] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:28:19.347894  9015 leader_election.cc:336] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:19.357057  9016 consensus_peers.cc:597] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 12:28:19.357715  9015 leader_election.cc:304] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
W20260709 12:28:19.359153  9015 leader_election.cc:336] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:19.359663 13025 raft_consensus.cc:2749] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:28:19.360134  9014 leader_election.cc:336] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
W20260709 12:28:19.370079  9015 leader_election.cc:336] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
W20260709 12:28:19.372054  9015 leader_election.cc:336] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:19.372496  9015 leader_election.cc:304] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 2d99fb7f1afb4c958cdc302eb8ef165f, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:19.373203 13025 raft_consensus.cc:2749] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:28:19.386513 13025 raft_consensus.cc:493] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.387125 13025 raft_consensus.cc:515] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:19.395951  9016 leader_election.cc:336] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:19.398286 13025 leader_election.cc:290] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:19.403162  9014 leader_election.cc:336] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
I20260709 12:28:19.403677  9014 leader_election.cc:304] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:19.404832 13025 raft_consensus.cc:2749] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:28:19.475025 13025 raft_consensus.cc:493] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:19.475638 13025 raft_consensus.cc:515] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:19.482601  9016 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:19.485978 13025 leader_election.cc:290] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:19.489589  9015 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:19.489992  9015 leader_election.cc:304] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:19.490885 13009 raft_consensus.cc:2749] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:28:19.494019  9014 leader_election.cc:336] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
W20260709 12:28:19.589442  9015 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:19.604127 13009 raft_consensus.cc:493] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader aef8c9f023564378a04e3e1e6171930d)
I20260709 12:28:19.604645 13009 raft_consensus.cc:515] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
I20260709 12:28:19.606634 13009 leader_election.cc:290] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:19.612030  9016 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:19.617755  9015 consensus_peers.cc:597] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:28:19.621701 13009 raft_consensus.cc:493] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:19.622300 13009 raft_consensus.cc:515] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:19.628697  9016 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
I20260709 12:28:19.631659 13009 leader_election.cc:290] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641)
W20260709 12:28:19.634865  9015 leader_election.cc:336] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:19.635321  9015 leader_election.cc:304] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:19.636453 13009 raft_consensus.cc:2749] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:28:19.640198  9014 leader_election.cc:336] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
I20260709 12:28:19.640697  9014 leader_election.cc:304] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, aef8c9f023564378a04e3e1e6171930d
I20260709 12:28:19.641625 13025 raft_consensus.cc:2749] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:28:19.676978 13009 raft_consensus.cc:493] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 2d99fb7f1afb4c958cdc302eb8ef165f)
I20260709 12:28:19.677666 13009 raft_consensus.cc:515] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "21c151c99bcf4cbeb819de06e68d95bf" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 38641 } } peers { permanent_uuid: "2d99fb7f1afb4c958cdc302eb8ef165f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41641 } attrs { replace: true } } peers { permanent_uuid: "aef8c9f023564378a04e3e1e6171930d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 37713 } } peers { permanent_uuid: "e3660d999c0a41658a1f1dbe7cc90746" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 37019 } attrs { promote: false } }
W20260709 12:28:19.684783  9016 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:19.690341  9015 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:19.690850  9015 leader_election.cc:304] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3660d999c0a41658a1f1dbe7cc90746; no voters: 21c151c99bcf4cbeb819de06e68d95bf, 2d99fb7f1afb4c958cdc302eb8ef165f
I20260709 12:28:19.691624 13025 raft_consensus.cc:2749] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:28:19.693041 13009 leader_election.cc:290] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641), 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641), aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713)
W20260709 12:28:19.698357  9014 leader_election.cc:336] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111)
W20260709 12:28:19.803578  9016 consensus_peers.cc:597] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): Couldn't send request to peer 21c151c99bcf4cbeb819de06e68d95bf. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260709 12:28:19.829339  9015 consensus_peers.cc:597] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:19.835536  9015 consensus_peers.cc:597] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:19.881628  9015 consensus_peers.cc:597] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:19.910296  9015 consensus_peers.cc:597] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:19.934407  9015 consensus_peers.cc:597] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:28:20.065338  9015 consensus_peers.cc:597] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): Couldn't send request to peer 2d99fb7f1afb4c958cdc302eb8ef165f. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:20.162667  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
W20260709 12:28:20.185619  9014 consensus_peers.cc:597] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 -> Peer aef8c9f023564378a04e3e1e6171930d (127.7.23.67:37713): Couldn't send request to peer aef8c9f023564378a04e3e1e6171930d. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.67:37713: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:20.268715  7261 tablet_server.cc:179] TabletServer@127.7.23.68:0 shutting down...
I20260709 12:28:20.324002  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:20.324957  7261 tablet_replica.cc:333] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.325860  7261 raft_consensus.cc:2243] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.326664  7261 raft_consensus.cc:2272] T c9d00e01c4bf4fa69c5d6648a287de68 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.329535  7261 tablet_replica.cc:333] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.330320  7261 raft_consensus.cc:2243] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.331512  7261 raft_consensus.cc:2272] T e78864d1ef6947eca56a20b30fc482a6 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.334103  7261 tablet_replica.cc:333] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.334906  7261 raft_consensus.cc:2243] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.335474  7261 raft_consensus.cc:2272] T 046c03262b594a9c8af1b19c581fb4b6 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.337870  7261 tablet_replica.cc:333] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.338624  7261 raft_consensus.cc:2243] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.339669  7261 raft_consensus.cc:2272] T 9ddabc2a2d42405c9f529c8489fdf71b P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.342031  7261 tablet_replica.cc:333] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.342844  7261 raft_consensus.cc:2243] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.343849  7261 raft_consensus.cc:2272] T c7efab53f2634a5abbadd798832d128c P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.346450  7261 tablet_replica.cc:333] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.347167  7261 raft_consensus.cc:2243] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.348201  7261 raft_consensus.cc:2272] T b9ce4c75067748ad84434b89f28725b0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.350857  7261 tablet_replica.cc:333] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.351642  7261 raft_consensus.cc:2243] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.352592  7261 raft_consensus.cc:2272] T 23e95bddd5b14e1b8e7f5bfe7a8f8392 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.355064  7261 tablet_replica.cc:333] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.355825  7261 raft_consensus.cc:2243] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.356534  7261 raft_consensus.cc:2272] T 88ee35c47e0d403393cb03f68a432b98 P e3660d999c0a41658a1f1dbe7cc90746 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.359097  7261 tablet_replica.cc:333] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.359817  7261 raft_consensus.cc:2243] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.360359  7261 raft_consensus.cc:2272] T 8974a3bbc8c3420f95c2b151405bd386 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.362687  7261 tablet_replica.cc:333] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.363442  7261 raft_consensus.cc:2243] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.363967  7261 raft_consensus.cc:2272] T 2a26f17e57344b8bba537d4b071c49be P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.366452  7261 tablet_replica.cc:333] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.367153  7261 raft_consensus.cc:2243] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.368206  7261 raft_consensus.cc:2272] T f7de1dd05702461da4c0319fda01a7ca P e3660d999c0a41658a1f1dbe7cc90746 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.372133  7261 tablet_replica.cc:333] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.372792  7261 raft_consensus.cc:2243] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.373333  7261 raft_consensus.cc:2272] T abbf9b71c617406c9d2be1cd987a6a94 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.375738  7261 tablet_replica.cc:333] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.376413  7261 raft_consensus.cc:2243] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.376932  7261 raft_consensus.cc:2272] T 3c0c82b4eaa64a08af0a1f0c7ddaaef0 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.379451  7261 tablet_replica.cc:333] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.380115  7261 raft_consensus.cc:2243] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.380666  7261 raft_consensus.cc:2272] T df155d204dc041d7b2ce5467f8825efd P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.383025  7261 tablet_replica.cc:333] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.383719  7261 raft_consensus.cc:2243] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.384871  7261 raft_consensus.cc:2272] T f2739228b32f48d7a73d1704fa1bfe5b P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.387292  7261 tablet_replica.cc:333] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.388010  7261 raft_consensus.cc:2243] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.388692  7261 raft_consensus.cc:2272] T d12c64e413ad46968034a527b5290316 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.391247  7261 tablet_replica.cc:333] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.391916  7261 raft_consensus.cc:2243] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.392966  7261 raft_consensus.cc:2272] T 016be601898642f5bfd00376e81080bd P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.395382  7261 tablet_replica.cc:333] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.396034  7261 raft_consensus.cc:2243] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.396564  7261 raft_consensus.cc:2272] T 7ae3eef998ef416f8ebd3e8c21b20834 P e3660d999c0a41658a1f1dbe7cc90746 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.398926  7261 tablet_replica.cc:333] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.399603  7261 raft_consensus.cc:2243] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.400108  7261 raft_consensus.cc:2272] T d3541cfbddb54a3dbef569666e60ffb4 P e3660d999c0a41658a1f1dbe7cc90746 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.402294  7261 tablet_replica.cc:333] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.402905  7261 raft_consensus.cc:2243] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.403857  7261 raft_consensus.cc:2272] T 2310aee96e77479c812917bfcb775d66 P e3660d999c0a41658a1f1dbe7cc90746 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.406162  7261 tablet_replica.cc:333] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.406805  7261 raft_consensus.cc:2243] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.407817  7261 raft_consensus.cc:2272] T 4c2e2eb7e2ca4c688fde6389b1c6a4ee P e3660d999c0a41658a1f1dbe7cc90746 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.410130  7261 tablet_replica.cc:333] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.410845  7261 raft_consensus.cc:2243] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.411866  7261 raft_consensus.cc:2272] T 15e2fa2b1330485fb8fbc9b08f54955b P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.414352  7261 tablet_replica.cc:333] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.414984  7261 raft_consensus.cc:2243] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.415542  7261 raft_consensus.cc:2272] T 9a231323db194487a6ca917e91cb1389 P e3660d999c0a41658a1f1dbe7cc90746 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.417814  7261 tablet_replica.cc:333] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.418493  7261 raft_consensus.cc:2243] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:20.419098  7261 raft_consensus.cc:2272] T 6a180f2cda394b6eb7ca0ecbbc583c75 P e3660d999c0a41658a1f1dbe7cc90746 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.421118  7261 tablet_replica.cc:333] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.421638  7261 raft_consensus.cc:2243] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.422391  7261 raft_consensus.cc:2272] T fea9eaca8b50473cb6788b0928b3f8c4 P e3660d999c0a41658a1f1dbe7cc90746 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.424185  7261 tablet_replica.cc:333] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746: stopping tablet replica
I20260709 12:28:20.424608  7261 raft_consensus.cc:2243] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:28:20.425279  7261 raft_consensus.cc:2272] T bf567c52be7141c5b7edac250f385cc4 P e3660d999c0a41658a1f1dbe7cc90746 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:20.740478  7261 tablet_server.cc:196] TabletServer@127.7.23.68:0 shutdown complete.
I20260709 12:28:20.801913  7261 master.cc:562] Master@127.7.23.126:36193 shutting down...
W20260709 12:28:20.835155  8343 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:28:20.835467  8343 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:28:20.835647  8343 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:28:30.300590  8282 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111) [suppressed 255 similar messages]
W20260709 12:28:30.304082  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 046c03262b594a9c8af1b19c581fb4b6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:33.139969  8282 catalog_manager.cc:4755] TS 21c151c99bcf4cbeb819de06e68d95bf (127.7.23.65:38641): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e78864d1ef6947eca56a20b30fc482a6: Network error: Client connection negotiation failed: client connection to 127.7.23.65:38641: connect: Connection refused (error 111)
W20260709 12:28:51.536861  8281 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 12:28:51.540423  8281 catalog_manager.cc:4755] TS 2d99fb7f1afb4c958cdc302eb8ef165f (127.7.23.66:41641): ChangeConfig:REMOVE_PEER RPC failed for tablet df155d204dc041d7b2ce5467f8825efd: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41641: connect: Connection refused (error 111)
I20260709 12:28:54.017079  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:54.018131  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:54.018525  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P fda1d6ce844f48669763ced7af1542be: stopping tablet replica
I20260709 12:28:54.196794  7261 master.cc:584] Master@127.7.23.126:36193 shutdown complete.
I20260709 12:28:54.246279  7261 test_util.cc:182] -----------------------------------------------
I20260709 12:28:54.246491  7261 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599893953746-7261-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (181495 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:28:54.250062  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:43005
I20260709 12:28:54.251176  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:54.256902 13037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.256907 13038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.257498 13040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:54.258291  7261 server_base.cc:1061] running on GCE node
I20260709 12:28:54.260492  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:54.260676  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:54.260828  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600134260806 us; error 0 us; skew 500 ppm
I20260709 12:28:54.261345  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:54.263842  7261 webserver.cc:533] Webserver started at http://127.7.23.126:44901/ using document root <none> and password file <none>
I20260709 12:28:54.264369  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:54.264546  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:54.264809  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:54.266108  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "8ac92aaf5a6841b5a599c2d387cd7acd"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.270483  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:28:54.273801 13045 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.274467  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:54.274730  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "8ac92aaf5a6841b5a599c2d387cd7acd"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.275002  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:54.286077  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:54.287285  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:54.325680  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:43005
I20260709 12:28:54.325781 13096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:43005 every 8 connection(s)
I20260709 12:28:54.329720 13097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:54.340452 13097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd: Bootstrap starting.
I20260709 12:28:54.345221 13097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:54.349311 13097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd: No bootstrap required, opened a new log
I20260709 12:28:54.351537 13097 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" member_type: VOTER }
I20260709 12:28:54.351969 13097 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:54.352149 13097 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ac92aaf5a6841b5a599c2d387cd7acd, State: Initialized, Role: FOLLOWER
I20260709 12:28:54.352627 13097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" member_type: VOTER }
I20260709 12:28:54.353062 13097 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:54.353255 13097 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:54.353464 13097 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:54.357832 13097 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" member_type: VOTER }
I20260709 12:28:54.358304 13097 leader_election.cc:304] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ac92aaf5a6841b5a599c2d387cd7acd; no voters: 
I20260709 12:28:54.359344 13097 leader_election.cc:290] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:54.359684 13100 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:54.360916 13100 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 1 LEADER]: Becoming Leader. State: Replica: 8ac92aaf5a6841b5a599c2d387cd7acd, State: Running, Role: LEADER
I20260709 12:28:54.361604 13100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" member_type: VOTER }
I20260709 12:28:54.362248 13097 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:54.368479 13101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" member_type: VOTER } }
I20260709 12:28:54.368443 13102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ac92aaf5a6841b5a599c2d387cd7acd. Latest consensus state: current_term: 1 leader_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ac92aaf5a6841b5a599c2d387cd7acd" member_type: VOTER } }
I20260709 12:28:54.369210 13101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:54.369316 13102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:54.371084 13108 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:54.377218 13108 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:54.378151  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:54.385888 13108 catalog_manager.cc:1383] Generated new cluster ID: 46bd84514b624d3fb389c9871eba69cc
I20260709 12:28:54.386198 13108 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:54.408708 13108 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:54.410043 13108 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:54.428866 13108 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd: Generated new TSK 0
I20260709 12:28:54.429467 13108 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:54.444983  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:54.450981 13118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.451867 13119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.454355 13121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:54.454522  7261 server_base.cc:1061] running on GCE node
I20260709 12:28:54.456511  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:54.456714  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:54.456867  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600134456852 us; error 0 us; skew 500 ppm
I20260709 12:28:54.457378  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:54.459686  7261 webserver.cc:533] Webserver started at http://127.7.23.65:45927/ using document root <none> and password file <none>
I20260709 12:28:54.460170  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:54.460345  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:54.460585  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:54.461740  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "2b4ab106e71748ef9a1c55bece2316e5"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.466293  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:28:54.469727 13126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.470557  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:28:54.470857  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "2b4ab106e71748ef9a1c55bece2316e5"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.471169  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:54.494438  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:54.495728  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:54.497153  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:54.499567  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:54.499758  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.499971  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:54.500144  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.539851  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:35779
I20260709 12:28:54.539956 13188 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:35779 every 8 connection(s)
I20260709 12:28:54.544983  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:54.552686 13193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.554759 13194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.557008 13196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:54.558095  7261 server_base.cc:1061] running on GCE node
I20260709 12:28:54.560528  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:54.560717  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:54.560887  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600134560869 us; error 0 us; skew 500 ppm
I20260709 12:28:54.561416  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:54.561502 13189 heartbeater.cc:344] Connected to a master server at 127.7.23.126:43005
I20260709 12:28:54.561935 13189 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:54.562693 13189 heartbeater.cc:507] Master 127.7.23.126:43005 requested a full tablet report, sending...
I20260709 12:28:54.564148  7261 webserver.cc:533] Webserver started at http://127.7.23.66:39719/ using document root <none> and password file <none>
I20260709 12:28:54.564674  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:54.564858  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:54.564864 13062 ts_manager.cc:194] Registered new tserver with Master: 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:54.565184  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:54.566382  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "31406ec9b44549329b74301b355264c5"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.566829 13062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46298
I20260709 12:28:54.570684  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:54.574326 13201 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.575034  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:54.575307  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "31406ec9b44549329b74301b355264c5"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.575606  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:54.586627  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:54.587903  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:54.589350  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:54.591531  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:54.591724  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.591936  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:54.592083  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.630698  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:34623
I20260709 12:28:54.630802 13263 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:34623 every 8 connection(s)
I20260709 12:28:54.635550  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:54.642799 13267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.644500 13268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.645416 13270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:54.646484  7261 server_base.cc:1061] running on GCE node
I20260709 12:28:54.647451  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:54.647709  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:54.647904  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600134647886 us; error 0 us; skew 500 ppm
I20260709 12:28:54.648591  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:54.649156 13264 heartbeater.cc:344] Connected to a master server at 127.7.23.126:43005
I20260709 12:28:54.649578 13264 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:54.650504 13264 heartbeater.cc:507] Master 127.7.23.126:43005 requested a full tablet report, sending...
I20260709 12:28:54.651490  7261 webserver.cc:533] Webserver started at http://127.7.23.67:36767/ using document root <none> and password file <none>
I20260709 12:28:54.652119  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:54.652338  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:54.652602  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:54.652755 13062 ts_manager.cc:194] Registered new tserver with Master: 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:54.653854  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.654122 13062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46306
I20260709 12:28:54.658424  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:54.661976 13275 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.662683  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:54.662968  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.663239  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:54.685062  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:54.686311  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:54.687798  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:54.689977  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:54.690174  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.690394  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:54.690546  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.730203  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:44667
I20260709 12:28:54.730300 13337 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:44667 every 8 connection(s)
I20260709 12:28:54.734890  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:54.741551 13341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.742955 13342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:54.744957 13344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:54.746088  7261 server_base.cc:1061] running on GCE node
I20260709 12:28:54.747040  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:54.747117 13338 heartbeater.cc:344] Connected to a master server at 127.7.23.126:43005
W20260709 12:28:54.747361  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:54.747586 13338 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:54.747617  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600134747598 us; error 0 us; skew 500 ppm
I20260709 12:28:54.748596  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:54.748682 13338 heartbeater.cc:507] Master 127.7.23.126:43005 requested a full tablet report, sending...
I20260709 12:28:54.751071 13062 ts_manager.cc:194] Registered new tserver with Master: c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:54.751392  7261 webserver.cc:533] Webserver started at http://127.7.23.68:46067/ using document root <none> and password file <none>
I20260709 12:28:54.752089  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:54.752341  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:54.752647  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:54.752913 13062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46310
I20260709 12:28:54.754268  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-3-root/instance:
uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.758663  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:28:54.761933 13349 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.762625  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:54.762913  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-3-root
uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:28:54.763171  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:54.780534  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:54.781759  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:54.782972  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:54.785176  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:54.785375  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.785594  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:54.785753  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:54.826212  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.68:36499
I20260709 12:28:54.826305 13411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.68:36499 every 8 connection(s)
I20260709 12:28:54.839840 13412 heartbeater.cc:344] Connected to a master server at 127.7.23.126:43005
I20260709 12:28:54.840238 13412 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:54.840986 13412 heartbeater.cc:507] Master 127.7.23.126:43005 requested a full tablet report, sending...
I20260709 12:28:54.842830 13062 ts_manager.cc:194] Registered new tserver with Master: fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:54.843689  7261 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014412327s
I20260709 12:28:54.844182 13062 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46320
I20260709 12:28:54.870191 13062 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46334:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:28:55.095799 13377 tablet_service.cc:1511] Processing CreateTablet for tablet 728ff7f7b916431596bad2058abcff08 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:55.096136 13303 tablet_service.cc:1511] Processing CreateTablet for tablet 728ff7f7b916431596bad2058abcff08 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:55.097292 13377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728ff7f7b916431596bad2058abcff08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.097527 13303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728ff7f7b916431596bad2058abcff08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.104684 13302 tablet_service.cc:1511] Processing CreateTablet for tablet ceab57fea69f4fb2b92768c69ccf1acd (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:55.106142 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceab57fea69f4fb2b92768c69ccf1acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.106493 13301 tablet_service.cc:1511] Processing CreateTablet for tablet 3947397e0615475ca34744de551446cc (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:55.107872 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3947397e0615475ca34744de551446cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.111042 13300 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5c4ef154104170b8d7cc738da7ef6b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:55.112443 13300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5c4ef154104170b8d7cc738da7ef6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.112116 13376 tablet_service.cc:1511] Processing CreateTablet for tablet e62a312762f44d1fa9089e42d4241ffe (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:55.113610 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62a312762f44d1fa9089e42d4241ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.115617 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 728ff7f7b916431596bad2058abcff08 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:28:55.116966 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 728ff7f7b916431596bad2058abcff08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.120585 13228 tablet_service.cc:1511] Processing CreateTablet for tablet ceab57fea69f4fb2b92768c69ccf1acd (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:55.121944 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceab57fea69f4fb2b92768c69ccf1acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.122022 13299 tablet_service.cc:1511] Processing CreateTablet for tablet de739c8902184de3b342f8d748c12a0e (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:55.123481 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de739c8902184de3b342f8d748c12a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.123386 13227 tablet_service.cc:1511] Processing CreateTablet for tablet e62a312762f44d1fa9089e42d4241ffe (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:55.125865 13226 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5c4ef154104170b8d7cc738da7ef6b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:55.128571 13375 tablet_service.cc:1511] Processing CreateTablet for tablet 3947397e0615475ca34744de551446cc (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:55.129976 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3947397e0615475ca34744de551446cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.132623 13225 tablet_service.cc:1511] Processing CreateTablet for tablet ce26cf9001dc430da555ebca2768adca (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:55.136565 13374 tablet_service.cc:1511] Processing CreateTablet for tablet ce26cf9001dc430da555ebca2768adca (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:55.137905 13374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce26cf9001dc430da555ebca2768adca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.140595 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 40227371d9284c11a346c1bf59ce0837 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:55.142279 13373 tablet_service.cc:1511] Processing CreateTablet for tablet de739c8902184de3b342f8d748c12a0e (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:55.143850 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de739c8902184de3b342f8d748c12a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.147212 13298 tablet_service.cc:1511] Processing CreateTablet for tablet 40227371d9284c11a346c1bf59ce0837 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:55.148605 13298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40227371d9284c11a346c1bf59ce0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.155756 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce26cf9001dc430da555ebca2768adca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.159761 13227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62a312762f44d1fa9089e42d4241ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.163069 13226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5c4ef154104170b8d7cc738da7ef6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.167896 13372 tablet_service.cc:1511] Processing CreateTablet for tablet 40227371d9284c11a346c1bf59ce0837 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:28:55.169256 13372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40227371d9284c11a346c1bf59ce0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.171788 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40227371d9284c11a346c1bf59ce0837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.174118 13223 tablet_service.cc:1511] Processing CreateTablet for tablet 687b69d2c0ed4789a4464687de621d9f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:55.175529 13223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687b69d2c0ed4789a4464687de621d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.186756 13299 tablet_service.cc:1511] Processing CreateTablet for tablet 687b69d2c0ed4789a4464687de621d9f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:55.188166 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687b69d2c0ed4789a4464687de621d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.189086 13153 tablet_service.cc:1511] Processing CreateTablet for tablet e62a312762f44d1fa9089e42d4241ffe (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:28:55.190445 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e62a312762f44d1fa9089e42d4241ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.192119 13154 tablet_service.cc:1511] Processing CreateTablet for tablet ceab57fea69f4fb2b92768c69ccf1acd (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:28:55.193589 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ceab57fea69f4fb2b92768c69ccf1acd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.213086 13152 tablet_service.cc:1511] Processing CreateTablet for tablet 3947397e0615475ca34744de551446cc (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:28:55.214704 13152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3947397e0615475ca34744de551446cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.216656 13151 tablet_service.cc:1511] Processing CreateTablet for tablet 7a5c4ef154104170b8d7cc738da7ef6b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:28:55.218060 13151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a5c4ef154104170b8d7cc738da7ef6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.220608 13149 tablet_service.cc:1511] Processing CreateTablet for tablet de739c8902184de3b342f8d748c12a0e (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:28:55.221962 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de739c8902184de3b342f8d748c12a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.223624 13150 tablet_service.cc:1511] Processing CreateTablet for tablet ce26cf9001dc430da555ebca2768adca (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:28:55.225059 13150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce26cf9001dc430da555ebca2768adca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.235287 13429 tablet_bootstrap.cc:492] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:55.251685 13371 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3ee9867f0f4c9983ee1092284810a2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:55.253074 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3ee9867f0f4c9983ee1092284810a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.281747 13222 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3ee9867f0f4c9983ee1092284810a2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:55.283221 13222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3ee9867f0f4c9983ee1092284810a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.283758 13298 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3f1c6c0d994184845443c82d412358 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:55.285000 13298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3f1c6c0d994184845443c82d412358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.293216 13148 tablet_service.cc:1511] Processing CreateTablet for tablet 687b69d2c0ed4789a4464687de621d9f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:28:55.294715 13148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687b69d2c0ed4789a4464687de621d9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.302882 13373 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3f1c6c0d994184845443c82d412358 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:55.304445 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3f1c6c0d994184845443c82d412358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.308663 13147 tablet_service.cc:1511] Processing CreateTablet for tablet 6e3ee9867f0f4c9983ee1092284810a2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:28:55.310066 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e3ee9867f0f4c9983ee1092284810a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.322876 13221 tablet_service.cc:1511] Processing CreateTablet for tablet f5b079a944f8482f9dcfbc01251b99ad (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:55.324394 13221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b079a944f8482f9dcfbc01251b99ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.342891 13430 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:55.347474 13431 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:55.347656 13376 tablet_service.cc:1511] Processing CreateTablet for tablet f5b079a944f8482f9dcfbc01251b99ad (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:55.348609 13146 tablet_service.cc:1511] Processing CreateTablet for tablet 3f3f1c6c0d994184845443c82d412358 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:28:55.350013 13146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f3f1c6c0d994184845443c82d412358. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.354279 13431 tablet_bootstrap.cc:654] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.359035 13371 tablet_service.cc:1511] Processing CreateTablet for tablet 16ba90b55562461497d50428e607bda4 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:55.361063 13145 tablet_service.cc:1511] Processing CreateTablet for tablet b37e0af275194677a945f05707b8be1b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:55.362422 13145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37e0af275194677a945f05707b8be1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.363610 13225 tablet_service.cc:1511] Processing CreateTablet for tablet b37e0af275194677a945f05707b8be1b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:55.368620 13220 tablet_service.cc:1511] Processing CreateTablet for tablet 16ba90b55562461497d50428e607bda4 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:55.364869 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37e0af275194677a945f05707b8be1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.374176 13298 tablet_service.cc:1511] Processing CreateTablet for tablet 3ada84c8013e4ff38f38e094b8c7f161 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:55.376513 13298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ada84c8013e4ff38f38e094b8c7f161. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:55.374615 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:55.377885 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ba90b55562461497d50428e607bda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.378185 13301 tablet_service.cc:1511] Processing CreateTablet for tablet f5b079a944f8482f9dcfbc01251b99ad (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:28:55.383317 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b079a944f8482f9dcfbc01251b99ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.379889 13149 tablet_service.cc:1511] Processing CreateTablet for tablet 16ba90b55562461497d50428e607bda4 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:28:55.375142 13431 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:55.384263 13431 ts_tablet_manager.cc:1403] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.008s
I20260709 12:28:55.385707 13430 tablet_bootstrap.cc:654] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.379729 13299 tablet_service.cc:1511] Processing CreateTablet for tablet b37e0af275194677a945f05707b8be1b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:28:55.386656 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ba90b55562461497d50428e607bda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.387651 13431 raft_consensus.cc:359] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.399881 13431 raft_consensus.cc:385] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:55.400228 13431 raft_consensus.cc:740] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:55.400986 13431 consensus_queue.cc:260] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.349049 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5b079a944f8482f9dcfbc01251b99ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.398373 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b37e0af275194677a945f05707b8be1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.407981 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16ba90b55562461497d50428e607bda4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.420169 13373 tablet_service.cc:1511] Processing CreateTablet for tablet 3ada84c8013e4ff38f38e094b8c7f161 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:55.421674 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ada84c8013e4ff38f38e094b8c7f161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.432374 13429 tablet_bootstrap.cc:654] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.438666 13152 tablet_service.cc:1511] Processing CreateTablet for tablet 3ada84c8013e4ff38f38e094b8c7f161 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:28:55.440035 13152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ada84c8013e4ff38f38e094b8c7f161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.445917 13225 tablet_service.cc:1511] Processing CreateTablet for tablet c9028d57790342829a18f33502b1c412 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:55.447221 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9028d57790342829a18f33502b1c412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.445784 13433 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:55.445957 13299 tablet_service.cc:1511] Processing CreateTablet for tablet c9028d57790342829a18f33502b1c412 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:55.452847 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9028d57790342829a18f33502b1c412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.473151 13430 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:55.473716 13430 ts_tablet_manager.cc:1403] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.131s	user 0.015s	sys 0.016s
I20260709 12:28:55.478886 13264 heartbeater.cc:499] Master 127.7.23.126:43005 was elected leader, sending a full tablet report...
I20260709 12:28:55.479698 13433 tablet_bootstrap.cc:654] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.483592 13431 ts_tablet_manager.cc:1434] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.099s	user 0.012s	sys 0.003s
I20260709 12:28:55.483978 13430 raft_consensus.cc:359] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.484594 13431 tablet_bootstrap.cc:492] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:55.484746 13430 raft_consensus.cc:385] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:55.485112 13430 raft_consensus.cc:740] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:55.485836 13430 consensus_queue.cc:260] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.490609 13149 tablet_service.cc:1511] Processing CreateTablet for tablet 2a904f1936a742d3a76ba3c33921147b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:55.491974 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a904f1936a742d3a76ba3c33921147b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.496188 13376 tablet_service.cc:1511] Processing CreateTablet for tablet c9028d57790342829a18f33502b1c412 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:28:55.497496 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9028d57790342829a18f33502b1c412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.497282 13371 tablet_service.cc:1511] Processing CreateTablet for tablet dc51d4b5af42468e901c06d37a30ea2b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:55.498574 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc51d4b5af42468e901c06d37a30ea2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.501389 13298 tablet_service.cc:1511] Processing CreateTablet for tablet 2a904f1936a742d3a76ba3c33921147b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:55.505447 13299 tablet_service.cc:1511] Processing CreateTablet for tablet 2415dad8fe444e70843baac50519f73c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:55.509682 13375 tablet_service.cc:1511] Processing CreateTablet for tablet 2415dad8fe444e70843baac50519f73c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:55.506930 13222 tablet_service.cc:1511] Processing CreateTablet for tablet dc51d4b5af42468e901c06d37a30ea2b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:55.520392 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2415dad8fe444e70843baac50519f73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.522924 13429 tablet_bootstrap.cc:492] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:55.523509 13429 ts_tablet_manager.cc:1403] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.289s	user 0.019s	sys 0.003s
I20260709 12:28:55.526625 13429 raft_consensus.cc:359] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.527386 13429 raft_consensus.cc:385] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:55.529978 13429 raft_consensus.cc:740] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:55.529343 13153 tablet_service.cc:1511] Processing CreateTablet for tablet 2415dad8fe444e70843baac50519f73c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:28:55.529397 13225 tablet_service.cc:1511] Processing CreateTablet for tablet 2a904f1936a742d3a76ba3c33921147b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:28:55.532557 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2415dad8fe444e70843baac50519f73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.536398 13220 tablet_service.cc:1511] Processing CreateTablet for tablet a9b658edca804986a4f3a9879589f0d2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:55.536646 13429 consensus_queue.cc:260] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.545564 13433 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:55.547303 13433 ts_tablet_manager.cc:1403] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.005s
I20260709 12:28:55.532773 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a904f1936a742d3a76ba3c33921147b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.551457 13222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc51d4b5af42468e901c06d37a30ea2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.553755 13301 tablet_service.cc:1511] Processing CreateTablet for tablet a9b658edca804986a4f3a9879589f0d2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:55.555806 13376 tablet_service.cc:1511] Processing CreateTablet for tablet a9b658edca804986a4f3a9879589f0d2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:28:55.557066 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b658edca804986a4f3a9879589f0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.557783 13154 tablet_service.cc:1511] Processing CreateTablet for tablet fde9f8bf8cdf4ce08f666bdc04a7c318 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:55.559082 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde9f8bf8cdf4ce08f666bdc04a7c318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.559751 13229 tablet_service.cc:1511] Processing CreateTablet for tablet fde9f8bf8cdf4ce08f666bdc04a7c318 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:55.561007 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde9f8bf8cdf4ce08f666bdc04a7c318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.516237 13431 tablet_bootstrap.cc:654] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.510995 13147 tablet_service.cc:1511] Processing CreateTablet for tablet dc51d4b5af42468e901c06d37a30ea2b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:28:55.566941 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b658edca804986a4f3a9879589f0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.567221 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc51d4b5af42468e901c06d37a30ea2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.520310 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2415dad8fe444e70843baac50519f73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.570971 13189 heartbeater.cc:499] Master 127.7.23.126:43005 was elected leader, sending a full tablet report...
I20260709 12:28:55.577240 13303 tablet_service.cc:1511] Processing CreateTablet for tablet fde9f8bf8cdf4ce08f666bdc04a7c318 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:28:55.577389 13433 raft_consensus.cc:359] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.578285 13433 raft_consensus.cc:385] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:55.578680 13433 raft_consensus.cc:740] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:55.579514 13433 consensus_queue.cc:260] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.580292 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b658edca804986a4f3a9879589f0d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.581008 13303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde9f8bf8cdf4ce08f666bdc04a7c318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.604458 13298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a904f1936a742d3a76ba3c33921147b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.623451 13224 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff0db3c14eb4efaa3564a8f703a3936 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:55.624840 13224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff0db3c14eb4efaa3564a8f703a3936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.628244 13412 heartbeater.cc:499] Master 127.7.23.126:43005 was elected leader, sending a full tablet report...
I20260709 12:28:55.630672 13429 ts_tablet_manager.cc:1434] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.107s	user 0.010s	sys 0.015s
I20260709 12:28:55.631377 13338 heartbeater.cc:499] Master 127.7.23.126:43005 was elected leader, sending a full tablet report...
I20260709 12:28:55.628299 13373 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff0db3c14eb4efaa3564a8f703a3936 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:28:55.635156 13265 tablet.cc:2406] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:55.635738 13429 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:55.623205 13149 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff0db3c14eb4efaa3564a8f703a3936 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:28:55.644048 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff0db3c14eb4efaa3564a8f703a3936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.646129 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff0db3c14eb4efaa3564a8f703a3936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.656140 13438 raft_consensus.cc:493] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.656689 13438 raft_consensus.cc:515] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.657267 13302 tablet_service.cc:1511] Processing CreateTablet for tablet dda9b6a2c2c84f739db973e6a815c956 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:55.658576 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda9b6a2c2c84f739db973e6a815c956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.665181 13433 ts_tablet_manager.cc:1434] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.117s	user 0.013s	sys 0.020s
I20260709 12:28:55.666359 13433 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:55.683449 13433 tablet_bootstrap.cc:654] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.657130 13430 ts_tablet_manager.cc:1434] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.183s	user 0.004s	sys 0.055s
I20260709 12:28:55.702545 13376 tablet_service.cc:1511] Processing CreateTablet for tablet dda9b6a2c2c84f739db973e6a815c956 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:55.703899 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda9b6a2c2c84f739db973e6a815c956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.698227 13438 leader_election.cc:290] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:55.717994 13430 tablet_bootstrap.cc:492] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:55.718410 13154 tablet_service.cc:1511] Processing CreateTablet for tablet dda9b6a2c2c84f739db973e6a815c956 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:28:55.719871 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda9b6a2c2c84f739db973e6a815c956. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.726071 13440 raft_consensus.cc:493] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.726626 13299 tablet_service.cc:1511] Processing CreateTablet for tablet b76c1b0221c64d12960e29e5cb59e771 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:55.727557 13220 tablet_service.cc:1511] Processing CreateTablet for tablet b76c1b0221c64d12960e29e5cb59e771 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:55.728394 13375 tablet_service.cc:1511] Processing CreateTablet for tablet b76c1b0221c64d12960e29e5cb59e771 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:28:55.728796 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76c1b0221c64d12960e29e5cb59e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.729638 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76c1b0221c64d12960e29e5cb59e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.729928 13147 tablet_service.cc:1511] Processing CreateTablet for tablet c9e399f6ac1043a89507e6aaab9a2d78 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:55.730417 13225 tablet_service.cc:1511] Processing CreateTablet for tablet c9e399f6ac1043a89507e6aaab9a2d78 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:55.731128 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e399f6ac1043a89507e6aaab9a2d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.731673 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e399f6ac1043a89507e6aaab9a2d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.726665 13440 raft_consensus.cc:515] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.727936 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76c1b0221c64d12960e29e5cb59e771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.738927 13429 tablet_bootstrap.cc:654] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.735927 13440 leader_election.cc:290] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:55.759001 13302 tablet_service.cc:1511] Processing CreateTablet for tablet c9e399f6ac1043a89507e6aaab9a2d78 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:28:55.760479 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9e399f6ac1043a89507e6aaab9a2d78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.759071 13431 tablet_bootstrap.cc:492] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:55.764026 13431 ts_tablet_manager.cc:1403] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.280s	user 0.014s	sys 0.001s
I20260709 12:28:55.767378 13431 raft_consensus.cc:359] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:55.768160 13431 raft_consensus.cc:385] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:55.768499 13431 raft_consensus.cc:740] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:55.769248 13431 consensus_queue.cc:260] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:55.777058 13371 tablet_service.cc:1511] Processing CreateTablet for tablet f143366d33a942e6a4da9183209575b2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:55.778571 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f143366d33a942e6a4da9183209575b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.784996 13433 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:55.785563 13433 ts_tablet_manager.cc:1403] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.119s	user 0.032s	sys 0.024s
I20260709 12:28:55.788269 13435 raft_consensus.cc:493] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.788862 13435 raft_consensus.cc:515] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.790795 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:55.791740 13435 leader_election.cc:290] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:55.806905 13430 tablet_bootstrap.cc:654] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.831261 13152 tablet_service.cc:1511] Processing CreateTablet for tablet f143366d33a942e6a4da9183209575b2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:55.832772 13152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f143366d33a942e6a4da9183209575b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.850744 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:28:55.854609 13353 leader_election.cc:343] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:55.855851 13229 tablet_service.cc:1511] Processing CreateTablet for tablet f143366d33a942e6a4da9183209575b2 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:28:55.857412 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f143366d33a942e6a4da9183209575b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.874073 13431 ts_tablet_manager.cc:1434] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.110s	user 0.003s	sys 0.005s
I20260709 12:28:55.882091 13303 tablet_service.cc:1511] Processing CreateTablet for tablet 0445e72cb4464ff69b4fe5e1e67f061b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:55.884294 13431 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:55.884120 13146 tablet_service.cc:1511] Processing CreateTablet for tablet 0445e72cb4464ff69b4fe5e1e67f061b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:55.885453 13146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0445e72cb4464ff69b4fe5e1e67f061b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.887497 13439 raft_consensus.cc:493] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:55.888058 13439 raft_consensus.cc:515] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:55.890774 13439 leader_election.cc:290] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:55.891384 13431 tablet_bootstrap.cc:654] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:55.895830 13303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0445e72cb4464ff69b4fe5e1e67f061b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.906250 13222 tablet_service.cc:1511] Processing CreateTablet for tablet 30647cb538f54daea2c91dc8a1708e5f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:55.907949 13222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30647cb538f54daea2c91dc8a1708e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.915802 13433 raft_consensus.cc:359] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:55.916435 13429 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:55.931331 13153 tablet_service.cc:1511] Processing CreateTablet for tablet 342a1932e1f84a15837148bd0ca8d0c8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:55.944247 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342a1932e1f84a15837148bd0ca8d0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.931586 13301 tablet_service.cc:1511] Processing CreateTablet for tablet 30647cb538f54daea2c91dc8a1708e5f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:55.949082 13376 tablet_service.cc:1511] Processing CreateTablet for tablet 30647cb538f54daea2c91dc8a1708e5f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:28:55.950415 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30647cb538f54daea2c91dc8a1708e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.952158 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 342a1932e1f84a15837148bd0ca8d0c8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:55.952553 13298 tablet_service.cc:1511] Processing CreateTablet for tablet 342a1932e1f84a15837148bd0ca8d0c8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:28:55.952757 13373 tablet_service.cc:1511] Processing CreateTablet for tablet 0445e72cb4464ff69b4fe5e1e67f061b (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:28:55.953480 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342a1932e1f84a15837148bd0ca8d0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.954494 13375 tablet_service.cc:1511] Processing CreateTablet for tablet 5f012632e884464d8749351b0ca69fef (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:55.959774 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0445e72cb4464ff69b4fe5e1e67f061b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.960273 13429 ts_tablet_manager.cc:1403] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.325s	user 0.013s	sys 0.011s
I20260709 12:28:55.963858 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f012632e884464d8749351b0ca69fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.950358 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30647cb538f54daea2c91dc8a1708e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.971762 13298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 342a1932e1f84a15837148bd0ca8d0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:55.921263 13433 raft_consensus.cc:385] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:55.973363 13433 raft_consensus.cc:740] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:55.974221 13433 consensus_queue.cc:260] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:55.976455 13433 ts_tablet_manager.cc:1434] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.191s	user 0.004s	sys 0.004s
I20260709 12:28:55.984294 13429 raft_consensus.cc:359] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:55.985080 13429 raft_consensus.cc:385] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:55.985390 13429 raft_consensus.cc:740] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:55.986178 13429 consensus_queue.cc:260] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:55.992830 13429 ts_tablet_manager.cc:1434] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:28:55.997781 13300 tablet_service.cc:1511] Processing CreateTablet for tablet 215896cbd30347de953b41e58793fe69 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:55.999228 13300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215896cbd30347de953b41e58793fe69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.001480 13372 tablet_service.cc:1511] Processing CreateTablet for tablet 215896cbd30347de953b41e58793fe69 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:56.002209 13149 tablet_service.cc:1511] Processing CreateTablet for tablet 215896cbd30347de953b41e58793fe69 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:28:56.002779 13372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215896cbd30347de953b41e58793fe69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.002187 13154 tablet_service.cc:1511] Processing CreateTablet for tablet 5f012632e884464d8749351b0ca69fef (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:28:56.012346 13352 leader_election.cc:343] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.012884 13352 leader_election.cc:304] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:56.014015 13438 raft_consensus.cc:2749] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.016390 13228 tablet_service.cc:1511] Processing CreateTablet for tablet efa7a585187844a68f08b1d640f1cf7c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:56.017738 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa7a585187844a68f08b1d640f1cf7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.025563 13429 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:56.027380 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f012632e884464d8749351b0ca69fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.031940 13435 raft_consensus.cc:493] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.032471 13435 raft_consensus.cc:515] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:56.034832 13435 leader_election.cc:290] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:56.039637 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:56.042717 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:56.044112 13225 tablet_service.cc:1511] Processing CreateTablet for tablet 5f012632e884464d8749351b0ca69fef (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:28:56.045619 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f012632e884464d8749351b0ca69fef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.046432 13299 tablet_service.cc:1511] Processing CreateTablet for tablet efa7a585187844a68f08b1d640f1cf7c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:56.047734 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa7a585187844a68f08b1d640f1cf7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.049881 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:56.050554 13239 raft_consensus.cc:2468] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:56.051899 13129 leader_election.cc:304] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:28:56.052739 13440 raft_consensus.cc:2804] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:56.053110 13440 raft_consensus.cc:493] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:56.053442 13440 raft_consensus.cc:3060] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.055243 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 215896cbd30347de953b41e58793fe69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.069785 13433 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:56.077343 13371 tablet_service.cc:1511] Processing CreateTablet for tablet efa7a585187844a68f08b1d640f1cf7c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:28:56.111040 13430 tablet_bootstrap.cc:492] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:56.111369 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:56.131882 13430 ts_tablet_manager.cc:1403] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.414s	user 0.009s	sys 0.032s
I20260709 12:28:56.116945 13431 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:56.117648 13302 tablet_service.cc:1511] Processing CreateTablet for tablet b8cd3149d5184714857f3c05a1fcaa4c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:56.120605 13220 tablet_service.cc:1511] Processing CreateTablet for tablet b8cd3149d5184714857f3c05a1fcaa4c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:56.122327 13147 tablet_service.cc:1511] Processing CreateTablet for tablet b8cd3149d5184714857f3c05a1fcaa4c (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:28:56.128907 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
W20260709 12:28:56.076766 13202 leader_election.cc:343] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.130184 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:56.135951 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8cd3149d5184714857f3c05a1fcaa4c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:56.135910 13202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 69027.6us
I20260709 12:28:56.135468 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efa7a585187844a68f08b1d640f1cf7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.137296 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8cd3149d5184714857f3c05a1fcaa4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.130486 13440 raft_consensus.cc:515] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:28:56.133054 13127 leader_election.cc:343] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.130498 13429 tablet_bootstrap.cc:654] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.141536 13153 tablet_service.cc:1511] Processing CreateTablet for tablet 42bae5aac3664bdaae25c1b0bd68ed08 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:28:56.136699 13202 leader_election.cc:343] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.142864 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bae5aac3664bdaae25c1b0bd68ed08. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:56.146904 13276 leader_election.cc:343] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.147200 13164 raft_consensus.cc:2393] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:28:56.148154 13431 ts_tablet_manager.cc:1403] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.264s	user 0.017s	sys 0.000s
I20260709 12:28:56.149140 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
W20260709 12:28:56.150578 13127 leader_election.cc:343] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.151039 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:56.152591 13278 leader_election.cc:343] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.153141 13278 leader_election.cc:304] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:56.151119 13372 tablet_service.cc:1511] Processing CreateTablet for tablet 42bae5aac3664bdaae25c1b0bd68ed08 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:28:56.153980 13439 raft_consensus.cc:2749] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.154657 13372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bae5aac3664bdaae25c1b0bd68ed08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.156792 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8cd3149d5184714857f3c05a1fcaa4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.188280 13430 raft_consensus.cc:359] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.189405 13440 leader_election.cc:290] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:56.190546 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:56.194339 13431 raft_consensus.cc:359] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.201294 13239 raft_consensus.cc:3060] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.201357 13431 raft_consensus.cc:385] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.201923 13431 raft_consensus.cc:740] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.195623 13429 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:56.204557 13429 ts_tablet_manager.cc:1403] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.181s	user 0.010s	sys 0.011s
I20260709 12:28:56.201395 13440 raft_consensus.cc:493] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.211614 13375 tablet_service.cc:1511] Processing CreateTablet for tablet 51330eddaa8145f9931042b9bfb80ff8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:56.212904 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51330eddaa8145f9931042b9bfb80ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.214741 13429 raft_consensus.cc:359] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
W20260709 12:28:56.197690 13049 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 51556.8us
I20260709 12:28:56.209514 13440 raft_consensus.cc:515] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.218472 13440 leader_election.cc:290] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:56.219580 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de739c8902184de3b342f8d748c12a0e" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:56.219767 13300 tablet_service.cc:1511] Processing CreateTablet for tablet 51330eddaa8145f9931042b9bfb80ff8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:56.209553 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 42bae5aac3664bdaae25c1b0bd68ed08 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:28:56.221002 13127 leader_election.cc:343] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.212826 13239 raft_consensus.cc:2468] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:56.221432 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42bae5aac3664bdaae25c1b0bd68ed08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.222432 13129 leader_election.cc:304] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:56.215934 13429 raft_consensus.cc:385] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.223624 13429 raft_consensus.cc:740] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.223713 13440 raft_consensus.cc:2804] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:56.197232 13433 tablet_bootstrap.cc:654] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.224365 13440 raft_consensus.cc:697] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:28:56.225592 13440 consensus_queue.cc:237] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.225704 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 530182bf3a3f45e99ccc864a7f931043 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:56.198267 13205 leader_election.cc:304] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:56.228075 13149 tablet_service.cc:1511] Processing CreateTablet for tablet 51330eddaa8145f9931042b9bfb80ff8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:28:56.227820 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530182bf3a3f45e99ccc864a7f931043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.228451 13435 raft_consensus.cc:2749] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.229311 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51330eddaa8145f9931042b9bfb80ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.189144 13430 raft_consensus.cc:385] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.230458 13430 raft_consensus.cc:740] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
W20260709 12:28:56.228627 13205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 78830.1us
I20260709 12:28:56.234347 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
W20260709 12:28:56.235896 13205 leader_election.cc:343] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.235673 13430 consensus_queue.cc:260] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.236466 13205 leader_election.cc:304] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:56.237788 13435 raft_consensus.cc:2749] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.221220 13300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51330eddaa8145f9931042b9bfb80ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.238521 13429 consensus_queue.cc:260] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.207060 13431 consensus_queue.cc:260] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.257751 13431 ts_tablet_manager.cc:1434] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.109s	user 0.015s	sys 0.001s
I20260709 12:28:56.259761 13430 ts_tablet_manager.cc:1434] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.128s	user 0.011s	sys 0.008s
I20260709 12:28:56.260833 13430 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:56.262591 13429 ts_tablet_manager.cc:1434] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.007s
I20260709 12:28:56.263729 13429 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:56.263695 13060 catalog_manager.cc:5697] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:56.278957 13429 tablet_bootstrap.cc:654] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.284415 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de739c8902184de3b342f8d748c12a0e" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
W20260709 12:28:56.286087 13130 leader_election.cc:343] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.286589 13130 leader_election.cc:304] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:56.291986 13440 raft_consensus.cc:2749] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.295065 13302 tablet_service.cc:1511] Processing CreateTablet for tablet 530182bf3a3f45e99ccc864a7f931043 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:56.296442 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530182bf3a3f45e99ccc864a7f931043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.296768 13430 tablet_bootstrap.cc:654] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.316847 13375 tablet_service.cc:1511] Processing CreateTablet for tablet 530182bf3a3f45e99ccc864a7f931043 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:28:56.318466 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 530182bf3a3f45e99ccc864a7f931043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.321429 13149 tablet_service.cc:1511] Processing CreateTablet for tablet f8343dc9896d484a95b73406414546bf (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:56.322901 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8343dc9896d484a95b73406414546bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.312141 13431 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:56.339607 13229 tablet_service.cc:1511] Processing CreateTablet for tablet f8343dc9896d484a95b73406414546bf (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:56.340919 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8343dc9896d484a95b73406414546bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.340821 13299 tablet_service.cc:1511] Processing CreateTablet for tablet f8343dc9896d484a95b73406414546bf (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:28:56.345901 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8343dc9896d484a95b73406414546bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.346194 13371 tablet_service.cc:1511] Processing CreateTablet for tablet 80ea8d04a10d4404b3a0dad7e62a595f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:56.348121 13225 tablet_service.cc:1511] Processing CreateTablet for tablet 80ea8d04a10d4404b3a0dad7e62a595f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:56.348702 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80ea8d04a10d4404b3a0dad7e62a595f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.343505 13147 tablet_service.cc:1511] Processing CreateTablet for tablet 80ea8d04a10d4404b3a0dad7e62a595f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:28:56.346655 13433 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:56.352025 13433 ts_tablet_manager.cc:1403] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.285s	user 0.032s	sys 0.021s
I20260709 12:28:56.352670 13300 tablet_service.cc:1511] Processing CreateTablet for tablet 9c840c65e2e544c89a82d480e518a745 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:56.353928 13300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c840c65e2e544c89a82d480e518a745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.351356 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80ea8d04a10d4404b3a0dad7e62a595f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.356045 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80ea8d04a10d4404b3a0dad7e62a595f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.355197 13433 raft_consensus.cc:359] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.364537 13433 raft_consensus.cc:385] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.364845 13433 raft_consensus.cc:740] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.366097 13373 tablet_service.cc:1511] Processing CreateTablet for tablet 9c840c65e2e544c89a82d480e518a745 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:56.367064 13154 tablet_service.cc:1511] Processing CreateTablet for tablet 9c840c65e2e544c89a82d480e518a745 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:28:56.367390 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c840c65e2e544c89a82d480e518a745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.368388 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c840c65e2e544c89a82d480e518a745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.374898 13433 consensus_queue.cc:260] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.378638 13431 tablet_bootstrap.cc:654] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.380220 13433 ts_tablet_manager.cc:1434] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:28:56.381428 13433 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:56.385407 13228 tablet_service.cc:1511] Processing CreateTablet for tablet b8f2402480454364bf123ad3e9b49cb8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:56.386838 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f2402480454364bf123ad3e9b49cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.392321 13301 tablet_service.cc:1511] Processing CreateTablet for tablet b8f2402480454364bf123ad3e9b49cb8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:28:56.402451 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:56.403503 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f2402480454364bf123ad3e9b49cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.403708 13153 tablet_service.cc:1511] Processing CreateTablet for tablet 146bc2757b61443cbd22d2ee03b646f1 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:56.404011 13376 tablet_service.cc:1511] Processing CreateTablet for tablet b8f2402480454364bf123ad3e9b49cb8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:28:56.404980 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146bc2757b61443cbd22d2ee03b646f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.405138 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8f2402480454364bf123ad3e9b49cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.408784 13430 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:56.409304 13430 ts_tablet_manager.cc:1403] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.027s
I20260709 12:28:56.412470 13430 raft_consensus.cc:359] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.413132 13430 raft_consensus.cc:385] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.413419 13430 raft_consensus.cc:740] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.424902 13429 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:56.425514 13430 consensus_queue.cc:260] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.425535 13429 ts_tablet_manager.cc:1403] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.162s	user 0.018s	sys 0.017s
I20260709 12:28:56.428719 13220 tablet_service.cc:1511] Processing CreateTablet for tablet 146bc2757b61443cbd22d2ee03b646f1 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:56.429977 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146bc2757b61443cbd22d2ee03b646f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.437531 13429 raft_consensus.cc:359] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.438328 13429 raft_consensus.cc:385] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.438618 13429 raft_consensus.cc:740] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.439343 13429 consensus_queue.cc:260] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.441637 13431 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:56.442167 13431 ts_tablet_manager.cc:1403] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.010s
I20260709 12:28:56.451571 13439 raft_consensus.cc:493] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.452107 13439 raft_consensus.cc:515] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.452623 13430 ts_tablet_manager.cc:1434] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:28:56.461021 13430 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:56.474620 13299 tablet_service.cc:1511] Processing CreateTablet for tablet 146bc2757b61443cbd22d2ee03b646f1 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:28:56.477638 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146bc2757b61443cbd22d2ee03b646f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.481268 13371 tablet_service.cc:1511] Processing CreateTablet for tablet 68eb6588fa0842bd812b9f8976b51d79 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:56.482282 13147 tablet_service.cc:1511] Processing CreateTablet for tablet 68eb6588fa0842bd812b9f8976b51d79 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:56.482801 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68eb6588fa0842bd812b9f8976b51d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.483625 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68eb6588fa0842bd812b9f8976b51d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.425076 13433 tablet_bootstrap.cc:654] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.485219 13439 leader_election.cc:290] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:56.485754 13439 raft_consensus.cc:493] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.486212 13439 raft_consensus.cc:515] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.490252 13431 raft_consensus.cc:359] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.491003 13431 raft_consensus.cc:385] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.492846 13429 ts_tablet_manager.cc:1434] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.066s	user 0.000s	sys 0.007s
I20260709 12:28:56.498598 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 68eb6588fa0842bd812b9f8976b51d79 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:28:56.499944 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68eb6588fa0842bd812b9f8976b51d79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.500489 13429 tablet_bootstrap.cc:492] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:56.501386 13430 tablet_bootstrap.cc:654] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.502681 13435 raft_consensus.cc:493] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.503204 13435 raft_consensus.cc:515] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.491294 13431 raft_consensus.cc:740] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.503948 13439 leader_election.cc:290] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:56.519207 13438 raft_consensus.cc:493] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.519897 13438 raft_consensus.cc:515] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.522213 13438 leader_election.cc:290] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:56.522327 13301 tablet_service.cc:1511] Processing CreateTablet for tablet e7189f0f0b184d46b795d6b9f0fb88e3 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:56.523746 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7189f0f0b184d46b795d6b9f0fb88e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.526082 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:56.527648 13352 leader_election.cc:343] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.528626 13433 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:56.529089 13371 tablet_service.cc:1511] Processing CreateTablet for tablet e7189f0f0b184d46b795d6b9f0fb88e3 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:56.530431 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7189f0f0b184d46b795d6b9f0fb88e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.532444 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 75960847d868465384c0cdc655302584 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:56.533896 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75960847d868465384c0cdc655302584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.505234 13435 leader_election.cc:290] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:56.506745 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:56.505199 13300 tablet_service.cc:1511] Processing CreateTablet for tablet a029386535a847ed873d186c825ac92a (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:56.507072 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:56.537118 13300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a029386535a847ed873d186c825ac92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.511200 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:56.541378 13147 tablet_service.cc:1511] Processing CreateTablet for tablet 75960847d868465384c0cdc655302584 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:56.541829 13302 tablet_service.cc:1511] Processing CreateTablet for tablet 75960847d868465384c0cdc655302584 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:28:56.529139 13433 ts_tablet_manager.cc:1403] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.148s	user 0.004s	sys 0.007s
I20260709 12:28:56.542608 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75960847d868465384c0cdc655302584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.514465 13154 tablet_service.cc:1511] Processing CreateTablet for tablet a029386535a847ed873d186c825ac92a (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:28:56.537945 13205 leader_election.cc:343] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.511662 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:56.543128 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75960847d868465384c0cdc655302584. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.518683 13220 tablet_service.cc:1511] Processing CreateTablet for tablet e7189f0f0b184d46b795d6b9f0fb88e3 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:28:56.545687 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7189f0f0b184d46b795d6b9f0fb88e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.537240 13429 tablet_bootstrap.cc:654] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:56.544028 13205 leader_election.cc:343] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.546240 13433 raft_consensus.cc:359] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.547659 13205 leader_election.cc:304] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:56.547930 13433 raft_consensus.cc:385] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.548311 13433 raft_consensus.cc:740] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
W20260709 12:28:56.548913 13278 leader_election.cc:343] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.549592 13435 raft_consensus.cc:2749] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.549180 13433 consensus_queue.cc:260] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.542624 13376 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd0a7112fea4d999c0ddebe3a4a74a0 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:56.551942 13433 ts_tablet_manager.cc:1434] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:28:56.552891 13376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd0a7112fea4d999c0ddebe3a4a74a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.553963 13433 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:56.508176 13375 tablet_service.cc:1511] Processing CreateTablet for tablet a029386535a847ed873d186c825ac92a (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:28:56.557231 13149 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd0a7112fea4d999c0ddebe3a4a74a0 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:56.547758 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a029386535a847ed873d186c825ac92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.504777 13431 consensus_queue.cc:260] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.559185 13239 raft_consensus.cc:2468] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:56.561070 13278 leader_election.cc:304] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:56.563146 13225 tablet_service.cc:1511] Processing CreateTablet for tablet 1bd0a7112fea4d999c0ddebe3a4a74a0 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:28:56.563970 13149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd0a7112fea4d999c0ddebe3a4a74a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.564404 13225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd0a7112fea4d999c0ddebe3a4a74a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.564947 13439 raft_consensus.cc:2804] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:56.565420 13439 raft_consensus.cc:493] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:56.565737 13439 raft_consensus.cc:3060] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.557567 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a029386535a847ed873d186c825ac92a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.566798 13299 tablet_service.cc:1511] Processing CreateTablet for tablet 70fae3d67b794456ad210d7e7ccbda1d (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:56.569780 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fae3d67b794456ad210d7e7ccbda1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.570416 13373 tablet_service.cc:1511] Processing CreateTablet for tablet 70fae3d67b794456ad210d7e7ccbda1d (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:56.574020 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fae3d67b794456ad210d7e7ccbda1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.577315 13153 tablet_service.cc:1511] Processing CreateTablet for tablet 70fae3d67b794456ad210d7e7ccbda1d (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:28:56.578691 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70fae3d67b794456ad210d7e7ccbda1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.581070 13431 ts_tablet_manager.cc:1434] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.139s	user 0.006s	sys 0.003s
I20260709 12:28:56.584345 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdd0c8711ba42c1bd4506afd7156e9a (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:56.585616 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdd0c8711ba42c1bd4506afd7156e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.588536 13431 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:56.603578 13298 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdd0c8711ba42c1bd4506afd7156e9a (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:56.605019 13298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdd0c8711ba42c1bd4506afd7156e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.606951 13439 raft_consensus.cc:515] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.620733 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:56.620927 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:56.621500 13164 raft_consensus.cc:2468] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
W20260709 12:28:56.622440 13279 leader_election.cc:343] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.622920 13279 leader_election.cc:304] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:56.623608 13439 leader_election.cc:290] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:56.624146 13439 raft_consensus.cc:2749] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.624954 13372 tablet_service.cc:1511] Processing CreateTablet for tablet 1cdd0c8711ba42c1bd4506afd7156e9a (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:28:56.625643 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:56.626224 13164 raft_consensus.cc:3060] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.626713 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:56.627351 13239 raft_consensus.cc:3060] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.626209 13372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cdd0c8711ba42c1bd4506afd7156e9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.633237 13164 raft_consensus.cc:2468] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:56.634836 13279 leader_election.cc:304] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:56.635761 13472 raft_consensus.cc:2804] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:56.636233 13472 raft_consensus.cc:697] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:56.637033 13472 consensus_queue.cc:237] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.637494 13239 raft_consensus.cc:2468] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:56.605089 13431 tablet_bootstrap.cc:654] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.651713 13433 tablet_bootstrap.cc:654] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.681854 13430 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:56.682436 13430 ts_tablet_manager.cc:1403] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.222s	user 0.021s	sys 0.022s
I20260709 12:28:56.683221 13429 tablet_bootstrap.cc:492] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:56.683924 13429 ts_tablet_manager.cc:1403] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.184s	user 0.022s	sys 0.011s
I20260709 12:28:56.683316 13060 catalog_manager.cc:5697] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:56.685400 13430 raft_consensus.cc:359] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.686851 13429 raft_consensus.cc:359] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:56.687628 13429 raft_consensus.cc:385] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.687914 13429 raft_consensus.cc:740] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.688655 13429 consensus_queue.cc:260] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:56.689615 13439 raft_consensus.cc:493] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.690056 13439 raft_consensus.cc:515] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.692221 13439 leader_election.cc:290] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:56.692950 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:56.693614 13313 raft_consensus.cc:2468] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:56.686108 13430 raft_consensus.cc:385] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.695084 13430 raft_consensus.cc:740] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.695604 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de739c8902184de3b342f8d748c12a0e" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:56.695894 13430 consensus_queue.cc:260] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.696630 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de739c8902184de3b342f8d748c12a0e" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:56.697331 13164 raft_consensus.cc:2468] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:56.698244 13430 ts_tablet_manager.cc:1434] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:28:56.699338 13430 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:56.698415 13154 tablet_service.cc:1511] Processing CreateTablet for tablet b29983fe14304e40925e693584d53f29 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:28:56.700742 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29983fe14304e40925e693584d53f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.702263 13279 leader_election.cc:304] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:56.703704 13353 leader_election.cc:304] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:56.705049 13438 raft_consensus.cc:2804] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:56.705453 13438 raft_consensus.cc:493] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:56.705725 13430 tablet_bootstrap.cc:654] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.705778 13438 raft_consensus.cc:3060] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.707651 13299 tablet_service.cc:1511] Processing CreateTablet for tablet b29983fe14304e40925e693584d53f29 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:28:56.708782 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29983fe14304e40925e693584d53f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.711055 13386 raft_consensus.cc:2468] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:56.719488 13440 consensus_queue.cc:1048] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:56.726807 13438 raft_consensus.cc:515] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.729581 13429 ts_tablet_manager.cc:1434] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:28:56.734457 13429 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:56.711506 13472 raft_consensus.cc:2804] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:56.738699 13472 raft_consensus.cc:493] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:56.730731 13372 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc3d02f64b7429aa081f6d4ac732e20 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:56.739101 13472 raft_consensus.cc:3060] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.740072 13372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc3d02f64b7429aa081f6d4ac732e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.742991 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:56.743819 13220 tablet_service.cc:1511] Processing CreateTablet for tablet b29983fe14304e40925e693584d53f29 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:28:56.745436 13352 leader_election.cc:343] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.745358 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29983fe14304e40925e693584d53f29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.743543 13440 raft_consensus.cc:493] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.746318 13440 raft_consensus.cc:515] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.747666 13147 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc3d02f64b7429aa081f6d4ac732e20 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:56.752580 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc3d02f64b7429aa081f6d4ac732e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.753086 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687b69d2c0ed4789a4464687de621d9f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:56.754652 13129 leader_election.cc:343] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.759378 13483 raft_consensus.cc:493] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:56.760061 13483 raft_consensus.cc:515] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.762298 13483 leader_election.cc:290] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:56.766214 13440 leader_election.cc:290] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:56.755641 13438 leader_election.cc:290] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:56.767887 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 2bc3d02f64b7429aa081f6d4ac732e20 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:28:56.769201 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bc3d02f64b7429aa081f6d4ac732e20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.773440 13301 tablet_service.cc:1511] Processing CreateTablet for tablet d1f4842692fd4f269ece83c3726dc22f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:56.775287 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f4842692fd4f269ece83c3726dc22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.779016 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687b69d2c0ed4789a4464687de621d9f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
W20260709 12:28:56.784946 13130 leader_election.cc:343] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.785400 13130 leader_election.cc:304] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:56.786141 13440 raft_consensus.cc:2749] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.789971 13472 raft_consensus.cc:515] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.773902 13429 tablet_bootstrap.cc:654] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.795452 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3f1c6c0d994184845443c82d412358" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:56.796167 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:56.796757 13313 raft_consensus.cc:3060] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.798040 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3f1c6c0d994184845443c82d412358" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
W20260709 12:28:56.798776 13353 leader_election.cc:343] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.799784 13431 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
W20260709 12:28:56.800060 13353 leader_election.cc:343] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:56.800316 13431 ts_tablet_manager.cc:1403] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.212s	user 0.010s	sys 0.009s
I20260709 12:28:56.800592 13353 leader_election.cc:304] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:56.802441 13438 raft_consensus.cc:2749] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:56.803337 13431 raft_consensus.cc:359] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.804141 13431 raft_consensus.cc:385] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.804459 13431 raft_consensus.cc:740] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.805153 13431 consensus_queue.cc:260] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:56.807132 13373 tablet_service.cc:1511] Processing CreateTablet for tablet d1f4842692fd4f269ece83c3726dc22f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:56.813580 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f4842692fd4f269ece83c3726dc22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.819501 13147 tablet_service.cc:1511] Processing CreateTablet for tablet d1f4842692fd4f269ece83c3726dc22f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:28:56.820369 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de739c8902184de3b342f8d748c12a0e" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:56.820973 13164 raft_consensus.cc:3060] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.822533 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f4842692fd4f269ece83c3726dc22f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.833640 13472 leader_election.cc:290] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:56.850431 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de739c8902184de3b342f8d748c12a0e" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:56.851202 13386 raft_consensus.cc:3060] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:56.807358 13431 ts_tablet_manager.cc:1434] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:28:56.854029 13431 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:56.864485 13433 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:56.873526 13313 raft_consensus.cc:2468] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:56.873785 13430 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:56.875027 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 62f989b065674a6b912d5fbd4f911f8f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:56.876191 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f989b065674a6b912d5fbd4f911f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.880733 13353 leader_election.cc:304] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:56.881956 13438 raft_consensus.cc:2804] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:56.879725 13430 ts_tablet_manager.cc:1403] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.181s	user 0.043s	sys 0.066s
I20260709 12:28:56.885409 13430 raft_consensus.cc:359] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.882422 13438 raft_consensus.cc:697] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:56.887838 13430 raft_consensus.cc:385] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.888521 13430 raft_consensus.cc:740] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.888288 13438 consensus_queue.cc:237] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.891623 13299 tablet_service.cc:1511] Processing CreateTablet for tablet 62f989b065674a6b912d5fbd4f911f8f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:56.875626 13433 ts_tablet_manager.cc:1403] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.322s	user 0.021s	sys 0.021s
I20260709 12:28:56.893117 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f989b065674a6b912d5fbd4f911f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.892124 13430 consensus_queue.cc:260] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.895593 13386 raft_consensus.cc:2468] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:56.896694 13276 leader_election.cc:304] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:56.898113 13430 ts_tablet_manager.cc:1434] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:28:56.899523 13472 raft_consensus.cc:2804] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:28:56.909423 13127 consensus_peers.cc:597] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 -> Peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Couldn't send request to peer fc0a5489897d4f6c8dd410cb6daee91b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:56.904832 13472 raft_consensus.cc:697] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:56.916060 13472 consensus_queue.cc:237] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:56.916750 13372 tablet_service.cc:1511] Processing CreateTablet for tablet 62f989b065674a6b912d5fbd4f911f8f (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:28:56.918033 13372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62f989b065674a6b912d5fbd4f911f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.919018 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 78cf5898f4814d6e9bc0a55599d09ea8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:56.920410 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cf5898f4814d6e9bc0a55599d09ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.920929 13061 catalog_manager.cc:5697] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:56.929663 13430 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:56.899250 13433 raft_consensus.cc:359] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:56.940740 13433 raft_consensus.cc:385] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.950187 13299 tablet_service.cc:1511] Processing CreateTablet for tablet 78cf5898f4814d6e9bc0a55599d09ea8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:56.951092 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cf5898f4814d6e9bc0a55599d09ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.952723 13433 raft_consensus.cc:740] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.954927 13375 tablet_service.cc:1511] Processing CreateTablet for tablet 2eab5a50da6542d6afd870d484d29a8e (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:56.956177 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eab5a50da6542d6afd870d484d29a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.959592 13431 tablet_bootstrap.cc:654] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.960970 13429 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:56.960777 13147 tablet_service.cc:1511] Processing CreateTablet for tablet 78cf5898f4814d6e9bc0a55599d09ea8 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:28:56.961484 13429 ts_tablet_manager.cc:1403] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.227s	user 0.022s	sys 0.025s
I20260709 12:28:56.961997 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78cf5898f4814d6e9bc0a55599d09ea8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.962430 13433 consensus_queue.cc:260] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:56.965056 13429 raft_consensus.cc:359] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:56.965664 13429 raft_consensus.cc:385] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.965902 13429 raft_consensus.cc:740] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.966617 13429 consensus_queue.cc:260] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:56.971448 13433 ts_tablet_manager.cc:1434] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 12:28:56.972604 13433 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:56.971596 13429 ts_tablet_manager.cc:1434] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:56.959215 13430 tablet_bootstrap.cc:654] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.978932 13429 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:56.981914 13431 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:56.982445 13431 ts_tablet_manager.cc:1403] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.129s	user 0.007s	sys 0.004s
I20260709 12:28:56.982788 13164 raft_consensus.cc:2468] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:56.983922 13059 catalog_manager.cc:5697] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:56.988478 13154 tablet_service.cc:1511] Processing CreateTablet for tablet 2eab5a50da6542d6afd870d484d29a8e (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:56.989754 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eab5a50da6542d6afd870d484d29a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:56.990345 13433 tablet_bootstrap.cc:654] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.993574 13431 raft_consensus.cc:359] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.994343 13431 raft_consensus.cc:385] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:56.994624 13431 raft_consensus.cc:740] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:56.995347 13431 consensus_queue.cc:260] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:56.995635 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 2eab5a50da6542d6afd870d484d29a8e (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:28:56.997722 13431 ts_tablet_manager.cc:1434] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:28:56.998804 13431 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:56.984900 13429 tablet_bootstrap.cc:654] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:56.999773 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eab5a50da6542d6afd870d484d29a8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.008060 13429 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:57.008617 13429 ts_tablet_manager.cc:1403] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:28:57.008963 13430 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.009543 13430 ts_tablet_manager.cc:1403] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.000s
I20260709 12:28:57.012557 13430 raft_consensus.cc:359] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.013360 13430 raft_consensus.cc:385] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.013706 13430 raft_consensus.cc:740] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.014551 13430 consensus_queue.cc:260] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.015043 13299 tablet_service.cc:1511] Processing CreateTablet for tablet b2f91ee1828b41d4b41addb4bc0c39a6 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:57.015986 13472 raft_consensus.cc:493] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.016243 13299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f91ee1828b41d4b41addb4bc0c39a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.016494 13472 raft_consensus.cc:515] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.018630 13472 leader_election.cc:290] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.019460 13220 tablet_service.cc:1511] Processing CreateTablet for tablet db87327473744d9cb4d2c2836ad19c47 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:57.020709 13220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db87327473744d9cb4d2c2836ad19c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.020983 13429 raft_consensus.cc:359] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.021732 13429 raft_consensus.cc:385] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.020897 13375 tablet_service.cc:1511] Processing CreateTablet for tablet b2f91ee1828b41d4b41addb4bc0c39a6 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:57.022259 13373 tablet_service.cc:1511] Processing CreateTablet for tablet db87327473744d9cb4d2c2836ad19c47 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:28:57.023041 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f91ee1828b41d4b41addb4bc0c39a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.023582 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db87327473744d9cb4d2c2836ad19c47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.024058 13433 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.024572 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40227371d9284c11a346c1bf59ce0837" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.025228 13301 tablet_service.cc:1511] Processing CreateTablet for tablet db87327473744d9cb4d2c2836ad19c47 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 12:28:57.026059 13276 leader_election.cc:343] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.026855 13433 ts_tablet_manager.cc:1403] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.002s
I20260709 12:28:57.026921 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40227371d9284c11a346c1bf59ce0837" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:57.026448 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db87327473744d9cb4d2c2836ad19c47. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:57.028669 13278 leader_election.cc:343] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.029100 13278 leader_election.cc:304] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:57.030014 13472 raft_consensus.cc:2749] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.030954 13147 tablet_service.cc:1511] Processing CreateTablet for tablet b2f91ee1828b41d4b41addb4bc0c39a6 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:28:57.032099 13147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f91ee1828b41d4b41addb4bc0c39a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.022002 13429 raft_consensus.cc:740] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.033907 13429 consensus_queue.cc:260] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.037384 13433 raft_consensus.cc:359] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.038120 13433 raft_consensus.cc:385] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.038434 13433 raft_consensus.cc:740] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.041679 13439 consensus_queue.cc:1048] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.044824 13430 ts_tablet_manager.cc:1434] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:28:57.045902 13430 tablet_bootstrap.cc:492] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.039175 13433 consensus_queue.cc:260] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.050400 13229 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf31b69250947228a7680fc301334a0 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:57.052373 13431 tablet_bootstrap.cc:654] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.052136 13300 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf31b69250947228a7680fc301334a0 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:57.052475 13229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf31b69250947228a7680fc301334a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.052503 13433 ts_tablet_manager.cc:1434] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:28:57.053987 13300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf31b69250947228a7680fc301334a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.053493 13429 ts_tablet_manager.cc:1434] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:28:57.060519 13430 tablet_bootstrap.cc:654] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.073678 13154 tablet_service.cc:1511] Processing CreateTablet for tablet 8cf31b69250947228a7680fc301334a0 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:28:57.076449 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cf31b69250947228a7680fc301334a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.074458 13433 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:57.074676 13429 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:57.086614 13429 tablet_bootstrap.cc:654] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.089759 13435 raft_consensus.cc:493] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.092589 13435 raft_consensus.cc:515] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.094846 13435 leader_election.cc:290] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:57.095845 13228 tablet_service.cc:1511] Processing CreateTablet for tablet 087a84ebe1094974b567d0e394b5c185 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:57.096995 13228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087a84ebe1094974b567d0e394b5c185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.097815 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:57.096946 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:57.099563 13313 raft_consensus.cc:2468] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 0.
I20260709 12:28:57.100914 13205 leader_election.cc:304] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.094622 13153 tablet_service.cc:1511] Processing CreateTablet for tablet 087a84ebe1094974b567d0e394b5c185 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:57.102787 13153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087a84ebe1094974b567d0e394b5c185. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:57.103716 13205 leader_election.cc:343] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.105098 13375 tablet_service.cc:1511] Processing CreateTablet for tablet 087a84ebe1094974b567d0e394b5c185 (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:28:57.106217 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 087a84ebe1094974b567d0e394b5c185. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.107929 13435 raft_consensus.cc:2804] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.108395 13435 raft_consensus.cc:493] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.108734 13435 raft_consensus.cc:3060] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.114657 13438 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.121134 13301 tablet_service.cc:1511] Processing CreateTablet for tablet 432cdf291ee349b1a36ebef0910617fa (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:57.124010 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432cdf291ee349b1a36ebef0910617fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.120049 13438 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.133569 13373 tablet_service.cc:1511] Processing CreateTablet for tablet 432cdf291ee349b1a36ebef0910617fa (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:57.134727 13373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432cdf291ee349b1a36ebef0910617fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.138631 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:28:57.142793 13353 leader_election.cc:343] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.143498 13438 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.145562 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:57.147028 13352 leader_election.cc:343] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.147501 13352 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:57.149119 13438 raft_consensus.cc:2749] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.156193 13433 tablet_bootstrap.cc:654] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.160626 13435 raft_consensus.cc:515] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.164276 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
W20260709 12:28:57.165977 13205 leader_election.cc:343] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.169130 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:57.169714 13313 raft_consensus.cc:3060] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.170889 13431 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:57.171530 13431 ts_tablet_manager.cc:1403] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.173s	user 0.027s	sys 0.021s
I20260709 12:28:57.172950 13435 leader_election.cc:290] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:57.174840 13431 raft_consensus.cc:359] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.175876 13431 raft_consensus.cc:385] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.176187 13431 raft_consensus.cc:740] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.177351 13313 raft_consensus.cc:2468] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:28:57.177203 13431 consensus_queue.cc:260] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.178678 13205 leader_election.cc:304] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:57.181869 13430 tablet_bootstrap.cc:492] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.182405 13430 ts_tablet_manager.cc:1403] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.137s	user 0.019s	sys 0.001s
I20260709 12:28:57.182406 13429 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:57.183091 13429 ts_tablet_manager.cc:1403] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.007s
I20260709 12:28:57.185504 13430 raft_consensus.cc:359] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.185787 13429 raft_consensus.cc:359] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.186254 13430 raft_consensus.cc:385] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.186604 13430 raft_consensus.cc:740] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.186852 13472 raft_consensus.cc:493] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.187358 13472 raft_consensus.cc:515] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.187551 13430 consensus_queue.cc:260] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.189551 13472 leader_election.cc:290] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:57.187736 13500 raft_consensus.cc:2804] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.189838 13433 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.192589 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3f1c6c0d994184845443c82d412358" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:57.193756 13433 ts_tablet_manager.cc:1403] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.122s	user 0.010s	sys 0.006s
I20260709 12:28:57.191110 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3f1c6c0d994184845443c82d412358" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.195030 13386 raft_consensus.cc:2468] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.189963 13430 ts_tablet_manager.cc:1434] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:57.193029 13500 raft_consensus.cc:697] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:28:57.196925 13433 raft_consensus.cc:359] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.197721 13433 raft_consensus.cc:385] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.197271 13500 consensus_queue.cc:237] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.198163 13433 raft_consensus.cc:740] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.199044 13433 consensus_queue.cc:260] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.201653 13433 ts_tablet_manager.cc:1434] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:28:57.202754 13433 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:28:57.194942 13279 leader_election.cc:343] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.214459 13472 consensus_queue.cc:1048] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.216153 13276 leader_election.cc:304] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:57.186471 13429 raft_consensus.cc:385] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.216957 13429 raft_consensus.cc:740] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.218328 13472 raft_consensus.cc:2804] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.218196 13429 consensus_queue.cc:260] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.220520 13429 ts_tablet_manager.cc:1434] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:28:57.208364 13154 tablet_service.cc:1511] Processing CreateTablet for tablet 432cdf291ee349b1a36ebef0910617fa (DEFAULT_TABLE table=test-workload [id=f90b596d947d4a5296670b0e4909759c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:28:57.221516 13429 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:57.222072 13154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432cdf291ee349b1a36ebef0910617fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:57.209659 13431 ts_tablet_manager.cc:1434] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:28:57.218765 13472 raft_consensus.cc:493] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.223026 13472 raft_consensus.cc:3060] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.211788 13430 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.229871 13472 raft_consensus.cc:515] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.232360 13431 tablet_bootstrap.cc:492] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:57.233599 13429 tablet_bootstrap.cc:654] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.234252 13430 tablet_bootstrap.cc:654] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.235425 13433 tablet_bootstrap.cc:654] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.239197 13472 leader_election.cc:290] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:57.240613 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3f1c6c0d994184845443c82d412358" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:57.242817 13061 catalog_manager.cc:5697] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.243963 13386 raft_consensus.cc:3060] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.248026 13502 raft_consensus.cc:493] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.248522 13502 raft_consensus.cc:515] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.250620 13502 leader_election.cc:290] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.252192 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3947397e0615475ca34744de551446cc" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:57.252835 13163 raft_consensus.cc:2468] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.252810 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f3f1c6c0d994184845443c82d412358" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:57.254345 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3947397e0615475ca34744de551446cc" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.254846 13164 raft_consensus.cc:3060] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.256111 13433 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.243449 13431 tablet_bootstrap.cc:654] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.254278 13279 leader_election.cc:304] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.256739 13433 ts_tablet_manager.cc:1403] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.008s
I20260709 12:28:57.257354 13472 raft_consensus.cc:2804] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.257740 13472 raft_consensus.cc:493] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.258070 13472 raft_consensus.cc:3060] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.260500 13433 raft_consensus.cc:359] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:28:57.256971 13276 leader_election.cc:343] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.264619 13433 raft_consensus.cc:385] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.265069 13164 raft_consensus.cc:2468] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.265313 13433 raft_consensus.cc:740] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.266455 13279 leader_election.cc:304] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.267277 13502 raft_consensus.cc:2804] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.267992 13502 raft_consensus.cc:697] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:57.267823 13472 raft_consensus.cc:515] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.267112 13433 consensus_queue.cc:260] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.268872 13502 consensus_queue.cc:237] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.270764 13433 ts_tablet_manager.cc:1434] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:28:57.272431 13472 leader_election.cc:290] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.273142 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3947397e0615475ca34744de551446cc" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:57.273823 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3947397e0615475ca34744de551446cc" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:57.279026 13164 raft_consensus.cc:3060] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.279714 13433 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:57.274580 13386 raft_consensus.cc:2468] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.281678 13061 catalog_manager.cc:5697] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.275466 13431 tablet_bootstrap.cc:492] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
W20260709 12:28:57.283241 13276 leader_election.cc:343] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.283669 13431 ts_tablet_manager.cc:1403] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.002s
I20260709 12:28:57.285715 13433 tablet_bootstrap.cc:654] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.286470 13431 raft_consensus.cc:359] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.287159 13431 raft_consensus.cc:385] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.287447 13431 raft_consensus.cc:740] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.288102 13431 consensus_queue.cc:260] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.290403 13429 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:57.290867 13429 ts_tablet_manager.cc:1403] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.015s
I20260709 12:28:57.293466 13429 raft_consensus.cc:359] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.294068 13429 raft_consensus.cc:385] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.294340 13429 raft_consensus.cc:740] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.295244 13438 consensus_queue.cc:1048] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.298079 13164 raft_consensus.cc:2468] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.299293 13279 leader_election.cc:304] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:57.299553 13433 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.300246 13433 ts_tablet_manager.cc:1403] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 12:28:57.300127 13472 raft_consensus.cc:2804] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.300822 13472 raft_consensus.cc:697] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:57.302116 13430 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.301721 13472 consensus_queue.cc:237] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.302582 13430 ts_tablet_manager.cc:1403] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.091s	user 0.003s	sys 0.009s
I20260709 12:28:57.303061 13433 raft_consensus.cc:359] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.303742 13433 raft_consensus.cc:385] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.304001 13433 raft_consensus.cc:740] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.300544 13429 consensus_queue.cc:260] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.304689 13433 consensus_queue.cc:260] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.306541 13433 ts_tablet_manager.cc:1434] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:28:57.307632 13429 ts_tablet_manager.cc:1434] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:28:57.308564 13429 tablet_bootstrap.cc:492] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:57.309221 13484 raft_consensus.cc:493] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.309744 13484 raft_consensus.cc:515] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.312644 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.312992 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:57.314070 13127 leader_election.cc:343] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:57.314630 13129 leader_election.cc:343] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.314718 13484 leader_election.cc:290] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.315137 13129 leader_election.cc:304] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:57.315687 13431 ts_tablet_manager.cc:1434] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:28:57.315428 13430 raft_consensus.cc:359] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.316155 13430 raft_consensus.cc:385] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.316442 13430 raft_consensus.cc:740] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.316879 13431 tablet_bootstrap.cc:492] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:57.317117 13430 consensus_queue.cc:260] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.317830 13433 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:57.319164 13430 ts_tablet_manager.cc:1434] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:28:57.320103 13430 tablet_bootstrap.cc:492] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.321631 13472 raft_consensus.cc:493] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.322167 13472 raft_consensus.cc:515] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.325040 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:57.314277 13429 tablet_bootstrap.cc:654] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.325680 13164 raft_consensus.cc:2468] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.326902 13279 leader_election.cc:304] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.327451 13484 raft_consensus.cc:2749] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.327723 13502 raft_consensus.cc:2804] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.328097 13502 raft_consensus.cc:493] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.328452 13502 raft_consensus.cc:3060] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.328722 13433 tablet_bootstrap.cc:654] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.325765 13430 tablet_bootstrap.cc:654] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.343426 13439 consensus_queue.cc:1048] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:57.351374 13502 raft_consensus.cc:515] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.355109 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:57.362986 13239 raft_consensus.cc:2468] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.356295 13472 leader_election.cc:290] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.356565 13483 raft_consensus.cc:493] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.364886 13483 raft_consensus.cc:515] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.366892 13483 leader_election.cc:290] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:57.368839 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3947397e0615475ca34744de551446cc" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:57.372954 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3947397e0615475ca34744de551446cc" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:57.373863 13164 raft_consensus.cc:2393] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc0a5489897d4f6c8dd410cb6daee91b in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:28:57.375191 13353 leader_election.cc:304] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:57.376720 13483 raft_consensus.cc:3060] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.391095 13472 raft_consensus.cc:493] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.391722 13472 raft_consensus.cc:515] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.394754 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:57.394486 13060 catalog_manager.cc:5697] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.396032 13164 raft_consensus.cc:3060] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:57.406976 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:57.410562 13439 consensus_queue.cc:1048] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.418767 13387 raft_consensus.cc:3060] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.440582 13483 raft_consensus.cc:2749] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.444980 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:57.445931 13239 raft_consensus.cc:3060] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.453853 13239 raft_consensus.cc:2468] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.456842 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687b69d2c0ed4789a4464687de621d9f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:57.505578 13162 raft_consensus.cc:2468] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.460371 13500 raft_consensus.cc:493] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.506582 13500 raft_consensus.cc:515] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.509469 13279 leader_election.cc:304] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.510177 13439 raft_consensus.cc:2804] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.510536 13439 raft_consensus.cc:493] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.510874 13439 raft_consensus.cc:3060] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.511289 13500 leader_election.cc:290] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.513774 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:28:57.515268 13205 leader_election.cc:343] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.518592 13439 raft_consensus.cc:515] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.463399 13502 leader_election.cc:290] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.465950 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687b69d2c0ed4789a4464687de621d9f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:57.519793 13238 raft_consensus.cc:2468] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.520990 13439 leader_election.cc:290] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.522279 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687b69d2c0ed4789a4464687de621d9f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:57.522882 13238 raft_consensus.cc:3060] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.523232 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687b69d2c0ed4789a4464687de621d9f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:57.523830 13162 raft_consensus.cc:3060] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.466652 13472 leader_election.cc:290] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
W20260709 12:28:57.471594 13352 consensus_peers.cc:597] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:57.527696 13352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 56228.5us
I20260709 12:28:57.479534 13164 raft_consensus.cc:2468] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.482800 13435 raft_consensus.cc:493] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.528823 13435 raft_consensus.cc:515] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.529950 13238 raft_consensus.cc:2468] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.530908 13435 leader_election.cc:290] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.532075 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40227371d9284c11a346c1bf59ce0837" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.532763 13386 raft_consensus.cc:2468] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 0.
I20260709 12:28:57.532711 13278 leader_election.cc:304] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.534041 13202 leader_election.cc:304] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:57.534871 13279 leader_election.cc:304] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.535560 13502 raft_consensus.cc:2804] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.536091 13502 raft_consensus.cc:697] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:57.536172 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40227371d9284c11a346c1bf59ce0837" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:57.536814 13313 raft_consensus.cc:2468] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 0.
I20260709 12:28:57.537073 13502 consensus_queue.cc:237] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.538535 13435 raft_consensus.cc:2804] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.538905 13435 raft_consensus.cc:493] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.539208 13435 raft_consensus.cc:3060] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.542145 13439 raft_consensus.cc:2804] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.542717 13439 raft_consensus.cc:697] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:57.543666 13439 consensus_queue.cc:237] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.561542 13162 raft_consensus.cc:2468] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.563653 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.564442 13387 raft_consensus.cc:2468] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 0.
I20260709 12:28:57.565622 13202 leader_election.cc:304] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:57.567049 13500 raft_consensus.cc:2804] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.567688 13500 raft_consensus.cc:493] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.568082 13500 raft_consensus.cc:3060] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.568861 13435 raft_consensus.cc:515] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.571730 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40227371d9284c11a346c1bf59ce0837" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:57.572314 13313 raft_consensus.cc:3060] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.575372 13500 raft_consensus.cc:515] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.578660 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:57.580092 13313 raft_consensus.cc:2468] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
W20260709 12:28:57.580250 13205 leader_election.cc:343] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.581252 13205 leader_election.cc:304] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.362042 13431 tablet_bootstrap.cc:654] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.587468 13435 leader_election.cc:290] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.587829 13429 tablet_bootstrap.cc:492] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:57.588027 13435 raft_consensus.cc:2804] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.588315 13429 ts_tablet_manager.cc:1403] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.280s	user 0.051s	sys 0.076s
I20260709 12:28:57.588459 13435 raft_consensus.cc:697] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:28:57.588721 13430 tablet_bootstrap.cc:492] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.588727 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40227371d9284c11a346c1bf59ce0837" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:57.589344 13430 ts_tablet_manager.cc:1403] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.269s	user 0.072s	sys 0.159s
I20260709 12:28:57.589645 13387 raft_consensus.cc:3060] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.591166 13429 raft_consensus.cc:359] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.592199 13430 raft_consensus.cc:359] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.589339 13435 consensus_queue.cc:237] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.592934 13430 raft_consensus.cc:385] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.594975 13430 raft_consensus.cc:740] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.595851 13500 leader_election.cc:290] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.595728 13430 consensus_queue.cc:260] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.597608 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:57.598208 13386 raft_consensus.cc:3060] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.599459 13387 raft_consensus.cc:2468] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:28:57.600405 13433 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.600863 13433 ts_tablet_manager.cc:1403] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.283s	user 0.040s	sys 0.098s
I20260709 12:28:57.601454 13430 ts_tablet_manager.cc:1434] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:28:57.602391 13430 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.603581 13433 raft_consensus.cc:359] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.604225 13433 raft_consensus.cc:385] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.604498 13433 raft_consensus.cc:740] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.591887 13429 raft_consensus.cc:385] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.605257 13386 raft_consensus.cc:2468] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:28:57.605774 13433 consensus_queue.cc:260] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.607818 13433 ts_tablet_manager.cc:1434] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:28:57.605382 13429 raft_consensus.cc:740] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.608891 13429 consensus_queue.cc:260] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.609279 13202 leader_election.cc:304] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:57.610898 13429 ts_tablet_manager.cc:1434] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:28:57.614626 13430 tablet_bootstrap.cc:654] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.616446 13429 tablet_bootstrap.cc:492] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:57.616099 13062 catalog_manager.cc:5697] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.617807 13062 catalog_manager.cc:5697] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:57.622221 13431 tablet_bootstrap.cc:492] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:57.622746 13431 ts_tablet_manager.cc:1403] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.306s	user 0.010s	sys 0.001s
I20260709 12:28:57.623941 13433 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:57.624796 13430 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.625299 13430 ts_tablet_manager.cc:1403] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:28:57.625530 13431 raft_consensus.cc:359] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.626199 13431 raft_consensus.cc:385] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.626462 13431 raft_consensus.cc:740] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.627574 13527 raft_consensus.cc:2804] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.627351 13431 consensus_queue.cc:260] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.628089 13527 raft_consensus.cc:697] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:28:57.629031 13429 tablet_bootstrap.cc:654] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.632326 13433 tablet_bootstrap.cc:654] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.628206 13430 raft_consensus.cc:359] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.633572 13430 raft_consensus.cc:385] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.633842 13430 raft_consensus.cc:740] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.634614 13430 consensus_queue.cc:260] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.628955 13527 consensus_queue.cc:237] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.636854 13430 ts_tablet_manager.cc:1434] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:28:57.638619 13431 ts_tablet_manager.cc:1434] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:28:57.642467 13431 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:57.637934 13430 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.645476 13059 catalog_manager.cc:5697] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.650090 13430 tablet_bootstrap.cc:654] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.670856 13062 catalog_manager.cc:5697] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:57.674564 13205 consensus_peers.cc:597] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:57.693812 13527 consensus_queue.cc:1048] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.695122 13439 consensus_queue.cc:1048] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.696096 13431 tablet_bootstrap.cc:654] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.701128 13433 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.698036 13429 tablet_bootstrap.cc:492] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:57.701642 13433 ts_tablet_manager.cc:1403] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.078s	user 0.028s	sys 0.023s
I20260709 12:28:57.701736 13429 ts_tablet_manager.cc:1403] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.086s	user 0.033s	sys 0.021s
I20260709 12:28:57.704550 13433 raft_consensus.cc:359] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.705237 13433 raft_consensus.cc:385] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.705499 13433 raft_consensus.cc:740] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.705619 13429 raft_consensus.cc:359] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.706502 13429 raft_consensus.cc:385] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.706818 13429 raft_consensus.cc:740] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.708016 13429 consensus_queue.cc:260] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.709220 13433 consensus_queue.cc:260] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.712363 13429 ts_tablet_manager.cc:1434] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:28:57.712532 13433 ts_tablet_manager.cc:1434] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:28:57.714071 13430 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.714890 13430 ts_tablet_manager.cc:1403] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.077s	user 0.033s	sys 0.022s
I20260709 12:28:57.714716 13502 consensus_queue.cc:1048] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.715338 13429 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:57.717656 13430 raft_consensus.cc:359] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.718359 13430 raft_consensus.cc:385] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.718680 13430 raft_consensus.cc:740] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.719401 13430 consensus_queue.cc:260] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.721380 13430 ts_tablet_manager.cc:1434] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:28:57.722047 13429 tablet_bootstrap.cc:654] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.722582 13523 raft_consensus.cc:493] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.714282 13431 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:57.723062 13523 raft_consensus.cc:515] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.723110 13433 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:57.726042 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:57.726651 13239 raft_consensus.cc:2468] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.723660 13431 ts_tablet_manager.cc:1403] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.000s
I20260709 12:28:57.727877 13278 leader_election.cc:304] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.728695 13472 raft_consensus.cc:2804] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.729074 13472 raft_consensus.cc:493] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.729410 13472 raft_consensus.cc:3060] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.730222 13431 raft_consensus.cc:359] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.730988 13431 raft_consensus.cc:385] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.731284 13431 raft_consensus.cc:740] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.732189 13523 leader_election.cc:290] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.732086 13431 consensus_queue.cc:260] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.733170 13430 tablet_bootstrap.cc:492] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.733753 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.739739 13387 raft_consensus.cc:2468] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:57.740820 13430 tablet_bootstrap.cc:654] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.722227 13502 consensus_queue.cc:1048] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:28:57.743574 13472 raft_consensus.cc:515] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.734158 13431 ts_tablet_manager.cc:1434] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:57.735471 13433 tablet_bootstrap.cc:654] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.751631 13527 raft_consensus.cc:493] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.752223 13527 raft_consensus.cc:515] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.754262 13527 leader_election.cc:290] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:57.755321 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.756132 13431 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:57.757344 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:57.757925 13239 raft_consensus.cc:3060] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.760697 13387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:57.760799 13472 leader_election.cc:290] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.761343 13387 raft_consensus.cc:3060] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.769873 13431 tablet_bootstrap.cc:654] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.771272 13429 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:57.772002 13429 ts_tablet_manager.cc:1403] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.006s
I20260709 12:28:57.774767 13433 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.775254 13433 ts_tablet_manager.cc:1403] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.012s
I20260709 12:28:57.777513 13484 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.778729 13484 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.780377 13433 raft_consensus.cc:359] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.783249 13433 raft_consensus.cc:385] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.783656 13433 raft_consensus.cc:740] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.784190 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:57.784423 13433 consensus_queue.cc:260] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
W20260709 12:28:57.785670 13129 leader_election.cc:343] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.787304 13429 raft_consensus.cc:359] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.788029 13429 raft_consensus.cc:385] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.788285 13429 raft_consensus.cc:740] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.788964 13429 consensus_queue.cc:260] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.783071 13484 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.792937 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.797233 13386 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:57.798048 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "728ff7f7b916431596bad2058abcff08" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:57.800421 13127 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:57.802623 13429 ts_tablet_manager.cc:1434] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:28:57.803689 13429 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:57.803814 13502 consensus_queue.cc:1048] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:57.806722 13205 leader_election.cc:304] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:57.807904 13527 raft_consensus.cc:2749] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.808447 13430 tablet_bootstrap.cc:492] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.809010 13430 ts_tablet_manager.cc:1403] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.087s	user 0.038s	sys 0.022s
I20260709 12:28:57.812351 13430 raft_consensus.cc:359] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.815459 13430 raft_consensus.cc:385] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.815685 13430 raft_consensus.cc:740] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.816816 13430 consensus_queue.cc:260] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.820739 13433 ts_tablet_manager.cc:1434] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.045s	user 0.012s	sys 0.003s
I20260709 12:28:57.821724 13433 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:57.821792 13484 raft_consensus.cc:2804] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.822324 13484 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.822700 13484 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.825217 13239 raft_consensus.cc:2468] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.826416 13278 leader_election.cc:304] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.827301 13523 raft_consensus.cc:2804] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.827800 13523 raft_consensus.cc:697] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:57.828646 13523 consensus_queue.cc:237] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.830452 13543 raft_consensus.cc:493] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.830941 13543 raft_consensus.cc:515] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.827893 13433 tablet_bootstrap.cc:654] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.838023 13430 ts_tablet_manager.cc:1434] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:28:57.839221 13430 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.841598 13431 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:57.842124 13431 ts_tablet_manager.cc:1403] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.019s
I20260709 12:28:57.844805 13431 raft_consensus.cc:359] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.845402 13431 raft_consensus.cc:385] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.845659 13431 raft_consensus.cc:740] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.846287 13431 consensus_queue.cc:260] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.847486 13484 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.848291 13431 ts_tablet_manager.cc:1434] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:28:57.849399 13431 tablet_bootstrap.cc:492] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:57.849656 13484 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.850672 13484 raft_consensus.cc:493] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.850860 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:57.851478 13239 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.852300 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:57.850769 13429 tablet_bootstrap.cc:654] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.857790 13430 tablet_bootstrap.cc:654] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.859129 13543 leader_election.cc:290] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.856938 13484 raft_consensus.cc:515] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.861325 13312 raft_consensus.cc:2468] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:57.872426 13431 tablet_bootstrap.cc:654] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.860986 13387 raft_consensus.cc:2468] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:57.877532 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:57.878309 13385 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.882504 13384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.883318 13384 raft_consensus.cc:2468] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:57.905639 13130 leader_election.cc:304] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:57.915627 13484 leader_election.cc:290] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:57.915736 13546 raft_consensus.cc:2804] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.923117 13546 raft_consensus.cc:493] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.924508 13429 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:57.925024 13429 ts_tablet_manager.cc:1403] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.021s
I20260709 12:28:57.925235 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:57.927678 13429 raft_consensus.cc:359] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.928331 13429 raft_consensus.cc:385] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.928587 13429 raft_consensus.cc:740] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.929191 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e62a312762f44d1fa9089e42d4241ffe" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:57.929359 13429 consensus_queue.cc:260] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.929934 13386 raft_consensus.cc:2393] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:28:57.930117 13546 raft_consensus.cc:3060] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.930958 13127 leader_election.cc:304] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:57.931685 13429 ts_tablet_manager.cc:1434] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:28:57.932546 13484 raft_consensus.cc:3060] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.932586 13429 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:57.939313 13484 raft_consensus.cc:2749] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:57.940436 13062 catalog_manager.cc:5697] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:57.941443 13546 raft_consensus.cc:515] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.943509 13429 tablet_bootstrap.cc:654] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:57.943908 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:57.946729 13239 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:57.943159 13546 leader_election.cc:290] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:57.953047 13312 raft_consensus.cc:3060] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.956015 13430 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:57.956548 13430 ts_tablet_manager.cc:1403] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.118s	user 0.019s	sys 0.026s
I20260709 12:28:57.949563 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:57.959131 13386 raft_consensus.cc:3060] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.961684 13430 raft_consensus.cc:359] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.962459 13430 raft_consensus.cc:385] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.962797 13430 raft_consensus.cc:740] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.963557 13430 consensus_queue.cc:260] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:57.965786 13430 ts_tablet_manager.cc:1434] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:28:57.966483 13430 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:57.961735 13483 raft_consensus.cc:493] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:57.968333 13483 raft_consensus.cc:515] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:57.970700 13483 leader_election.cc:290] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:57.971328 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9028d57790342829a18f33502b1c412" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:57.971976 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9028d57790342829a18f33502b1c412" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:57.972600 13313 raft_consensus.cc:2468] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:57.975793 13430 tablet_bootstrap.cc:654] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:57.974227 13352 leader_election.cc:343] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:57.977020 13353 leader_election.cc:304] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:57.977368 13433 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:57.977921 13433 ts_tablet_manager.cc:1403] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.156s	user 0.037s	sys 0.022s
I20260709 12:28:57.978332 13483 raft_consensus.cc:2804] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:57.978809 13483 raft_consensus.cc:493] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:57.975812 13129 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:28:57.979245 13483 raft_consensus.cc:3060] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:57.981771 13433 raft_consensus.cc:359] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:57.982479 13433 raft_consensus.cc:385] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:57.982743 13433 raft_consensus.cc:740] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:57.995644 13546 raft_consensus.cc:2804] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:57.997414 13546 raft_consensus.cc:697] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:28:57.998489 13546 consensus_queue.cc:237] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.001664 13483 raft_consensus.cc:515] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.002648 13433 consensus_queue.cc:260] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.005712 13386 raft_consensus.cc:2468] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:58.007786 13127 leader_election.cc:304] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.008800 13484 raft_consensus.cc:2804] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.009315 13484 raft_consensus.cc:697] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:28:58.010165 13484 consensus_queue.cc:237] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.012152 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9028d57790342829a18f33502b1c412" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:28:58.013907 13352 leader_election.cc:343] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.015631 13483 leader_election.cc:290] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.016774 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9028d57790342829a18f33502b1c412" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:58.017989 13313 raft_consensus.cc:3060] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.025072 13433 ts_tablet_manager.cc:1434] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:28:58.029275 13483 raft_consensus.cc:493] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.029881 13483 raft_consensus.cc:515] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.030961 13430 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:58.032862 13431 tablet_bootstrap.cc:492] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:58.033330 13431 ts_tablet_manager.cc:1403] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.184s	user 0.015s	sys 0.000s
I20260709 12:28:58.034703 13433 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:58.036224 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:58.036921 13162 raft_consensus.cc:2468] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:58.038650 13431 raft_consensus.cc:359] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.039325 13431 raft_consensus.cc:385] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.039626 13431 raft_consensus.cc:740] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.040256 13431 consensus_queue.cc:260] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.040997 13472 consensus_queue.cc:1048] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.042270 13431 ts_tablet_manager.cc:1434] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:28:58.043210 13431 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:58.043571 13353 leader_election.cc:304] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.044421 13519 raft_consensus.cc:2804] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.044793 13519 raft_consensus.cc:493] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.039484 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.045140 13519 raft_consensus.cc:3060] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.045845 13237 raft_consensus.cc:2468] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:58.033339 13483 leader_election.cc:290] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.048041 13430 ts_tablet_manager.cc:1403] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.082s	user 0.034s	sys 0.024s
I20260709 12:28:58.050727 13430 raft_consensus.cc:359] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.051373 13430 raft_consensus.cc:385] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.051658 13430 raft_consensus.cc:740] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.053730 13431 tablet_bootstrap.cc:654] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.054914 13519 raft_consensus.cc:515] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:57.973119 13385 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:58.060824 13313 raft_consensus.cc:2468] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:58.056419 13430 consensus_queue.cc:260] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.062260 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:58.063936 13164 raft_consensus.cc:3060] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.066668 13545 raft_consensus.cc:493] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.067217 13545 raft_consensus.cc:515] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.066800 13430 ts_tablet_manager.cc:1434] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:28:58.069140 13430 tablet_bootstrap.cc:492] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:58.069640 13545 leader_election.cc:290] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.070817 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.073199 13429 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.073737 13429 ts_tablet_manager.cc:1403] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.141s	user 0.069s	sys 0.050s
I20260709 12:28:58.076110 13239 raft_consensus.cc:3060] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.077454 13429 raft_consensus.cc:359] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.078293 13429 raft_consensus.cc:385] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.064286 13312 raft_consensus.cc:2468] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:58.078742 13430 tablet_bootstrap.cc:654] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.078661 13429 raft_consensus.cc:740] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.085119 13523 consensus_queue.cc:1048] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.077339 13353 leader_election.cc:304] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:58.091567 13483 raft_consensus.cc:2804] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.092033 13062 catalog_manager.cc:5697] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.095290 13472 consensus_queue.cc:1048] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.098049 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:58.098697 13236 raft_consensus.cc:3060] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.089545 13519 leader_election.cc:290] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.103400 13433 tablet_bootstrap.cc:654] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.087818 13429 consensus_queue.cc:260] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.108913 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ceab57fea69f4fb2b92768c69ccf1acd" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:58.121505 13130 leader_election.cc:304] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:58.123517 13435 consensus_queue.cc:1048] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.105741 13164 raft_consensus.cc:2468] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:58.126129 13353 leader_election.cc:304] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.124881 13236 raft_consensus.cc:2468] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:58.128690 13484 raft_consensus.cc:2749] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:58.133038 13439 consensus_queue.cc:1048] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:58.141808 13431 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:58.142323 13429 ts_tablet_manager.cc:1434] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 12:28:58.142463 13431 ts_tablet_manager.cc:1403] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.013s
I20260709 12:28:58.143230 13429 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.131800 13435 consensus_queue.cc:1048] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:28:58.135072 13519 raft_consensus.cc:2804] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.144241 13483 raft_consensus.cc:697] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:58.177767 13483 consensus_queue.cc:237] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.181802 13163 raft_consensus.cc:3060] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.198789 13429 tablet_bootstrap.cc:654] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.203369 13573 consensus_queue.cc:1048] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:58.173555 13059 catalog_manager.cc:5697] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:58.209765 13484 raft_consensus.cc:493] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.210299 13484 raft_consensus.cc:515] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.166175 13430 tablet_bootstrap.cc:492] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:58.212146 13430 ts_tablet_manager.cc:1403] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.143s	user 0.008s	sys 0.005s
I20260709 12:28:58.213702 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:58.214432 13313 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:58.214998 13429 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.185307 13435 consensus_queue.cc:1048] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 12:28:58.217427 13130 leader_election.cc:304] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:58.213758 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.219389 13546 raft_consensus.cc:2804] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.219657 13484 leader_election.cc:290] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.219882 13546 raft_consensus.cc:493] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.193151 13431 raft_consensus.cc:359] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.220392 13546 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.220706 13431 raft_consensus.cc:385] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.220904 13519 raft_consensus.cc:697] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:58.221218 13431 raft_consensus.cc:740] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.221855 13519 consensus_queue.cc:237] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.222684 13431 consensus_queue.cc:260] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.219977 13430 raft_consensus.cc:359] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.225579 13430 raft_consensus.cc:385] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.225850 13430 raft_consensus.cc:740] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.226532 13430 consensus_queue.cc:260] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.227929 13546 raft_consensus.cc:515] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.228644 13430 ts_tablet_manager.cc:1434] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:28:58.229588 13430 tablet_bootstrap.cc:492] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:58.230141 13546 leader_election.cc:290] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.231045 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:58.234091 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:58.234676 13313 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.235605 13502 consensus_queue.cc:1048] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.245915 13430 tablet_bootstrap.cc:654] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.247560 13429 ts_tablet_manager.cc:1403] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.105s	user 0.009s	sys 0.010s
I20260709 12:28:58.273125 13239 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:58.281868 13429 raft_consensus.cc:359] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.282608 13429 raft_consensus.cc:385] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.282874 13429 raft_consensus.cc:740] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.284796 13429 consensus_queue.cc:260] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.288806 13061 catalog_manager.cc:5697] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:58.299373 13433 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:58.300009 13433 ts_tablet_manager.cc:1403] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.266s	user 0.021s	sys 0.010s
I20260709 12:28:58.301800 13429 ts_tablet_manager.cc:1434] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:28:58.302819 13429 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.308319 13313 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:58.314608 13130 leader_election.cc:304] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:58.308933 13433 raft_consensus.cc:359] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.315017 13430 tablet_bootstrap.cc:492] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:58.317250 13430 ts_tablet_manager.cc:1403] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.006s
I20260709 12:28:58.317378 13429 tablet_bootstrap.cc:654] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.315837 13546 raft_consensus.cc:2804] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.319252 13546 raft_consensus.cc:697] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:28:58.319958 13430 raft_consensus.cc:359] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.320066 13546 consensus_queue.cc:237] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.320716 13430 raft_consensus.cc:385] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.315994 13433 raft_consensus.cc:385] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.321408 13433 raft_consensus.cc:740] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.321017 13430 raft_consensus.cc:740] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.322188 13433 consensus_queue.cc:260] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.324931 13433 ts_tablet_manager.cc:1434] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 12:28:58.325978 13433 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:58.319847 13439 consensus_queue.cc:1048] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:28:58.336745 13431 ts_tablet_manager.cc:1434] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.194s	user 0.007s	sys 0.001s
I20260709 12:28:58.337780 13431 tablet_bootstrap.cc:492] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:58.330084 13430 consensus_queue.cc:260] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.343743 13430 ts_tablet_manager.cc:1434] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:28:58.344849 13430 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:58.353035 13573 raft_consensus.cc:493] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.353646 13573 raft_consensus.cc:515] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.357303 13573 leader_election.cc:290] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:58.357918 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9028d57790342829a18f33502b1c412" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:58.358786 13312 raft_consensus.cc:2393] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:28:58.359078 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9028d57790342829a18f33502b1c412" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:58.361191 13202 leader_election.cc:304] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:58.365738 13500 raft_consensus.cc:3060] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.368304 13433 tablet_bootstrap.cc:654] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.374162 13500 raft_consensus.cc:2749] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:58.374465 13430 tablet_bootstrap.cc:654] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.377672 13433 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:58.378252 13433 ts_tablet_manager.cc:1403] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.003s
I20260709 12:28:58.381207 13433 raft_consensus.cc:359] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.350426 13060 catalog_manager.cc:5697] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.381983 13433 raft_consensus.cc:385] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.382357 13433 raft_consensus.cc:740] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.387212 13433 consensus_queue.cc:260] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.388675 13431 tablet_bootstrap.cc:654] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.391769 13433 ts_tablet_manager.cc:1434] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:28:58.392927 13433 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:58.399071 13433 tablet_bootstrap.cc:654] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.410867 13519 raft_consensus.cc:493] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.411528 13519 raft_consensus.cc:515] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.414551 13519 leader_election.cc:290] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:58.418762 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2415dad8fe444e70843baac50519f73c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:58.419605 13312 raft_consensus.cc:2468] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:58.421311 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2415dad8fe444e70843baac50519f73c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:58.424142 13353 leader_election.cc:304] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.424965 13519 raft_consensus.cc:2804] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:58.425066 13353 leader_election.cc:343] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.425367 13519 raft_consensus.cc:493] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.425740 13519 raft_consensus.cc:3060] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.425938 13429 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.426378 13429 ts_tablet_manager.cc:1403] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.124s	user 0.029s	sys 0.055s
I20260709 12:28:58.428293 13484 consensus_queue.cc:1048] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.429075 13429 raft_consensus.cc:359] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.429728 13429 raft_consensus.cc:385] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.429970 13429 raft_consensus.cc:740] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.432953 13519 raft_consensus.cc:515] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.436224 13431 tablet_bootstrap.cc:492] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:58.436739 13431 ts_tablet_manager.cc:1403] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.000s
W20260709 12:28:58.439090 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:58.439122 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2415dad8fe444e70843baac50519f73c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:58.440227 13429 consensus_queue.cc:260] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.440791 13312 raft_consensus.cc:3060] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.442385 13429 ts_tablet_manager.cc:1434] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:28:58.439301 13431 raft_consensus.cc:359] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.442952 13431 raft_consensus.cc:385] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.443239 13431 raft_consensus.cc:740] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.443910 13431 consensus_queue.cc:260] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.445766 13433 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:58.446400 13433 ts_tablet_manager.cc:1403] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.002s
I20260709 12:28:58.449357 13433 raft_consensus.cc:359] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.450201 13433 raft_consensus.cc:385] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.450506 13433 raft_consensus.cc:740] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.451566 13430 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:58.451296 13433 consensus_queue.cc:260] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.445860 13431 ts_tablet_manager.cc:1434] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:28:58.452044 13430 ts_tablet_manager.cc:1403] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.107s	user 0.025s	sys 0.031s
I20260709 12:28:58.452952 13431 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:58.453831 13433 ts_tablet_manager.cc:1434] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:58.459014 13431 tablet_bootstrap.cc:654] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.451897 13429 tablet_bootstrap.cc:492] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.465126 13546 consensus_queue.cc:1048] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.464820 13430 raft_consensus.cc:359] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.466601 13430 raft_consensus.cc:385] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.466894 13430 raft_consensus.cc:740] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.467303 13429 tablet_bootstrap.cc:654] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.468736 13430 consensus_queue.cc:260] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.470940 13430 ts_tablet_manager.cc:1434] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:28:58.460970 13433 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:58.475212 13502 raft_consensus.cc:493] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.475924 13502 raft_consensus.cc:515] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.475577 13430 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:58.478809 13062 catalog_manager.cc:5697] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.482327 13429 tablet_bootstrap.cc:492] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.482811 13429 ts_tablet_manager.cc:1403] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.002s
I20260709 12:28:58.485595 13433 tablet_bootstrap.cc:654] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.485494 13429 raft_consensus.cc:359] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.502979 13429 raft_consensus.cc:385] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.486505 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde9f8bf8cdf4ce08f666bdc04a7c318" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:58.487524 13502 leader_election.cc:290] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.503774 13163 raft_consensus.cc:2468] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:58.506071 13279 leader_election.cc:304] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:58.503326 13429 raft_consensus.cc:740] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.488924 13430 tablet_bootstrap.cc:654] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.507650 13429 consensus_queue.cc:260] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.489471 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde9f8bf8cdf4ce08f666bdc04a7c318" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.490499 13312 raft_consensus.cc:2468] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:58.510237 13472 raft_consensus.cc:2804] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.510730 13472 raft_consensus.cc:493] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.491482 13519 leader_election.cc:290] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:58.511078 13472 raft_consensus.cc:3060] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.492585 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2415dad8fe444e70843baac50519f73c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:58.511716 13164 raft_consensus.cc:3060] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.512277 13353 leader_election.cc:304] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.500588 13484 consensus_queue.cc:1048] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:58.513163 13519 raft_consensus.cc:2804] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.513792 13519 raft_consensus.cc:697] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:58.514650 13519 consensus_queue.cc:237] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
W20260709 12:28:58.511929 13278 leader_election.cc:343] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.518469 13439 raft_consensus.cc:493] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.526657 13568 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.526630 13545 consensus_queue.cc:1048] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:58.519085 13439 raft_consensus.cc:515] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.543996 13439 leader_election.cc:290] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:58.546393 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:58.547199 13386 raft_consensus.cc:2468] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:58.548740 13276 leader_election.cc:304] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.550580 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:58.552186 13164 raft_consensus.cc:2468] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:58.555823 13483 raft_consensus.cc:493] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.556408 13483 raft_consensus.cc:515] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.558494 13483 leader_election.cc:290] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.527525 13568 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.559993 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b658edca804986a4f3a9879589f0d2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.560462 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b658edca804986a4f3a9879589f0d2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:58.560664 13238 raft_consensus.cc:2468] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:58.561116 13313 raft_consensus.cc:2468] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:58.561836 13352 leader_election.cc:304] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.562330 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.562810 13431 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:58.563333 13431 ts_tablet_manager.cc:1403] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.019s
W20260709 12:28:58.563759 13352 leader_election.cc:343] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.569821 13431 raft_consensus.cc:359] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.573231 13484 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.573756 13431 raft_consensus.cc:385] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.573793 13484 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.574892 13523 raft_consensus.cc:2804] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.575295 13523 raft_consensus.cc:493] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.575773 13523 raft_consensus.cc:3060] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.576373 13484 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.577024 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:58.577394 13431 raft_consensus.cc:740] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.577697 13386 raft_consensus.cc:2468] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:58.578791 13431 consensus_queue.cc:260] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.581945 13431 ts_tablet_manager.cc:1434] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
W20260709 12:28:58.578806 13279 leader_election.cc:343] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.583811 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:58.584542 13164 raft_consensus.cc:2468] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:58.585662 13431 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:58.585780 13353 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:58.586958 13566 raft_consensus.cc:2804] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.587339 13566 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.587672 13566 raft_consensus.cc:3060] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.591630 13523 raft_consensus.cc:515] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.509847 13429 ts_tablet_manager.cc:1434] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 12:28:58.594322 13429 tablet_bootstrap.cc:492] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.596125 13566 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.575268 13519 raft_consensus.cc:2804] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.597883 13519 raft_consensus.cc:493] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.598259 13519 raft_consensus.cc:3060] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.600462 13566 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.600507 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:28:58.602186 13352 leader_election.cc:343] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.602981 13127 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.562616 13568 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.604250 13545 raft_consensus.cc:2804] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.604636 13545 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.604997 13545 raft_consensus.cc:3060] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.608886 13431 tablet_bootstrap.cc:654] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.606742 13061 catalog_manager.cc:5697] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.611075 13523 leader_election.cc:290] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:58.611897 13568 consensus_queue.cc:1048] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.612112 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
W20260709 12:28:58.623001 13279 leader_election.cc:343] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.597599 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.625738 13430 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
W20260709 12:28:58.625845 13129 leader_election.cc:343] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.626307 13430 ts_tablet_manager.cc:1403] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.006s
I20260709 12:28:58.628973 13430 raft_consensus.cc:359] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.629513 13472 raft_consensus.cc:515] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.632084 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:58.632351 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde9f8bf8cdf4ce08f666bdc04a7c318" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:58.632784 13386 raft_consensus.cc:3060] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.633169 13163 raft_consensus.cc:3060] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.634413 13429 tablet_bootstrap.cc:654] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.635169 13568 raft_consensus.cc:493] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.635705 13568 raft_consensus.cc:515] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.638507 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:58.639943 13352 leader_election.cc:343] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.629617 13430 raft_consensus.cc:385] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.640436 13386 raft_consensus.cc:2468] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:58.640437 13163 raft_consensus.cc:2468] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:58.641801 13276 leader_election.cc:304] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:58.641935 13279 leader_election.cc:304] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:58.642122 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:58.642505 13568 leader_election.cc:290] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.643110 13439 raft_consensus.cc:2804] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.643471 13430 raft_consensus.cc:740] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
W20260709 12:28:58.643589 13353 leader_election.cc:343] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.643908 13439 raft_consensus.cc:697] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:58.644101 13353 leader_election.cc:304] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:58.644331 13430 consensus_queue.cc:260] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.644804 13439 consensus_queue.cc:237] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.645339 13566 raft_consensus.cc:2749] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:58.646423 13601 raft_consensus.cc:2804] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.646812 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:58.647302 13601 raft_consensus.cc:697] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:58.648183 13601 consensus_queue.cc:237] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.650928 13472 leader_election.cc:290] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.652287 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde9f8bf8cdf4ce08f666bdc04a7c318" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:58.652981 13239 raft_consensus.cc:3060] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.646453 13430 ts_tablet_manager.cc:1434] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:28:58.655083 13430 tablet_bootstrap.cc:492] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:58.643072 13545 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.657728 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:58.658027 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:58.658542 13386 raft_consensus.cc:2393] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
W20260709 12:28:58.659593 13129 leader_election.cc:343] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.660224 13127 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:58.661202 13484 raft_consensus.cc:2749] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:58.662284 13164 raft_consensus.cc:2393] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc0a5489897d4f6c8dd410cb6daee91b in current term 1: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:28:58.655040 13519 raft_consensus.cc:515] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.664352 13353 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:58.665488 13566 raft_consensus.cc:2749] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:58.666673 13545 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.668653 13429 tablet_bootstrap.cc:492] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.670527 13429 ts_tablet_manager.cc:1403] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 12:28:58.669375 13483 consensus_queue.cc:1048] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.671273 13433 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:58.671799 13433 ts_tablet_manager.cc:1403] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.211s	user 0.039s	sys 0.049s
I20260709 12:28:58.675274 13433 raft_consensus.cc:359] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.675683 13429 raft_consensus.cc:359] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.676266 13433 raft_consensus.cc:385] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.676643 13433 raft_consensus.cc:740] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.664346 13431 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:58.676635 13429 raft_consensus.cc:385] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.677659 13431 ts_tablet_manager.cc:1403] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.001s
I20260709 12:28:58.677760 13433 consensus_queue.cc:260] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.679975 13433 ts_tablet_manager.cc:1434] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:58.680825 13433 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:58.685009 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b658edca804986a4f3a9879589f0d2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:58.685644 13238 raft_consensus.cc:3060] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.687037 13433 tablet_bootstrap.cc:654] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.688066 13431 raft_consensus.cc:359] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.688819 13431 raft_consensus.cc:385] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.689133 13431 raft_consensus.cc:740] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.689850 13429 raft_consensus.cc:740] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.691993 13429 consensus_queue.cc:260] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.690461 13431 consensus_queue.cc:260] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.694619 13431 ts_tablet_manager.cc:1434] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:28:58.696497 13429 ts_tablet_manager.cc:1434] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:28:58.697089 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b658edca804986a4f3a9879589f0d2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:58.696777 13058 catalog_manager.cc:5697] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:58.697724 13312 raft_consensus.cc:3060] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.698053 13429 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.698850 13058 catalog_manager.cc:5697] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.700529 13433 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:58.700645 13431 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:58.701018 13433 ts_tablet_manager.cc:1403] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.005s
I20260709 12:28:58.703945 13433 raft_consensus.cc:359] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.704579 13433 raft_consensus.cc:385] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.704840 13433 raft_consensus.cc:740] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.705633 13433 consensus_queue.cc:260] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.706327 13483 consensus_queue.cc:1048] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.707877 13433 ts_tablet_manager.cc:1434] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:28:58.708918 13433 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:58.710038 13431 tablet_bootstrap.cc:654] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.713689 13519 leader_election.cc:290] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.711930 13429 tablet_bootstrap.cc:654] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.713928 13236 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.719194 13595 raft_consensus.cc:493] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.719789 13595 raft_consensus.cc:515] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.721896 13595 leader_election.cc:290] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.724668 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:58.725394 13386 raft_consensus.cc:2468] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:58.727758 13127 leader_election.cc:304] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.728011 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.729008 13429 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.729496 13595 raft_consensus.cc:2804] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:58.729918 13129 leader_election.cc:343] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.730059 13595 raft_consensus.cc:493] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.730559 13595 raft_consensus.cc:3060] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.736927 13430 tablet_bootstrap.cc:654] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.737532 13595 raft_consensus.cc:515] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.738500 13429 ts_tablet_manager.cc:1403] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.000s
I20260709 12:28:58.741447 13238 raft_consensus.cc:2468] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:58.741390 13483 consensus_queue.cc:1048] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:58.747048 13352 leader_election.cc:304] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:58.748003 13563 raft_consensus.cc:2804] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.748252 13594 consensus_queue.cc:1048] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:58.748582 13563 raft_consensus.cc:697] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:58.748593 13431 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:58.749470 13563 consensus_queue.cc:237] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.751062 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:58.751677 13385 raft_consensus.cc:3060] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.751842 13433 tablet_bootstrap.cc:654] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.760951 13385 raft_consensus.cc:2468] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:58.747191 13429 raft_consensus.cc:359] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.763566 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:58.669788 13239 raft_consensus.cc:2468] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:58.764405 13595 leader_election.cc:290] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
W20260709 12:28:58.765048 13129 leader_election.cc:343] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.766466 13127 leader_election.cc:304] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:58.763801 13429 raft_consensus.cc:385] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.767349 13594 raft_consensus.cc:2804] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:58.767621 13429 raft_consensus.cc:740] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.768839 13430 tablet_bootstrap.cc:492] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:58.767915 13594 raft_consensus.cc:697] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:28:58.749560 13431 ts_tablet_manager.cc:1403] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.005s
I20260709 12:28:58.769675 13430 ts_tablet_manager.cc:1403] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.115s	user 0.012s	sys 0.003s
I20260709 12:28:58.770936 13594 consensus_queue.cc:237] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.773376 13430 raft_consensus.cc:359] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.773888 13431 raft_consensus.cc:359] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.774771 13431 raft_consensus.cc:385] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.775071 13431 raft_consensus.cc:740] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.774051 13430 raft_consensus.cc:385] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.769620 13429 consensus_queue.cc:260] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.777995 13430 raft_consensus.cc:740] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.779234 13430 consensus_queue.cc:260] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:58.780665 13429 ts_tablet_manager.cc:1434] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:28:58.779125 13431 consensus_queue.cc:260] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.783301 13431 ts_tablet_manager.cc:1434] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:28:58.784432 13430 ts_tablet_manager.cc:1434] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:28:58.785317 13431 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:58.785630 13430 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:58.784332 13429 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.798743 13430 tablet_bootstrap.cc:654] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.803606 13431 tablet_bootstrap.cc:654] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.804546 13429 tablet_bootstrap.cc:654] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.812299 13601 raft_consensus.cc:493] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.812882 13601 raft_consensus.cc:515] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.815827 13500 raft_consensus.cc:493] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.816354 13500 raft_consensus.cc:515] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.818473 13500 leader_election.cc:290] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:58.819092 13545 consensus_queue.cc:1048] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.821048 13312 raft_consensus.cc:2468] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:58.822363 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:28:58.823791 13205 leader_election.cc:343] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.823861 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:58.822271 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:58.824080 13601 leader_election.cc:290] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.824882 13313 raft_consensus.cc:2468] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 0.
I20260709 12:28:58.825644 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:58.826331 13239 raft_consensus.cc:2468] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:58.826226 13205 leader_election.cc:304] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5
W20260709 12:28:58.827486 13279 leader_election.cc:343] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.827771 13500 raft_consensus.cc:2804] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.828176 13500 raft_consensus.cc:493] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.828517 13500 raft_consensus.cc:3060] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.832221 13278 leader_election.cc:304] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:58.833395 13601 raft_consensus.cc:2804] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:58.833770 13601 raft_consensus.cc:493] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:58.834076 13601 raft_consensus.cc:3060] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.842085 13573 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:58.842795 13573 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:58.845836 13573 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:58.846565 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:58.847384 13386 raft_consensus.cc:2393] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:28:58.849998 13431 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:58.854151 13431 ts_tablet_manager.cc:1403] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.006s
I20260709 12:28:58.842084 13601 raft_consensus.cc:515] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.853340 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:58.856567 13163 raft_consensus.cc:2393] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:28:58.858505 13205 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:58.858891 13429 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.859556 13429 ts_tablet_manager.cc:1403] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.004s
I20260709 12:28:58.859643 13573 raft_consensus.cc:3060] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:58.861294 13431 raft_consensus.cc:359] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.865573 13431 raft_consensus.cc:385] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.870721 13431 raft_consensus.cc:740] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.871811 13431 consensus_queue.cc:260] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.874478 13431 ts_tablet_manager.cc:1434] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:28:58.875654 13431 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:58.868527 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:58.864769 13429 raft_consensus.cc:359] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.876410 13429 raft_consensus.cc:385] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.876714 13429 raft_consensus.cc:740] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.877708 13429 consensus_queue.cc:260] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.880317 13429 ts_tablet_manager.cc:1434] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:28:58.867825 13573 raft_consensus.cc:2749] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:58.881660 13279 leader_election.cc:343] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.881726 13429 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.896277 13429 tablet_bootstrap.cc:654] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.898981 13431 tablet_bootstrap.cc:654] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.872324 13601 leader_election.cc:290] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:58.873302 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:58.902251 13500 raft_consensus.cc:515] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.908576 13429 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.909207 13429 ts_tablet_manager.cc:1403] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.003s
I20260709 12:28:58.912137 13429 raft_consensus.cc:359] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.913192 13429 raft_consensus.cc:385] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:58.913920 13429 raft_consensus.cc:740] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:58.918412 13519 consensus_queue.cc:1048] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.919896 13239 raft_consensus.cc:2393] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 in current term 1: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:28:58.921953 13278 leader_election.cc:304] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:58.923039 13523 raft_consensus.cc:2749] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:58.811096 13062 catalog_manager.cc:5697] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:58.931156 13061 catalog_manager.cc:5697] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:58.915359 13429 consensus_queue.cc:260] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:58.945272 13566 consensus_queue.cc:1048] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:58.952103 13429 ts_tablet_manager.cc:1434] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 12:28:58.953223 13429 tablet_bootstrap.cc:492] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:58.973213 13429 tablet_bootstrap.cc:654] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:58.985069 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
W20260709 12:28:58.986750 13205 leader_election.cc:343] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:58.988246 13429 tablet_bootstrap.cc:492] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:58.989230 13429 ts_tablet_manager.cc:1403] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.005s
I20260709 12:28:58.989032 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:58.990576 13311 raft_consensus.cc:2393] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:28:58.991904 13205 leader_election.cc:304] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:58.992836 13573 raft_consensus.cc:2749] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:58.992216 13433 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:58.994035 13433 ts_tablet_manager.cc:1403] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.285s	user 0.082s	sys 0.066s
I20260709 12:28:58.996896 13433 raft_consensus.cc:359] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:58.997900 13500 leader_election.cc:290] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.000187 13429 raft_consensus.cc:359] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.001406 13429 raft_consensus.cc:385] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.001760 13429 raft_consensus.cc:740] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.002629 13429 consensus_queue.cc:260] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.002650 13430 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.001046 13433 raft_consensus.cc:385] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.005247 13433 raft_consensus.cc:740] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.005089 13430 ts_tablet_manager.cc:1403] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.220s	user 0.043s	sys 0.041s
I20260709 12:28:59.005973 13433 consensus_queue.cc:260] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.007776 13431 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:59.008122 13433 ts_tablet_manager.cc:1434] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:28:59.008256 13431 ts_tablet_manager.cc:1403] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.133s	user 0.025s	sys 0.019s
I20260709 12:28:59.008697 13430 raft_consensus.cc:359] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.009384 13430 raft_consensus.cc:385] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.009176 13433 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.009684 13430 raft_consensus.cc:740] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.010399 13430 consensus_queue.cc:260] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.010906 13431 raft_consensus.cc:359] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.011629 13431 raft_consensus.cc:385] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.011900 13431 raft_consensus.cc:740] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.012502 13430 ts_tablet_manager.cc:1434] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:59.009701 13429 ts_tablet_manager.cc:1434] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:28:59.012655 13431 consensus_queue.cc:260] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.013669 13429 tablet_bootstrap.cc:492] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.016434 13433 tablet_bootstrap.cc:654] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.019953 13431 ts_tablet_manager.cc:1434] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:59.020754 13430 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.021003 13431 tablet_bootstrap.cc:492] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:59.026752 13430 tablet_bootstrap.cc:654] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.027595 13431 tablet_bootstrap.cc:654] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.019721 13429 tablet_bootstrap.cc:654] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.033069 13433 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.033526 13433 ts_tablet_manager.cc:1403] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 12:28:59.034556 13431 tablet_bootstrap.cc:492] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:59.035051 13431 ts_tablet_manager.cc:1403] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:28:59.036092 13433 raft_consensus.cc:359] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.036922 13433 raft_consensus.cc:385] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.037207 13433 raft_consensus.cc:740] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.036538 13430 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.038889 13430 ts_tablet_manager.cc:1403] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.005s
I20260709 12:28:59.039575 13431 raft_consensus.cc:359] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.040323 13431 raft_consensus.cc:385] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.040625 13431 raft_consensus.cc:740] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.041426 13431 consensus_queue.cc:260] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.037992 13433 consensus_queue.cc:260] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.041558 13430 raft_consensus.cc:359] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.042433 13430 raft_consensus.cc:385] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.042755 13430 raft_consensus.cc:740] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.043584 13430 consensus_queue.cc:260] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.043980 13433 ts_tablet_manager.cc:1434] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:28:59.042016 13472 consensus_queue.cc:1048] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:59.045055 13433 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.046069 13430 ts_tablet_manager.cc:1434] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:28:59.047019 13430 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.051235 13433 tablet_bootstrap.cc:654] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.052508 13430 tablet_bootstrap.cc:654] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.056433 13431 ts_tablet_manager.cc:1434] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:28:59.057540 13431 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:59.064502 13601 consensus_queue.cc:1048] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:59.070555 13433 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.070890 13430 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.071081 13433 ts_tablet_manager.cc:1403] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 12:28:59.071555 13430 ts_tablet_manager.cc:1403] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 12:28:59.073869 13433 raft_consensus.cc:359] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.074549 13433 raft_consensus.cc:385] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.074800 13433 raft_consensus.cc:740] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.079854 13430 raft_consensus.cc:359] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.080639 13430 raft_consensus.cc:385] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.080968 13430 raft_consensus.cc:740] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.081382 13433 consensus_queue.cc:260] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.081787 13430 consensus_queue.cc:260] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.084266 13430 ts_tablet_manager.cc:1434] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:28:59.084266 13433 ts_tablet_manager.cc:1434] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:28:59.085376 13430 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.085376 13433 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.090008 13431 tablet_bootstrap.cc:654] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.092945 13433 tablet_bootstrap.cc:654] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.099313 13429 tablet_bootstrap.cc:492] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.093022 13430 tablet_bootstrap.cc:654] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.099856 13429 ts_tablet_manager.cc:1403] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.086s	user 0.024s	sys 0.015s
I20260709 12:28:59.103305 13429 raft_consensus.cc:359] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.103996 13429 raft_consensus.cc:385] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.104275 13429 raft_consensus.cc:740] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.107661 13430 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.107576 13429 consensus_queue.cc:260] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.108176 13430 ts_tablet_manager.cc:1403] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 12:28:59.108063 13433 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.109001 13433 ts_tablet_manager.cc:1403] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 12:28:59.110908 13430 raft_consensus.cc:359] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.111596 13430 raft_consensus.cc:385] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.111869 13430 raft_consensus.cc:740] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.111891 13433 raft_consensus.cc:359] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.112438 13472 consensus_queue.cc:1048] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:59.112790 13433 raft_consensus.cc:385] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.112577 13430 consensus_queue.cc:260] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.113185 13433 raft_consensus.cc:740] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.113955 13433 consensus_queue.cc:260] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.114884 13430 ts_tablet_manager.cc:1434] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:28:59.116374 13433 ts_tablet_manager.cc:1434] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:59.117103 13429 ts_tablet_manager.cc:1434] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:28:59.118021 13433 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.118021 13429 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.118582 13430 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.124802 13433 tablet_bootstrap.cc:654] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.127151 13431 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:59.127219 13594 raft_consensus.cc:493] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.127862 13431 ts_tablet_manager.cc:1403] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.000s
I20260709 12:28:59.127951 13594 raft_consensus.cc:515] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.130288 13594 leader_election.cc:290] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.132400 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.133217 13237 raft_consensus.cc:2393] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:28:59.133769 13430 tablet_bootstrap.cc:654] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.136231 13500 raft_consensus.cc:493] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.136727 13500 raft_consensus.cc:515] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.137452 13429 tablet_bootstrap.cc:654] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.138727 13500 leader_election.cc:290] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.137495 13472 raft_consensus.cc:493] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.139907 13472 raft_consensus.cc:515] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.140606 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342a1932e1f84a15837148bd0ca8d0c8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.141245 13163 raft_consensus.cc:2468] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 0.
I20260709 12:28:59.142616 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342a1932e1f84a15837148bd0ca8d0c8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.143239 13311 raft_consensus.cc:2468] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 0.
I20260709 12:28:59.143365 13472 leader_election.cc:290] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:59.143744 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.180801 13237 raft_consensus.cc:2468] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:59.144518 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.181730 13429 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.163594 13384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:59.182325 13429 ts_tablet_manager.cc:1403] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.001s
I20260709 12:28:59.182705 13384 raft_consensus.cc:2468] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:59.184477 13519 raft_consensus.cc:493] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.167495 13566 raft_consensus.cc:493] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.185047 13519 raft_consensus.cc:515] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.185086 13566 raft_consensus.cc:515] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.185573 13429 raft_consensus.cc:359] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.186393 13429 raft_consensus.cc:385] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.186646 13429 raft_consensus.cc:740] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.177346 13545 raft_consensus.cc:493] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.187664 13545 raft_consensus.cc:515] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.187193 13519 leader_election.cc:290] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:59.188601 13276 leader_election.cc:304] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.190397 13163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215896cbd30347de953b41e58793fe69" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.190737 13601 raft_consensus.cc:2804] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.191052 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.191766 13313 raft_consensus.cc:2468] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.192960 13312 raft_consensus.cc:2393] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:28:59.194299 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.194484 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215896cbd30347de953b41e58793fe69" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.195035 13164 raft_consensus.cc:2468] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.196420 13130 leader_election.cc:304] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:28:59.196822 13353 leader_election.cc:304] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
W20260709 12:28:59.198222 13353 leader_election.cc:343] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.198310 13595 raft_consensus.cc:3060] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.198753 13433 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.199255 13433 ts_tablet_manager.cc:1403] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.081s	user 0.034s	sys 0.017s
I20260709 12:28:59.201601 13483 raft_consensus.cc:2804] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.148881 13205 leader_election.cc:304] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:59.201994 13433 raft_consensus.cc:359] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.202775 13433 raft_consensus.cc:385] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:28:59.202740 13205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:44667, user_credentials={real_user=slave}} blocked reactor thread for 53993us
I20260709 12:28:59.203195 13433 raft_consensus.cc:740] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.203444 13500 raft_consensus.cc:2804] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.203831 13500 raft_consensus.cc:493] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.204188 13500 raft_consensus.cc:3060] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.203970 13433 consensus_queue.cc:260] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.205542 13433 ts_tablet_manager.cc:1434] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:59.205979 13601 raft_consensus.cc:493] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.206439 13601 raft_consensus.cc:3060] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.201992 13483 raft_consensus.cc:493] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.208487 13483 raft_consensus.cc:3060] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.218153 13595 raft_consensus.cc:2749] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:59.187901 13429 consensus_queue.cc:260] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.222884 13311 raft_consensus.cc:2468] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.223691 13439 raft_consensus.cc:493] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.224280 13439 raft_consensus.cc:515] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.187179 13566 leader_election.cc:290] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:59.231528 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7a585187844a68f08b1d640f1cf7c" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:59.233150 13278 leader_election.cc:343] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.234306 13439 leader_election.cc:290] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:59.236343 13429 ts_tablet_manager.cc:1434] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 12:28:59.237362 13601 raft_consensus.cc:515] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.240599 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:59.241204 13237 raft_consensus.cc:3060] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.245898 13353 leader_election.cc:304] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:59.247364 13384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7a585187844a68f08b1d640f1cf7c" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:59.247751 13566 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.249459 13566 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.252754 13563 raft_consensus.cc:2804] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.253198 13563 raft_consensus.cc:493] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.253544 13563 raft_consensus.cc:3060] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.263595 13519 consensus_queue.cc:1048] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:59.275183 13601 leader_election.cc:290] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:59.278101 13594 consensus_queue.cc:1048] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:59.279771 13566 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.280898 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.281700 13433 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:28:59.282570 13352 leader_election.cc:343] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.283617 13566 raft_consensus.cc:493] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.284101 13566 raft_consensus.cc:515] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.285185 13500 raft_consensus.cc:515] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.286126 13566 leader_election.cc:290] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.288154 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:59.288830 13276 leader_election.cc:343] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.319193 13276 leader_election.cc:304] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:59.319658 13500 leader_election.cc:290] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.320906 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.290107 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:59.321707 13386 raft_consensus.cc:3060] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.321913 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342a1932e1f84a15837148bd0ca8d0c8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:59.322567 13162 raft_consensus.cc:3060] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:59.323737 13352 leader_election.cc:343] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.290290 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.291075 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.325556 13311 raft_consensus.cc:2468] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.325501 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "342a1932e1f84a15837148bd0ca8d0c8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
W20260709 12:28:59.326076 13353 leader_election.cc:343] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.326574 13312 raft_consensus.cc:3060] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.326642 13353 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.327692 13566 raft_consensus.cc:2749] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:59.328258 13353 leader_election.cc:304] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.293241 13237 raft_consensus.cc:2468] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:59.295181 13163 raft_consensus.cc:3060] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.330117 13278 leader_election.cc:304] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:59.330909 13472 raft_consensus.cc:2749] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:59.331444 13601 raft_consensus.cc:2804] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.331957 13601 raft_consensus.cc:697] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:28:59.332768 13601 consensus_queue.cc:237] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.296334 13545 leader_election.cc:290] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:59.335351 13312 raft_consensus.cc:2468] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:28:59.293488 13433 tablet_bootstrap.cc:654] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.336544 13205 leader_election.cc:304] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:59.297402 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:59.338147 13573 raft_consensus.cc:2804] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.338647 13573 raft_consensus.cc:697] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:28:59.339578 13566 raft_consensus.cc:2804] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.339455 13573 consensus_queue.cc:237] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.340003 13566 raft_consensus.cc:493] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.263954 13429 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.290958 13519 consensus_queue.cc:1048] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:28:59.340456 13566 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.342336 13519 raft_consensus.cc:493] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.342784 13519 raft_consensus.cc:515] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.305337 13239 raft_consensus.cc:3060] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.316726 13563 raft_consensus.cc:515] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.317539 13483 raft_consensus.cc:515] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.339856 13127 leader_election.cc:304] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:28:59.312345 13431 raft_consensus.cc:359] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.344938 13431 raft_consensus.cc:385] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.345223 13431 raft_consensus.cc:740] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.345902 13483 leader_election.cc:290] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:59.348448 13519 leader_election.cc:290] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.351292 13545 raft_consensus.cc:2749] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:59.345876 13431 consensus_queue.cc:260] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.352005 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f143366d33a942e6a4da9183209575b2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.352660 13238 raft_consensus.cc:2468] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.353492 13431 ts_tablet_manager.cc:1434] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.225s	user 0.005s	sys 0.000s
I20260709 12:28:59.358634 13431 tablet_bootstrap.cc:492] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:59.358340 13545 consensus_queue.cc:1048] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:59.362044 13352 leader_election.cc:304] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.362228 13162 raft_consensus.cc:2468] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:28:59.362236 13386 raft_consensus.cc:2468] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:59.365803 13472 consensus_queue.cc:1048] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:59.366263 13563 leader_election.cc:290] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:59.369128 13431 tablet_bootstrap.cc:654] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.370092 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:59.370693 13313 raft_consensus.cc:3060] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.372473 13430 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.372987 13430 ts_tablet_manager.cc:1403] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.256s	user 0.067s	sys 0.067s
I20260709 12:28:59.373188 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:59.373872 13161 raft_consensus.cc:3060] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.375813 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f143366d33a942e6a4da9183209575b2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.376475 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215896cbd30347de953b41e58793fe69" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:59.377296 13162 raft_consensus.cc:3060] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.376497 13160 raft_consensus.cc:2468] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.373208 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "215896cbd30347de953b41e58793fe69" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:59.381093 13311 raft_consensus.cc:3060] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.378988 13566 raft_consensus.cc:515] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.363269 13519 raft_consensus.cc:2804] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.390069 13430 raft_consensus.cc:359] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.396835 13430 raft_consensus.cc:385] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.397248 13430 raft_consensus.cc:740] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.400470 13433 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.400995 13433 ts_tablet_manager.cc:1403] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.005s
I20260709 12:28:59.398015 13430 consensus_queue.cc:260] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.401340 13313 raft_consensus.cc:2468] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.403584 13433 raft_consensus.cc:359] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.404063 13430 ts_tablet_manager.cc:1434] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:28:59.404294 13433 raft_consensus.cc:385] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.404578 13433 raft_consensus.cc:740] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.396162 13519 raft_consensus.cc:493] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.415592 13519 raft_consensus.cc:3060] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.419498 13058 catalog_manager.cc:5697] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.422279 13429 tablet_bootstrap.cc:654] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.408022 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:28:59.424559 13352 leader_election.cc:343] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.427327 13311 raft_consensus.cc:2468] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.410751 13433 consensus_queue.cc:260] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.408552 13161 raft_consensus.cc:2468] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.434008 13430 tablet_bootstrap.cc:492] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.439046 13433 ts_tablet_manager.cc:1434] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:28:59.430095 13566 leader_election.cc:290] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.441685 13433 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.442545 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:59.443131 13311 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.446158 13353 leader_election.cc:304] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.447077 13646 raft_consensus.cc:2804] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.447113 13353 leader_election.cc:304] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.447710 13646 raft_consensus.cc:697] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:59.448544 13646 consensus_queue.cc:237] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.450394 13563 raft_consensus.cc:2804] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.450897 13563 raft_consensus.cc:697] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:59.453537 13563 consensus_queue.cc:237] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.453367 13058 catalog_manager.cc:5697] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.471964 13162 raft_consensus.cc:2468] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.479389 13430 tablet_bootstrap.cc:654] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.486943 13429 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.487424 13429 ts_tablet_manager.cc:1403] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.225s	user 0.018s	sys 0.008s
I20260709 12:28:59.491292 13433 tablet_bootstrap.cc:654] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.495759 13519 raft_consensus.cc:515] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.498240 13519 leader_election.cc:290] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.498711 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f143366d33a942e6a4da9183209575b2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:59.499331 13162 raft_consensus.cc:3060] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.503746 13311 raft_consensus.cc:2468] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
W20260709 12:28:59.504938 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:59.508389 13429 raft_consensus.cc:359] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.509102 13429 raft_consensus.cc:385] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.509362 13429 raft_consensus.cc:740] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.510027 13429 consensus_queue.cc:260] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.513015 13429 ts_tablet_manager.cc:1434] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:28:59.513886 13429 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.514122 13430 tablet_bootstrap.cc:492] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.514727 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f143366d33a942e6a4da9183209575b2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:59.515461 13236 raft_consensus.cc:3060] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.522289 13429 tablet_bootstrap.cc:654] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.522485 13236 raft_consensus.cc:2468] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.523650 13352 leader_election.cc:304] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.523869 13430 ts_tablet_manager.cc:1403] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.000s
I20260709 12:28:59.515067 13353 leader_election.cc:304] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.524519 13519 raft_consensus.cc:2804] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.525036 13519 raft_consensus.cc:697] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:59.525790 13566 raft_consensus.cc:2804] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.525849 13519 consensus_queue.cc:237] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.526463 13566 raft_consensus.cc:697] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:59.527035 13430 raft_consensus.cc:359] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.527272 13566 consensus_queue.cc:237] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.531747 13430 raft_consensus.cc:385] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.532397 13430 raft_consensus.cc:740] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.533527 13430 consensus_queue.cc:260] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.536381 13430 ts_tablet_manager.cc:1434] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 12:28:59.537976 13162 raft_consensus.cc:2468] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.546384 13430 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.547247 13058 catalog_manager.cc:5697] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.550448 13058 catalog_manager.cc:5697] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.555896 13429 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.556393 13429 ts_tablet_manager.cc:1403] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.005s
I20260709 12:28:59.558413 13429 raft_consensus.cc:359] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.558876 13429 raft_consensus.cc:385] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.559082 13429 raft_consensus.cc:740] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.559528 13430 tablet_bootstrap.cc:654] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.559849 13429 consensus_queue.cc:260] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.560807 13433 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.561317 13433 ts_tablet_manager.cc:1403] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.000s
I20260709 12:28:59.563841 13433 raft_consensus.cc:359] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.566572 13433 raft_consensus.cc:385] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.566895 13433 raft_consensus.cc:740] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.567593 13433 consensus_queue.cc:260] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.570003 13433 ts_tablet_manager.cc:1434] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:59.570927 13433 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.573647 13429 ts_tablet_manager.cc:1434] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:28:59.576776 13430 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.577248 13430 ts_tablet_manager.cc:1403] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.000s
I20260709 12:28:59.579042 13433 tablet_bootstrap.cc:654] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.580842 13429 tablet_bootstrap.cc:492] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.582228 13430 raft_consensus.cc:359] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.582923 13430 raft_consensus.cc:385] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.578648 13431 tablet_bootstrap.cc:492] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:59.585264 13431 ts_tablet_manager.cc:1403] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.227s	user 0.006s	sys 0.007s
I20260709 12:28:59.583185 13430 raft_consensus.cc:740] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.587357 13430 consensus_queue.cc:260] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.587921 13431 raft_consensus.cc:359] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.588615 13431 raft_consensus.cc:385] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.588889 13431 raft_consensus.cc:740] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.591769 13430 ts_tablet_manager.cc:1434] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:28:59.592689 13430 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.593508 13431 consensus_queue.cc:260] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.599493 13430 tablet_bootstrap.cc:654] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.608314 13061 catalog_manager.cc:5697] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.610092 13061 catalog_manager.cc:5697] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:59.599393 13431 ts_tablet_manager.cc:1434] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:28:59.615806 13431 tablet_bootstrap.cc:492] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:59.629451 13429 tablet_bootstrap.cc:654] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.633621 13430 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.634244 13430 ts_tablet_manager.cc:1403] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.042s	user 0.024s	sys 0.015s
I20260709 12:28:59.634449 13433 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.634932 13433 ts_tablet_manager.cc:1403] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.064s	user 0.034s	sys 0.015s
I20260709 12:28:59.636583 13431 tablet_bootstrap.cc:654] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.637164 13430 raft_consensus.cc:359] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.637401 13433 raft_consensus.cc:359] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.637954 13430 raft_consensus.cc:385] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.638108 13433 raft_consensus.cc:385] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.638532 13430 raft_consensus.cc:740] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.638561 13433 raft_consensus.cc:740] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.638856 13545 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.639735 13545 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.639894 13430 consensus_queue.cc:260] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.641847 13545 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.642066 13430 ts_tablet_manager.cc:1434] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:59.643124 13430 tablet_bootstrap.cc:492] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.645424 13429 tablet_bootstrap.cc:492] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.645282 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:59.645957 13386 raft_consensus.cc:2468] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:59.647899 13429 ts_tablet_manager.cc:1403] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.067s	user 0.008s	sys 0.003s
I20260709 12:28:59.647801 13127 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.648816 13430 tablet_bootstrap.cc:654] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.649012 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:59.650516 13129 leader_election.cc:343] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.651486 13545 raft_consensus.cc:2804] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.651919 13545 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.652298 13545 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.652189 13429 raft_consensus.cc:359] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.652993 13429 raft_consensus.cc:385] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.653277 13429 raft_consensus.cc:740] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.655967 13429 consensus_queue.cc:260] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.659057 13433 consensus_queue.cc:260] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.663043 13433 ts_tablet_manager.cc:1434] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.006s
I20260709 12:28:59.660698 13545 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.666102 13429 ts_tablet_manager.cc:1434] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:28:59.667201 13429 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.667636 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:59.668242 13386 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.676820 13386 raft_consensus.cc:2468] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:59.678021 13127 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.678898 13595 raft_consensus.cc:2804] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.679378 13595 raft_consensus.cc:697] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:28:59.680235 13595 consensus_queue.cc:237] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.684978 13472 raft_consensus.cc:493] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.665395 13433 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.685952 13472 raft_consensus.cc:515] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.689783 13472 leader_election.cc:290] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.687568 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:59.691324 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cd3149d5184714857f3c05a1fcaa4c" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.691632 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cd3149d5184714857f3c05a1fcaa4c" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:28:59.692078 13129 leader_election.cc:343] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.692333 13162 raft_consensus.cc:2468] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:59.693686 13279 leader_election.cc:304] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
W20260709 12:28:59.694245 13278 leader_election.cc:343] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.694500 13472 raft_consensus.cc:2804] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.695230 13472 raft_consensus.cc:493] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.695624 13472 raft_consensus.cc:3060] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.704279 13472 raft_consensus.cc:515] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.707683 13545 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.714025 13433 tablet_bootstrap.cc:654] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.717999 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cd3149d5184714857f3c05a1fcaa4c" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:28:59.718640 13162 raft_consensus.cc:3060] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.718956 13430 tablet_bootstrap.cc:492] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.719592 13430 ts_tablet_manager.cc:1403] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.077s	user 0.019s	sys 0.044s
I20260709 12:28:59.722289 13430 raft_consensus.cc:359] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.722990 13430 raft_consensus.cc:385] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.722954 13573 consensus_queue.cc:1048] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:59.723678 13430 raft_consensus.cc:740] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.724514 13430 consensus_queue.cc:260] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.726405 13162 raft_consensus.cc:2468] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:28:59.726908 13430 ts_tablet_manager.cc:1434] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:28:59.719031 13519 raft_consensus.cc:493] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.728032 13472 leader_election.cc:290] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.727821 13519 raft_consensus.cc:515] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.695230 13429 tablet_bootstrap.cc:654] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.729112 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8cd3149d5184714857f3c05a1fcaa4c" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:59.729889 13519 leader_election.cc:290] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
W20260709 12:28:59.730672 13278 leader_election.cc:343] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.732331 13279 leader_election.cc:304] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.732437 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.733291 13472 raft_consensus.cc:2804] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.733779 13472 raft_consensus.cc:697] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
W20260709 12:28:59.734083 13352 leader_election.cc:343] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.731812 13430 tablet_bootstrap.cc:492] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.734560 13472 consensus_queue.cc:237] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.736294 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.737042 13519 raft_consensus.cc:493] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.737515 13519 raft_consensus.cc:515] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.740453 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7a585187844a68f08b1d640f1cf7c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:28:59.742136 13352 leader_election.cc:343] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.743055 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7a585187844a68f08b1d640f1cf7c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.743769 13312 raft_consensus.cc:2468] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.745117 13353 leader_election.cc:304] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.746021 13566 raft_consensus.cc:2804] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.746418 13566 raft_consensus.cc:493] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.746589 13430 tablet_bootstrap.cc:654] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.747022 13566 raft_consensus.cc:3060] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.749565 13057 catalog_manager.cc:5697] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:59.751807 13519 leader_election.cc:290] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.753906 13431 tablet_bootstrap.cc:492] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:28:59.754457 13431 ts_tablet_manager.cc:1403] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.013s
W20260709 12:28:59.756431 13353 leader_election.cc:343] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.756953 13353 leader_election.cc:304] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.757385 13431 raft_consensus.cc:359] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.758059 13431 raft_consensus.cc:385] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.758242 13430 tablet_bootstrap.cc:492] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.758818 13646 raft_consensus.cc:2749] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:59.759030 13430 ts_tablet_manager.cc:1403] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.009s
I20260709 12:28:59.761895 13430 raft_consensus.cc:359] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.762763 13430 raft_consensus.cc:385] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.762780 13431 raft_consensus.cc:740] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.763236 13430 raft_consensus.cc:740] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.763765 13431 consensus_queue.cc:260] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.763991 13430 consensus_queue.cc:260] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.769706 13566 raft_consensus.cc:515] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.774053 13430 ts_tablet_manager.cc:1434] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:28:59.775056 13430 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:28:59.778447 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7a585187844a68f08b1d640f1cf7c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:28:59.779119 13239 raft_consensus.cc:3060] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.780890 13430 tablet_bootstrap.cc:654] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.788388 13239 raft_consensus.cc:2468] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.789817 13352 leader_election.cc:304] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:28:59.790875 13519 raft_consensus.cc:2804] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.791625 13519 raft_consensus.cc:697] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:28:59.792508 13519 consensus_queue.cc:237] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.796620 13431 ts_tablet_manager.cc:1434] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.004s
I20260709 12:28:59.799607 13429 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.800166 13429 ts_tablet_manager.cc:1403] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.133s	user 0.027s	sys 0.023s
I20260709 12:28:59.802982 13429 raft_consensus.cc:359] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.803746 13429 raft_consensus.cc:385] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.804064 13429 raft_consensus.cc:740] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.805346 13429 consensus_queue.cc:260] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.807729 13429 ts_tablet_manager.cc:1434] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:59.808626 13429 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.810581 13431 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:28:59.814257 13429 tablet_bootstrap.cc:654] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.815263 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efa7a585187844a68f08b1d640f1cf7c" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:59.815933 13312 raft_consensus.cc:3060] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.817922 13430 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.818252 13431 tablet_bootstrap.cc:654] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.818535 13430 ts_tablet_manager.cc:1403] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.017s
I20260709 12:28:59.819808 13545 raft_consensus.cc:493] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.820313 13545 raft_consensus.cc:515] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.821600 13430 raft_consensus.cc:359] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.822371 13430 raft_consensus.cc:385] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.823318 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.824023 13313 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:59.825206 13545 leader_election.cc:290] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:59.825387 13130 leader_election.cc:304] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:59.825948 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:59.826267 13595 raft_consensus.cc:2804] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.826721 13386 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:28:59.826750 13595 raft_consensus.cc:493] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.827433 13595 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.833592 13312 raft_consensus.cc:2468] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:28:59.835299 13429 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.822700 13430 raft_consensus.cc:740] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.835870 13429 ts_tablet_manager.cc:1403] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.010s
I20260709 12:28:59.837445 13566 leader_election.cc:290] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:28:59.838655 13429 raft_consensus.cc:359] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.839291 13429 raft_consensus.cc:385] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.839563 13429 raft_consensus.cc:740] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.840199 13429 consensus_queue.cc:260] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.842655 13433 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:28:59.843122 13433 ts_tablet_manager.cc:1403] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.000s
I20260709 12:28:59.844352 13429 ts_tablet_manager.cc:1434] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:59.845788 13433 raft_consensus.cc:359] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.846375 13429 tablet_bootstrap.cc:492] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:28:59.852862 13429 tablet_bootstrap.cc:654] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.835124 13595 raft_consensus.cc:515] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.853632 13061 catalog_manager.cc:5697] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:59.855608 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:28:59.856238 13312 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.857403 13433 raft_consensus.cc:385] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.857700 13433 raft_consensus.cc:740] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.858474 13433 consensus_queue.cc:260] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.863292 13312 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:28:59.863852 13472 raft_consensus.cc:493] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.864357 13472 raft_consensus.cc:515] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.864920 13130 leader_election.cc:304] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:28:59.866194 13430 consensus_queue.cc:260] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.866506 13472 leader_election.cc:290] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:59.869174 13545 raft_consensus.cc:2804] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:59.869663 13545 raft_consensus.cc:697] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:28:59.874567 13430 ts_tablet_manager.cc:1434] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.003s
I20260709 12:28:59.875269 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.875690 13430 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
W20260709 12:28:59.880352 13278 leader_election.cc:343] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.886691 13430 tablet_bootstrap.cc:654] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.889385 13545 consensus_queue.cc:237] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.889887 13573 consensus_queue.cc:1048] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:59.898185 13519 raft_consensus.cc:493] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.898809 13519 raft_consensus.cc:515] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:28:59.903604 13519 leader_election.cc:290] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:28:59.907989 13060 catalog_manager.cc:5697] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:59.912700 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:28:59.913486 13311 raft_consensus.cc:2468] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:28:59.915118 13472 raft_consensus.cc:493] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:59.915710 13472 raft_consensus.cc:515] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:28:59.917104 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.917740 13472 leader_election.cc:290] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:28:59.915735 13439 consensus_queue.cc:1048] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:59.918784 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:28:59.919440 13566 consensus_queue.cc:1048] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:59.920454 13278 leader_election.cc:343] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.922096 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:28:59.926887 13433 ts_tablet_manager.cc:1434] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.002s
I20260709 12:28:59.928043 13433 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:28:59.922806 13386 raft_consensus.cc:2468] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:28:59.936743 13439 consensus_queue.cc:1048] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:59.938707 13429 tablet_bootstrap.cc:492] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:28:59.939191 13429 ts_tablet_manager.cc:1403] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.093s	user 0.027s	sys 0.048s
I20260709 12:28:59.942041 13430 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:28:59.941896 13429 raft_consensus.cc:359] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.942536 13429 raft_consensus.cc:385] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.942884 13429 raft_consensus.cc:740] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.942569 13430 ts_tablet_manager.cc:1403] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.021s
I20260709 12:28:59.943648 13429 consensus_queue.cc:260] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:28:59.946081 13429 ts_tablet_manager.cc:1434] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:28:59.946344 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:28:59.946967 13429 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
W20260709 12:28:59.949663 13279 leader_election.cc:343] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.950150 13279 leader_election.cc:304] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.951244 13439 raft_consensus.cc:2749] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:59.951753 13430 raft_consensus.cc:359] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.952476 13430 raft_consensus.cc:385] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:59.952706 13430 raft_consensus.cc:740] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:28:59.953292 13430 consensus_queue.cc:260] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:28:59.958182 13430 ts_tablet_manager.cc:1434] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 12:28:59.962669 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:28:59.963348 13386 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:59.968379 13353 leader_election.cc:343] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:59.972633 13429 tablet_bootstrap.cc:654] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.973714 13353 leader_election.cc:304] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:28:59.978245 13566 raft_consensus.cc:2804] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.978638 13566 raft_consensus.cc:493] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.978907 13566 raft_consensus.cc:3060] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.957280 13595 leader_election.cc:290] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:28:59.989512 13276 leader_election.cc:304] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:28:59.992238 13433 tablet_bootstrap.cc:654] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:59.991310 13439 raft_consensus.cc:2804] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:59.994861 13439 raft_consensus.cc:493] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:59.995244 13439 raft_consensus.cc:3060] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:59.975595 13646 consensus_queue.cc:1048] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:29:00.006349 13431 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:00.006884 13431 ts_tablet_manager.cc:1403] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.196s	user 0.026s	sys 0.029s
I20260709 12:29:00.009589 13439 raft_consensus.cc:515] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.010583 13519 raft_consensus.cc:493] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.011101 13519 raft_consensus.cc:515] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.012498 13563 consensus_queue.cc:1048] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.014062 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:00.014195 13566 raft_consensus.cc:515] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
W20260709 12:29:00.015491 13278 leader_election.cc:343] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.016198 13439 leader_election.cc:290] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:00.016644 13519 leader_election.cc:290] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:00.017385 13566 leader_election.cc:290] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:00.020624 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.021919 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:00.022341 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:00.022894 13385 raft_consensus.cc:3060] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:00.023516 13352 leader_election.cc:343] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.027887 13239 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.028278 13386 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:00.026665 13061 catalog_manager.cc:5697] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:00.042754 13430 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:00.055795 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:00.056464 13310 raft_consensus.cc:3060] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.064517 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:00.064918 13500 raft_consensus.cc:493] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.065487 13500 raft_consensus.cc:515] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.066596 13313 raft_consensus.cc:2468] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
W20260709 12:29:00.070393 13353 leader_election.cc:343] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.071482 13566 consensus_queue.cc:1048] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.072986 13353 leader_election.cc:304] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:00.074406 13566 raft_consensus.cc:2804] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.074453 13519 consensus_queue.cc:1048] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.074894 13566 raft_consensus.cc:493] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.075278 13566 raft_consensus.cc:3060] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.076668 13500 leader_election.cc:290] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:00.075003 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:00.078864 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:00.079396 13313 raft_consensus.cc:2468] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:00.080914 13205 leader_election.cc:304] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:00.089965 13431 raft_consensus.cc:359] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.090777 13431 raft_consensus.cc:385] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.091039 13431 raft_consensus.cc:740] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.099850 13431 consensus_queue.cc:260] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.102931 13431 ts_tablet_manager.cc:1434] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.001s
I20260709 12:29:00.103900 13431 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:00.109579 13431 tablet_bootstrap.cc:654] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.110817 13566 raft_consensus.cc:515] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.127205 13430 tablet_bootstrap.cc:654] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.143633 13429 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:00.144196 13429 ts_tablet_manager.cc:1403] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.197s	user 0.018s	sys 0.020s
I20260709 12:29:00.146541 13433 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:00.147115 13433 ts_tablet_manager.cc:1403] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.005s
I20260709 12:29:00.150754 13385 raft_consensus.cc:2468] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:00.145030 13500 raft_consensus.cc:2804] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:00.152019 13566 leader_election.cc:290] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:00.152809 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:00.155946 13276 leader_election.cc:304] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
W20260709 12:29:00.156870 13352 leader_election.cc:343] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.157168 13566 consensus_queue.cc:1048] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:00.157112 13601 raft_consensus.cc:2804] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.159492 13601 raft_consensus.cc:697] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:00.160301 13601 consensus_queue.cc:237] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.158906 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:00.162431 13313 raft_consensus.cc:3060] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.164292 13439 consensus_queue.cc:1048] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.170635 13500 raft_consensus.cc:493] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fc0a5489897d4f6c8dd410cb6daee91b)
I20260709 12:29:00.171100 13500 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.173288 13646 consensus_queue.cc:1048] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.174149 13237 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.177309 13433 raft_consensus.cc:359] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.177908 13433 raft_consensus.cc:385] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.178110 13433 raft_consensus.cc:740] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.179184 13433 consensus_queue.cc:260] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.192166 13433 ts_tablet_manager.cc:1434] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:29:00.192031 13429 raft_consensus.cc:359] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.192914 13429 raft_consensus.cc:385] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.193269 13433 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:00.193241 13429 raft_consensus.cc:740] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.198359 13431 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:00.198977 13431 ts_tablet_manager.cc:1403] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.007s
I20260709 12:29:00.194404 13429 consensus_queue.cc:260] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.215996 13429 ts_tablet_manager.cc:1434] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 12:29:00.217154 13429 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:00.194757 13566 consensus_queue.cc:1048] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:29:00.234206 13429 tablet_bootstrap.cc:654] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.229539 13431 raft_consensus.cc:359] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.235080 13431 raft_consensus.cc:385] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.235378 13431 raft_consensus.cc:740] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.217758 13310 raft_consensus.cc:2468] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:00.241892 13431 consensus_queue.cc:260] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.255676 13595 consensus_queue.cc:1048] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.263532 13313 raft_consensus.cc:2468] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:00.283316 13693 consensus_queue.cc:1048] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.267292 13519 raft_consensus.cc:493] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.286836 13519 raft_consensus.cc:515] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.289127 13519 leader_election.cc:290] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.290403 13681 raft_consensus.cc:493] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.290963 13681 raft_consensus.cc:515] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.294415 13353 leader_election.cc:304] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:00.295751 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.296440 13236 raft_consensus.cc:2468] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:00.303256 13431 ts_tablet_manager.cc:1434] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.104s	user 0.018s	sys 0.018s
I20260709 12:29:00.304736 13353 leader_election.cc:304] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:00.293924 13681 leader_election.cc:290] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.268375 13595 consensus_queue.cc:1048] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.042s
I20260709 12:29:00.323696 13129 leader_election.cc:304] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:00.324689 13595 raft_consensus.cc:2804] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.325080 13595 raft_consensus.cc:493] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.325397 13595 raft_consensus.cc:3060] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.326012 13693 raft_consensus.cc:2804] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.326494 13693 raft_consensus.cc:697] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:00.328871 13430 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:00.329411 13430 ts_tablet_manager.cc:1403] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.287s	user 0.014s	sys 0.013s
I20260709 12:29:00.334188 13431 tablet_bootstrap.cc:492] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:00.320883 13433 tablet_bootstrap.cc:654] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.321749 13500 raft_consensus.cc:515] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.322467 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:00.323637 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.361479 13563 raft_consensus.cc:2804] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.327265 13693 consensus_queue.cc:237] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
W20260709 12:29:00.372876 13353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:44667, user_credentials={real_user=slave}} blocked reactor thread for 68235.8us
I20260709 12:29:00.386660 13058 catalog_manager.cc:5697] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.383994 13683 raft_consensus.cc:493] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.391799 13683 raft_consensus.cc:515] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.377846 13563 raft_consensus.cc:697] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:00.391804 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:00.408869 13429 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:00.408627 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:00.409034 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.409394 13309 raft_consensus.cc:2468] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
W20260709 12:29:00.410497 13129 leader_election.cc:343] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.411079 13431 tablet_bootstrap.cc:654] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.417848 13429 ts_tablet_manager.cc:1403] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.201s	user 0.015s	sys 0.004s
I20260709 12:29:00.420068 13430 raft_consensus.cc:359] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.420758 13430 raft_consensus.cc:385] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.421011 13430 raft_consensus.cc:740] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.421597 13430 consensus_queue.cc:260] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.423395 13595 raft_consensus.cc:515] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.416652 13386 raft_consensus.cc:2468] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:00.426724 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:00.427295 13238 raft_consensus.cc:3060] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:00.384737 13352 leader_election.cc:343] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.427734 13130 leader_election.cc:304] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
W20260709 12:29:00.428231 13352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 45553.8us
I20260709 12:29:00.429847 13684 raft_consensus.cc:2804] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.430244 13684 raft_consensus.cc:493] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.430550 13684 raft_consensus.cc:3060] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.439148 13500 leader_election.cc:290] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:00.431666 13595 leader_election.cc:290] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.447458 13430 ts_tablet_manager.cc:1434] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.002s
I20260709 12:29:00.436578 13484 consensus_queue.cc:1048] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:29:00.457500 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:00.459592 13429 raft_consensus.cc:359] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
W20260709 12:29:00.460222 13353 leader_election.cc:343] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.460714 13353 leader_election.cc:304] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:00.461956 13701 raft_consensus.cc:2749] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:00.464681 13683 leader_election.cc:290] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:00.455519 13563 consensus_queue.cc:237] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.460256 13429 raft_consensus.cc:385] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.467886 13429 raft_consensus.cc:740] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.468629 13429 consensus_queue.cc:260] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.478462 13429 ts_tablet_manager.cc:1434] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 12:29:00.473459 13238 raft_consensus.cc:2468] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:00.481695 13429 tablet_bootstrap.cc:492] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:00.487777 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:00.488416 13383 raft_consensus.cc:3060] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.490482 13431 tablet_bootstrap.cc:492] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:00.490897 13431 ts_tablet_manager.cc:1403] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.187s	user 0.011s	sys 0.006s
I20260709 12:29:00.496390 13129 leader_election.cc:304] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:00.498648 13595 raft_consensus.cc:2804] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.499189 13595 raft_consensus.cc:697] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
W20260709 12:29:00.500195 13278 consensus_peers.cc:597] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:00.500065 13595 consensus_queue.cc:237] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.509974 13433 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:00.510898 13433 ts_tablet_manager.cc:1403] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.318s	user 0.012s	sys 0.014s
I20260709 12:29:00.511662 13715 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.515892 13715 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.519301 13715 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:00.520880 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:00.521539 13385 raft_consensus.cc:2468] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:00.524252 13431 raft_consensus.cc:359] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.524951 13431 raft_consensus.cc:385] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.525193 13431 raft_consensus.cc:740] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.525867 13431 consensus_queue.cc:260] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.527761 13202 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:00.528867 13715 raft_consensus.cc:2804] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:00.530478 13715 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.531059 13715 raft_consensus.cc:3060] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.533478 13701 raft_consensus.cc:493] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.533964 13701 raft_consensus.cc:515] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.534773 13433 raft_consensus.cc:359] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.535442 13433 raft_consensus.cc:385] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.536055 13701 leader_election.cc:290] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.536267 13433 raft_consensus.cc:740] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.538516 13431 ts_tablet_manager.cc:1434] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:29:00.540763 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:00.543073 13519 raft_consensus.cc:493] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.543623 13519 raft_consensus.cc:515] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.539043 13433 consensus_queue.cc:260] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.545538 13519 leader_election.cc:290] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.546384 13433 ts_tablet_manager.cc:1434] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.000s
I20260709 12:29:00.529577 13684 raft_consensus.cc:515] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
W20260709 12:29:00.543210 13353 leader_election.cc:343] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.539947 13431 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:00.538419 13711 consensus_queue.cc:1048] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:29:00.549273 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:29:00.551993 13353 leader_election.cc:343] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.552706 13433 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:00.552932 13239 raft_consensus.cc:3060] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.554352 13430 tablet_bootstrap.cc:492] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:00.551925 13429 tablet_bootstrap.cc:654] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.565412 13684 leader_election.cc:290] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
W20260709 12:29:00.561451 13127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 44154.8us
I20260709 12:29:00.585981 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:00.586189 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:00.586750 13312 raft_consensus.cc:3060] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.593889 13312 raft_consensus.cc:2468] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:00.595276 13130 leader_election.cc:304] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:00.596411 13724 raft_consensus.cc:2804] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:00.596992 13724 raft_consensus.cc:697] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:00.598119 13724 consensus_queue.cc:237] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.598210 13058 catalog_manager.cc:5697] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:00.599277 13715 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.604983 13058 catalog_manager.cc:5697] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.607921 13430 tablet_bootstrap.cc:654] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.606799 13601 consensus_queue.cc:1048] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:29:00.610430 13383 raft_consensus.cc:2468] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:00.610689 13239 raft_consensus.cc:1240] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Rejecting Update request from peer fc0a5489897d4f6c8dd410cb6daee91b for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:00.614257 13472 raft_consensus.cc:493] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.614754 13472 raft_consensus.cc:515] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.617753 13472 leader_election.cc:290] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.616940 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.613212 13484 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.623932 13484 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.624279 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.625859 13484 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.626591 13433 tablet_bootstrap.cc:654] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.627664 13725 consensus_queue.cc:1048] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:29:00.628113 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:29:00.628901 13278 leader_election.cc:343] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:00.629462 13279 leader_election.cc:343] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.629879 13279 leader_election.cc:304] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:00.631773 13439 raft_consensus.cc:2749] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:29:00.632169 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:00.636106 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:00.636792 13383 raft_consensus.cc:2468] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:00.651503 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.652365 13233 raft_consensus.cc:2393] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 2: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:29:00.652499 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:00.655273 13431 tablet_bootstrap.cc:654] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.656478 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.669682 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:00.670377 13160 raft_consensus.cc:2468] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:00.644984 13127 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
W20260709 12:29:00.677034 13129 leader_election.cc:343] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:00.678119 13352 leader_election.cc:343] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.678632 13352 leader_election.cc:304] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:00.679345 13205 leader_election.cc:304] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:00.680640 13563 raft_consensus.cc:2749] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:00.682171 13716 raft_consensus.cc:2749] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:00.679430 13711 consensus_queue.cc:1059] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:29:00.690971 13431 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:00.691485 13431 ts_tablet_manager.cc:1403] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.152s	user 0.014s	sys 0.000s
W20260709 12:29:00.680505 13352 leader_election.cc:343] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.697592 13352 leader_election.cc:304] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:00.684878 13595 raft_consensus.cc:2804] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:00.699065 13595 raft_consensus.cc:493] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:00.694972 13127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 52317.5us
I20260709 12:29:00.699380 13519 raft_consensus.cc:2749] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:00.699688 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:00.710816 13386 raft_consensus.cc:3060] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.700942 13057 catalog_manager.cc:5697] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.702548 13563 raft_consensus.cc:3055] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:00.708158 13595 raft_consensus.cc:3060] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.717805 13719 consensus_queue.cc:1048] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:00.712369 13563 raft_consensus.cc:740] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:00.720377 13563 consensus_queue.cc:260] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.721709 13563 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.729979 13433 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:00.730489 13433 ts_tablet_manager.cc:1403] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.183s	user 0.011s	sys 0.003s
I20260709 12:29:00.719151 13715 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:00.737437 13433 raft_consensus.cc:359] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.738726 13433 raft_consensus.cc:385] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.731400 13595 raft_consensus.cc:515] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.739023 13433 raft_consensus.cc:740] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.748250 13382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:00.748417 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:00.749539 13237 raft_consensus.cc:2393] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 2: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:29:00.750598 13595 leader_election.cc:290] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.735294 13386 raft_consensus.cc:2468] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:00.751643 13127 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:00.751101 13430 tablet_bootstrap.cc:492] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:00.753150 13430 ts_tablet_manager.cc:1403] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.199s	user 0.006s	sys 0.008s
I20260709 12:29:00.753271 13202 leader_election.cc:304] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:00.753567 13724 raft_consensus.cc:2749] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:00.754585 13715 raft_consensus.cc:2804] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:00.755049 13715 raft_consensus.cc:697] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:00.755947 13715 consensus_queue.cc:237] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.748368 13433 consensus_queue.cc:260] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.759122 13433 ts_tablet_manager.cc:1434] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:29:00.763031 13433 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:00.763707 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc51d4b5af42468e901c06d37a30ea2b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:00.764628 13160 raft_consensus.cc:2393] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:29:00.767473 13430 raft_consensus.cc:359] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.768282 13430 raft_consensus.cc:385] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.768591 13430 raft_consensus.cc:740] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.766784 13057 catalog_manager.cc:5697] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:00.769279 13430 consensus_queue.cc:260] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.770767 13429 tablet_bootstrap.cc:492] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:00.772234 13429 ts_tablet_manager.cc:1403] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.292s	user 0.026s	sys 0.009s
I20260709 12:29:00.772537 13430 ts_tablet_manager.cc:1434] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 12:29:00.773538 13430 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:00.774375 13431 raft_consensus.cc:359] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.774917 13429 raft_consensus.cc:359] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.775646 13429 raft_consensus.cc:385] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.775913 13429 raft_consensus.cc:740] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.775070 13431 raft_consensus.cc:385] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.777355 13431 raft_consensus.cc:740] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.778021 13431 consensus_queue.cc:260] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.780112 13430 tablet_bootstrap.cc:654] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.780349 13429 consensus_queue.cc:260] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.782822 13429 ts_tablet_manager.cc:1434] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:29:00.783684 13429 tablet_bootstrap.cc:492] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:00.787550 13431 ts_tablet_manager.cc:1434] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 12:29:00.788472 13431 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:00.794288 13431 tablet_bootstrap.cc:654] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.801309 13429 tablet_bootstrap.cc:654] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.813321 13595 raft_consensus.cc:493] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.814079 13595 raft_consensus.cc:515] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.821552 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:00.822435 13310 raft_consensus.cc:2393] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:00.825608 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:00.825698 13595 leader_election.cc:290] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:00.827174 13127 leader_election.cc:304] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:00.828042 13595 raft_consensus.cc:3060] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.829869 13061 catalog_manager.cc:5697] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:00.837800 13237 raft_consensus.cc:3060] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.840512 13433 tablet_bootstrap.cc:654] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.843730 13595 raft_consensus.cc:2749] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:00.845661 13720 raft_consensus.cc:493] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.846205 13720 raft_consensus.cc:515] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.846650 13430 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:00.848335 13430 ts_tablet_manager.cc:1403] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.075s	user 0.022s	sys 0.020s
I20260709 12:29:00.850219 13720 leader_election.cc:290] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.850936 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.851603 13239 raft_consensus.cc:2468] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:00.853296 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:00.853564 13278 leader_election.cc:304] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:00.854441 13719 raft_consensus.cc:2804] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:00.854712 13431 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:00.855232 13431 ts_tablet_manager.cc:1403] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.001s
I20260709 12:29:00.857961 13431 raft_consensus.cc:359] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.858687 13431 raft_consensus.cc:385] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.858939 13431 raft_consensus.cc:740] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.859581 13431 consensus_queue.cc:260] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.860210 13433 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:00.860713 13433 ts_tablet_manager.cc:1403] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.000s
I20260709 12:29:00.861789 13431 ts_tablet_manager.cc:1434] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:00.862825 13431 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:00.863283 13433 raft_consensus.cc:359] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.863977 13433 raft_consensus.cc:385] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.864240 13433 raft_consensus.cc:740] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.865038 13433 consensus_queue.cc:260] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.856148 13161 raft_consensus.cc:2468] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:00.869135 13431 tablet_bootstrap.cc:654] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.854784 13719 raft_consensus.cc:493] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.873198 13719 raft_consensus.cc:3060] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.882220 13719 raft_consensus.cc:515] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.884409 13429 tablet_bootstrap.cc:492] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:00.886796 13429 ts_tablet_manager.cc:1403] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.103s	user 0.013s	sys 0.002s
I20260709 12:29:00.889015 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:00.889317 13719 leader_election.cc:290] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:00.889714 13160 raft_consensus.cc:3060] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.890635 13431 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:00.891090 13431 ts_tablet_manager.cc:1403] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.003s
I20260709 12:29:00.889443 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9e399f6ac1043a89507e6aaab9a2d78" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:00.891916 13239 raft_consensus.cc:3060] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:00.885684 13430 raft_consensus.cc:359] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.894837 13429 raft_consensus.cc:359] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.895264 13430 raft_consensus.cc:385] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.885610 13433 ts_tablet_manager.cc:1434] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:29:00.895538 13429 raft_consensus.cc:385] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.895687 13430 raft_consensus.cc:740] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.895902 13429 raft_consensus.cc:740] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.896441 13430 consensus_queue.cc:260] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.896698 13429 consensus_queue.cc:260] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.898603 13430 ts_tablet_manager.cc:1434] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.000s
I20260709 12:29:00.899605 13433 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:00.901942 13239 raft_consensus.cc:2468] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:00.904256 13429 ts_tablet_manager.cc:1434] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:29:00.904698 13160 raft_consensus.cc:2468] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:00.906381 13433 tablet_bootstrap.cc:654] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.906654 13279 leader_election.cc:304] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:00.907343 13429 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:00.907729 13719 raft_consensus.cc:2804] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:00.908325 13719 raft_consensus.cc:697] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:00.909021 13563 consensus_queue.cc:1048] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.909216 13719 consensus_queue.cc:237] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.913343 13429 tablet_bootstrap.cc:654] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.915897 13430 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:00.922116 13430 tablet_bootstrap.cc:654] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.923487 13431 raft_consensus.cc:359] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.924206 13431 raft_consensus.cc:385] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.924461 13431 raft_consensus.cc:740] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.925091 13431 consensus_queue.cc:260] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:00.925663 13563 consensus_queue.cc:1048] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:00.927120 13431 ts_tablet_manager.cc:1434] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.000s
I20260709 12:29:00.928069 13431 tablet_bootstrap.cc:492] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:00.935607 13431 tablet_bootstrap.cc:654] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.938377 13429 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:00.938898 13429 ts_tablet_manager.cc:1403] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 12:29:00.941530 13429 raft_consensus.cc:359] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.942227 13429 raft_consensus.cc:385] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.942545 13429 raft_consensus.cc:740] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.943301 13429 consensus_queue.cc:260] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.949556 13429 ts_tablet_manager.cc:1434] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:29:00.952153 13429 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:00.954633 13519 raft_consensus.cc:493] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.951176 13430 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:00.957811 13431 tablet_bootstrap.cc:492] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:00.958271 13430 ts_tablet_manager.cc:1403] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.007s
I20260709 12:29:00.958407 13431 ts_tablet_manager.cc:1403] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.005s
I20260709 12:29:00.960912 13430 raft_consensus.cc:359] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.961599 13430 raft_consensus.cc:385] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.961880 13430 raft_consensus.cc:740] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.955142 13519 raft_consensus.cc:515] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.962527 13430 consensus_queue.cc:260] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.964864 13430 ts_tablet_manager.cc:1434] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:00.965816 13430 tablet_bootstrap.cc:492] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:00.957803 13429 tablet_bootstrap.cc:654] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.973541 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7189f0f0b184d46b795d6b9f0fb88e3" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:29:00.975211 13352 consensus_peers.cc:597] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:00.975836 13352 leader_election.cc:343] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.976212 13701 raft_consensus.cc:493] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.976382 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7189f0f0b184d46b795d6b9f0fb88e3" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:00.976744 13701 raft_consensus.cc:515] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:00.977833 13310 raft_consensus.cc:2468] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:29:00.978999 13701 leader_election.cc:290] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:00.980373 13431 raft_consensus.cc:359] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.981010 13431 raft_consensus.cc:385] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:00.981251 13431 raft_consensus.cc:740] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:00.983075 13353 leader_election.cc:304] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:00.984423 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:00.985692 13595 raft_consensus.cc:493] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:00.973835 13519 leader_election.cc:290] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:00.986199 13595 raft_consensus.cc:515] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.986397 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:00.987151 13313 raft_consensus.cc:2468] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
W20260709 12:29:00.987498 13353 leader_election.cc:343] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:00.986351 13431 consensus_queue.cc:260] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:00.988400 13595 leader_election.cc:290] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:00.989367 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:00.989610 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:00.990010 13239 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:00.989279 13519 raft_consensus.cc:2804] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.990278 13313 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:00.990579 13519 raft_consensus.cc:493] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.990976 13519 raft_consensus.cc:3060] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.979187 13430 tablet_bootstrap.cc:654] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:00.991583 13130 leader_election.cc:304] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:00.992424 13595 raft_consensus.cc:2804] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:00.992780 13595 raft_consensus.cc:493] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:00.993098 13595 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.000018 13429 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:01.000555 13429 ts_tablet_manager.cc:1403] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.003s
I20260709 12:29:01.000815 13431 ts_tablet_manager.cc:1434] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:29:01.001573 13595 raft_consensus.cc:515] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:01.002439 13430 tablet_bootstrap.cc:492] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:01.002908 13430 ts_tablet_manager.cc:1403] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.007s
I20260709 12:29:01.003811 13431 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:01.003623 13429 raft_consensus.cc:359] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.004654 13429 raft_consensus.cc:385] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.004997 13429 raft_consensus.cc:740] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.005796 13429 consensus_queue.cc:260] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.005903 13430 raft_consensus.cc:359] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.006642 13430 raft_consensus.cc:385] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.006913 13430 raft_consensus.cc:740] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.007591 13429 ts_tablet_manager.cc:1434] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:01.007688 13430 consensus_queue.cc:260] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.008672 13429 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:01.010142 13430 ts_tablet_manager.cc:1434] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:29:01.011071 13430 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:01.007743 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:01.011963 13310 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:00.988240 13353 leader_election.cc:304] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:01.013690 13701 raft_consensus.cc:2804] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.014082 13701 raft_consensus.cc:493] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.014406 13701 raft_consensus.cc:3060] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.016618 13429 tablet_bootstrap.cc:654] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.016996 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:01.017547 13239 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.022976 13684 consensus_queue.cc:1048] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.025835 13239 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:01.026996 13129 leader_election.cc:304] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:01.027951 13484 raft_consensus.cc:2804] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.028411 13484 raft_consensus.cc:697] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:01.029197 13484 consensus_queue.cc:237] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:00.985857 13061 catalog_manager.cc:5697] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 2, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:01.023224 13310 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:01.034590 13701 raft_consensus.cc:515] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.041109 13595 leader_election.cc:290] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:01.043943 13701 leader_election.cc:290] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
W20260709 12:29:01.044134 13129 consensus_peers.cc:597] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.048683 13431 tablet_bootstrap.cc:654] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.050639 13484 consensus_queue.cc:1048] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.060971 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:01.061615 13310 raft_consensus.cc:3060] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.046645 13430 tablet_bootstrap.cc:654] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.074554 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:01.071058 13056 catalog_manager.cc:5697] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.076229 13433 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:01.076894 13433 ts_tablet_manager.cc:1403] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.177s	user 0.029s	sys 0.024s
W20260709 12:29:01.081056 13353 leader_election.cc:343] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.087292 13433 raft_consensus.cc:359] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.088017 13433 raft_consensus.cc:385] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.088218 13433 raft_consensus.cc:740] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.094545 13433 consensus_queue.cc:260] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.099017 13433 ts_tablet_manager.cc:1434] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:29:01.100121 13433 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:01.103428 13595 raft_consensus.cc:493] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.103986 13595 raft_consensus.cc:515] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.106048 13595 leader_election.cc:290] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:01.107790 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:01.108606 13239 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:01.111356 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:01.111850 13129 leader_election.cc:304] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:01.112027 13383 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:01.116020 13595 raft_consensus.cc:2804] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.116425 13595 raft_consensus.cc:493] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.110745 13433 tablet_bootstrap.cc:654] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.116760 13595 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.122138 13310 raft_consensus.cc:2468] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:01.141191 13595 raft_consensus.cc:515] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.148123 13429 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:01.148384 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:01.149164 13386 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.148761 13429 ts_tablet_manager.cc:1403] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.140s	user 0.027s	sys 0.015s
I20260709 12:29:01.155347 13646 consensus_queue.cc:1048] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:29:01.156857 13386 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:01.158020 13127 leader_election.cc:304] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:01.158610 13429 raft_consensus.cc:359] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:01.160276 13429 raft_consensus.cc:385] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.160491 13429 raft_consensus.cc:740] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.161005 13429 consensus_queue.cc:260] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:01.165341 13353 leader_election.cc:304] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:01.159148 13724 raft_consensus.cc:2804] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.169800 13429 ts_tablet_manager.cc:1434] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:29:01.170562 13429 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:01.171272 13724 raft_consensus.cc:697] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:01.172212 13724 consensus_queue.cc:237] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.168953 13595 leader_election.cc:290] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:01.168747 13646 raft_consensus.cc:2804] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.179703 13646 raft_consensus.cc:697] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:01.185070 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:01.185743 13236 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.186816 13429 tablet_bootstrap.cc:654] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.189529 13430 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:01.185314 13646 consensus_queue.cc:237] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.189857 13431 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:01.190050 13430 ts_tablet_manager.cc:1403] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.010s
I20260709 12:29:01.193476 13431 ts_tablet_manager.cc:1403] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.190s	user 0.033s	sys 0.031s
I20260709 12:29:01.195928 13430 raft_consensus.cc:359] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.196125 13431 raft_consensus.cc:359] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:01.196694 13430 raft_consensus.cc:385] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.196823 13431 raft_consensus.cc:385] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.197101 13430 raft_consensus.cc:740] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.197409 13431 raft_consensus.cc:740] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.192605 13519 raft_consensus.cc:515] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.200999 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7189f0f0b184d46b795d6b9f0fb88e3" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:01.202692 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7189f0f0b184d46b795d6b9f0fb88e3" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:01.203287 13313 raft_consensus.cc:3060] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.204080 13386 raft_consensus.cc:1275] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:29:01.205212 13352 leader_election.cc:343] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.206429 13715 consensus_queue.cc:1048] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.198186 13430 consensus_queue.cc:260] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.216971 13430 ts_tablet_manager.cc:1434] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:29:01.222286 13430 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:01.214746 13236 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:01.214787 13431 consensus_queue.cc:260] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:01.214943 13519 leader_election.cc:290] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:01.234405 13721 raft_consensus.cc:493] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.236917 13721 raft_consensus.cc:515] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.239013 13721 leader_election.cc:290] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:01.239723 13431 ts_tablet_manager.cc:1434] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:29:01.240748 13431 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:01.241150 13433 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:01.241649 13433 ts_tablet_manager.cc:1403] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.003s
I20260709 12:29:01.241770 13430 tablet_bootstrap.cc:654] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.242893 13059 catalog_manager.cc:5697] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.251902 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:01.252565 13385 raft_consensus.cc:2468] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:01.255916 13433 raft_consensus.cc:359] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.256492 13433 raft_consensus.cc:385] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.256688 13433 raft_consensus.cc:740] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.257154 13433 consensus_queue.cc:260] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.261041 13433 ts_tablet_manager.cc:1434] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:29:01.262591 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:01.265974 13684 consensus_queue.cc:1048] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.268018 13684 raft_consensus.cc:493] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.268541 13684 raft_consensus.cc:515] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.269963 13431 tablet_bootstrap.cc:654] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.271206 13382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:01.280139 13160 raft_consensus.cc:1275] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:01.282198 13059 catalog_manager.cc:5697] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.291972 13433 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:01.276482 13276 leader_election.cc:304] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:01.289599 13716 consensus_queue.cc:1048] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
W20260709 12:29:01.298943 13278 leader_election.cc:343] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.315541 13161 raft_consensus.cc:1275] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:01.317318 13719 consensus_queue.cc:1048] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.285668 13382 raft_consensus.cc:2468] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:01.319764 13720 raft_consensus.cc:2804] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.320261 13720 raft_consensus.cc:493] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.320587 13720 raft_consensus.cc:3060] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:01.319718 13276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 48003.6us
I20260709 12:29:01.349241 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:01.345072 13127 leader_election.cc:304] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:01.340094 13684 leader_election.cc:290] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
W20260709 12:29:01.352991 13129 leader_election.cc:343] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.353474 13684 raft_consensus.cc:2804] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.353837 13684 raft_consensus.cc:493] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.354147 13684 raft_consensus.cc:3060] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.361974 13429 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:01.367713 13429 ts_tablet_manager.cc:1403] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.197s	user 0.008s	sys 0.036s
I20260709 12:29:01.387936 13430 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:01.388486 13430 ts_tablet_manager.cc:1403] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.166s	user 0.012s	sys 0.010s
I20260709 12:29:01.391038 13430 raft_consensus.cc:359] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.391873 13430 raft_consensus.cc:385] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.392197 13430 raft_consensus.cc:740] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.393020 13430 consensus_queue.cc:260] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.394565 13433 tablet_bootstrap.cc:654] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.395692 13430 ts_tablet_manager.cc:1434] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:01.395925 13313 raft_consensus.cc:2468] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:01.398569 13720 raft_consensus.cc:515] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.395785 13693 raft_consensus.cc:493] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.403713 13693 raft_consensus.cc:515] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.405704 13693 leader_election.cc:290] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:01.407552 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:01.409026 13430 tablet_bootstrap.cc:492] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:01.410784 13720 leader_election.cc:290] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:01.401907 13684 raft_consensus.cc:515] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:29:01.412276 13353 leader_election.cc:343] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.416745 13382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
W20260709 12:29:01.431190 13278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 70895us
I20260709 12:29:01.421162 13429 raft_consensus.cc:359] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.434285 13430 tablet_bootstrap.cc:654] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.413955 13431 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:01.436890 13431 ts_tablet_manager.cc:1403] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.196s	user 0.010s	sys 0.045s
I20260709 12:29:01.421679 13237 raft_consensus.cc:3060] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.437512 13429 raft_consensus.cc:385] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.431123 13382 raft_consensus.cc:3060] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.439543 13429 raft_consensus.cc:740] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.440338 13429 consensus_queue.cc:260] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.442612 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:01.443310 13386 raft_consensus.cc:3060] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.454818 13429 ts_tablet_manager.cc:1434] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 12:29:01.448084 13715 raft_consensus.cc:493] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.461181 13386 raft_consensus.cc:2468] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
W20260709 12:29:01.451069 13279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 81778.1us
I20260709 12:29:01.460848 13353 leader_election.cc:304] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:01.462936 13684 leader_election.cc:290] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:01.466414 13519 raft_consensus.cc:2804] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.469444 13519 raft_consensus.cc:697] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:01.469775 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:01.470269 13519 consensus_queue.cc:237] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.470949 13433 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:01.462368 13715 raft_consensus.cc:515] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.471396 13433 ts_tablet_manager.cc:1403] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.180s	user 0.020s	sys 0.006s
I20260709 12:29:01.471185 13431 raft_consensus.cc:359] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.471886 13431 raft_consensus.cc:385] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.472153 13431 raft_consensus.cc:740] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.473006 13715 leader_election.cc:290] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:01.473205 13431 consensus_queue.cc:260] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.474501 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:01.474593 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:01.474068 13433 raft_consensus.cc:359] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.476223 13433 raft_consensus.cc:385] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.477209 13433 raft_consensus.cc:740] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.477846 13433 consensus_queue.cc:260] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.478725 13775 raft_consensus.cc:493] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.479292 13431 ts_tablet_manager.cc:1434] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 12:29:01.479182 13775 raft_consensus.cc:515] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.480108 13433 ts_tablet_manager.cc:1434] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:29:01.480264 13431 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:01.481307 13775 leader_election.cc:290] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:01.483482 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:01.484086 13309 raft_consensus.cc:2468] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:29:01.486442 13236 raft_consensus.cc:1275] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:01.489197 13429 tablet_bootstrap.cc:492] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:01.490855 13433 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:01.491508 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:01.492097 13386 raft_consensus.cc:2468] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:01.494132 13276 leader_election.cc:304] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:01.494899 13773 raft_consensus.cc:2804] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.495256 13773 raft_consensus.cc:493] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.495596 13773 raft_consensus.cc:3060] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.498354 13382 raft_consensus.cc:2468] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:01.499805 13431 tablet_bootstrap.cc:654] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:01.501266 13278 leader_election.cc:343] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.502152 13775 consensus_queue.cc:1048] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.502504 13773 raft_consensus.cc:515] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.505357 13353 leader_election.cc:304] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:01.506732 13767 raft_consensus.cc:2804] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.507093 13767 raft_consensus.cc:493] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.507372 13773 leader_election.cc:290] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:01.507436 13767 raft_consensus.cc:3060] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.507735 13701 raft_consensus.cc:493] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.508279 13701 raft_consensus.cc:515] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.510403 13701 leader_election.cc:290] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:01.508234 13276 leader_election.cc:304] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:01.513293 13773 raft_consensus.cc:2804] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.513856 13773 raft_consensus.cc:697] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:01.514742 13773 consensus_queue.cc:237] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.516251 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:01.521046 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:01.519543 13767 raft_consensus.cc:515] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.523222 13386 raft_consensus.cc:2393] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:01.525552 13433 tablet_bootstrap.cc:654] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.527161 13767 leader_election.cc:290] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:01.530174 13430 tablet_bootstrap.cc:492] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:01.530722 13430 ts_tablet_manager.cc:1403] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.005s
I20260709 12:29:01.530884 13429 tablet_bootstrap.cc:654] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.572628 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:01.573498 13127 leader_election.cc:304] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
W20260709 12:29:01.577430 13129 leader_election.cc:343] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.582772 13430 raft_consensus.cc:359] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.584272 13430 raft_consensus.cc:385] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:01.584457 13279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 64009.3us
I20260709 12:29:01.586308 13430 raft_consensus.cc:740] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.587294 13430 consensus_queue.cc:260] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.596247 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:01.574389 13160 raft_consensus.cc:3060] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.615808 13595 raft_consensus.cc:2804] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.595101 13484 raft_consensus.cc:493] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.616914 13484 raft_consensus.cc:515] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.624192 13162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:01.627638 13484 leader_election.cc:290] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:01.578068 13236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:29:01.647078 13353 leader_election.cc:343] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.647650 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:01.648658 13383 raft_consensus.cc:2468] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:01.652457 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:01.653674 13309 raft_consensus.cc:2393] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc0a5489897d4f6c8dd410cb6daee91b in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:01.662181 13205 leader_election.cc:304] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:01.666532 13430 ts_tablet_manager.cc:1434] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.135s	user 0.010s	sys 0.004s
I20260709 12:29:01.668744 13430 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:01.669288 13233 raft_consensus.cc:3060] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.681866 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:01.694582 13431 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
W20260709 12:29:01.700021 13129 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 84132.7us
I20260709 12:29:01.712721 13684 consensus_queue.cc:1048] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:29:01.702473 13595 raft_consensus.cc:697] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:01.717617 13160 raft_consensus.cc:2468] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:01.718271 13595 consensus_queue.cc:237] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.721195 13433 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:01.722066 13433 ts_tablet_manager.cc:1403] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.232s	user 0.012s	sys 0.005s
I20260709 12:29:01.725826 13433 raft_consensus.cc:359] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.730438 13773 raft_consensus.cc:493] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.730931 13279 leader_election.cc:304] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:01.732301 13127 leader_election.cc:304] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
W20260709 12:29:01.733563 13205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.67:44667, user_credentials={real_user=slave}} blocked reactor thread for 71718.1us
I20260709 12:29:01.735466 13431 ts_tablet_manager.cc:1403] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.255s	user 0.016s	sys 0.025s
I20260709 12:29:01.735579 13353 leader_election.cc:304] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:01.740584 13433 raft_consensus.cc:385] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.779047 13429 tablet_bootstrap.cc:492] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
W20260709 12:29:01.779227 13353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 43766us
I20260709 12:29:01.779851 13429 ts_tablet_manager.cc:1403] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.291s	user 0.017s	sys 0.009s
I20260709 12:29:01.781013 13711 raft_consensus.cc:2804] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:01.781152 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:01.781685 13711 raft_consensus.cc:697] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:01.781968 13238 raft_consensus.cc:2468] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:01.783203 13701 consensus_queue.cc:1048] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.784411 13773 raft_consensus.cc:515] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:01.784559 13429 raft_consensus.cc:359] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:01.785655 13429 raft_consensus.cc:385] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:01.786026 13429 raft_consensus.cc:740] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.786415 13711 consensus_queue.cc:237] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.786888 13429 consensus_queue.cc:260] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
W20260709 12:29:01.788149 13279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 76189.7us
I20260709 12:29:01.788324 13774 raft_consensus.cc:2749] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:29:01.789420 13127 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 57220.9us
I20260709 12:29:01.792421 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:01.794045 13784 consensus_queue.cc:1048] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:29:01.794517 13279 leader_election.cc:343] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.801018 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:01.777158 13433 raft_consensus.cc:740] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.818912 13429 ts_tablet_manager.cc:1434] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.001s
I20260709 12:29:01.791355 13724 raft_consensus.cc:2804] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:29:01.822651 13278 leader_election.cc:343] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.823298 13278 leader_election.cc:304] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
W20260709 12:29:01.826655 13353 consensus_peers.cc:597] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:01.827525 13724 raft_consensus.cc:493] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.827989 13724 raft_consensus.cc:3060] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.831391 13783 raft_consensus.cc:2749] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:01.838874 13429 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:01.839970 13430 tablet_bootstrap.cc:654] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.787340 13773 leader_election.cc:290] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
W20260709 12:29:01.846882 13352 leader_election.cc:343] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.848544 13693 raft_consensus.cc:493] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.849527 13693 raft_consensus.cc:515] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.852463 13693 leader_election.cc:290] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:01.849767 13429 tablet_bootstrap.cc:654] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:01.853914 13431 raft_consensus.cc:359] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.855970 13484 consensus_queue.cc:1048] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:01.864938 13724 raft_consensus.cc:515] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.867189 13785 consensus_queue.cc:1048] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:01.869612 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:01.849437 13352 leader_election.cc:304] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:01.873049 13061 catalog_manager.cc:5697] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:01.880514 13431 raft_consensus.cc:385] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:01.890586 13353 leader_election.cc:343] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:01.892858 13431 raft_consensus.cc:740] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:01.899657 13431 consensus_queue.cc:260] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:01.903846 13433 consensus_queue.cc:260] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.912967 13431 ts_tablet_manager.cc:1434] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.136s	user 0.006s	sys 0.001s
I20260709 12:29:01.917179 13433 ts_tablet_manager.cc:1434] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.195s	user 0.006s	sys 0.001s
I20260709 12:29:01.927706 13519 raft_consensus.cc:2749] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:29:01.930590 13352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 83919.4us
I20260709 12:29:01.939028 13774 raft_consensus.cc:493] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.939606 13774 raft_consensus.cc:515] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:01.941958 13774 leader_election.cc:290] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:01.942893 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:01.943662 13310 raft_consensus.cc:2468] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:29:01.943782 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:01.944689 13383 raft_consensus.cc:2468] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:01.946255 13276 leader_election.cc:304] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:01.947199 13773 raft_consensus.cc:2804] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.947705 13773 raft_consensus.cc:493] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.948025 13773 raft_consensus.cc:3060] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:01.957444 13205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:44667, user_credentials={real_user=slave}} blocked reactor thread for 50386us
I20260709 12:29:01.962066 13159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:01.972334 13353 leader_election.cc:304] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:01.983901 13701 raft_consensus.cc:2804] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:01.986339 13701 raft_consensus.cc:493] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:01.986735 13701 raft_consensus.cc:3060] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:01.986117 13059 catalog_manager.cc:5697] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.990242 13431 tablet_bootstrap.cc:492] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:01.993702 13725 raft_consensus.cc:493] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:01.994222 13725 raft_consensus.cc:515] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
W20260709 12:29:01.997776 13279 leader_election.cc:343] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.000866 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:02.001557 13383 raft_consensus.cc:3060] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.004209 13433 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:02.007150 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.009218 13725 leader_election.cc:290] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.010003 13724 leader_election.cc:290] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:02.012197 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:02.012799 13238 raft_consensus.cc:3060] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.013190 13693 raft_consensus.cc:493] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.013747 13693 raft_consensus.cc:515] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.018296 13773 raft_consensus.cc:515] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.019345 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.021003 13519 raft_consensus.cc:493] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.047734 13431 tablet_bootstrap.cc:654] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.051779 13715 raft_consensus.cc:493] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:02.052460 13715 raft_consensus.cc:515] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.056509 13239 raft_consensus.cc:2468] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:02.059528 13062 catalog_manager.cc:5697] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:01.995204 13701 raft_consensus.cc:515] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.057765 13519 raft_consensus.cc:515] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.073611 13701 leader_election.cc:290] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:02.057471 13783 raft_consensus.cc:493] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fc0a5489897d4f6c8dd410cb6daee91b)
I20260709 12:29:02.063055 13693 leader_election.cc:290] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.086048 13783 raft_consensus.cc:515] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.088326 13783 leader_election.cc:290] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.090221 13773 leader_election.cc:290] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:02.091809 13715 leader_election.cc:290] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.095358 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:02.097900 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:02.099704 13352 leader_election.cc:304] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:02.100494 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.102487 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
W20260709 12:29:02.102388 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:02.103705 13646 raft_consensus.cc:2804] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:29:02.104211 13646 raft_consensus.cc:493] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.104595 13646 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:02.105253 13383 raft_consensus.cc:2468] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:02.102412 13130 leader_election.cc:304] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:02.106877 13784 raft_consensus.cc:2749] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.108480 13127 leader_election.cc:304] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:02.109153 13431 tablet_bootstrap.cc:492] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:02.109656 13431 ts_tablet_manager.cc:1403] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.003s
I20260709 12:29:02.110555 13784 raft_consensus.cc:2804] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:02.111100 13784 raft_consensus.cc:697] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:02.112075 13784 consensus_queue.cc:237] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.114742 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:02.115608 13383 raft_consensus.cc:2393] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:02.116994 13433 tablet_bootstrap.cc:654] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.118759 13431 raft_consensus.cc:359] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.119985 13431 raft_consensus.cc:385] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:02.120527 13353 leader_election.cc:343] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.123849 13431 raft_consensus.cc:740] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.110477 13429 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:02.124531 13429 ts_tablet_manager.cc:1403] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.286s	user 0.015s	sys 0.021s
I20260709 12:29:02.120635 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.106137 13238 raft_consensus.cc:2468] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:02.134012 13430 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:02.134464 13430 ts_tablet_manager.cc:1403] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.466s	user 0.014s	sys 0.017s
I20260709 12:29:02.120522 13519 leader_election.cc:290] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.126631 13431 consensus_queue.cc:260] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.137583 13716 raft_consensus.cc:2749] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.138912 13431 ts_tablet_manager.cc:1434] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260709 12:29:02.139890 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.140149 13431 tablet_bootstrap.cc:492] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:02.139884 13429 raft_consensus.cc:359] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.144963 13429 raft_consensus.cc:385] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.145267 13429 raft_consensus.cc:740] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.148304 13429 consensus_queue.cc:260] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.143951 13774 raft_consensus.cc:493] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.143517 13313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.153852 13239 raft_consensus.cc:3060] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:02.154893 13279 leader_election.cc:343] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.155836 13279 leader_election.cc:304] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:02.157986 13720 raft_consensus.cc:2749] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.161461 13774 raft_consensus.cc:515] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
W20260709 12:29:02.161965 13352 leader_election.cc:343] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.162921 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:02.165001 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.168015 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.163763 13774 leader_election.cc:290] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.164242 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.142380 13804 consensus_queue.cc:1048] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:29:02.171459 13311 raft_consensus.cc:2468] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 0.
I20260709 12:29:02.174005 13309 raft_consensus.cc:2393] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc0a5489897d4f6c8dd410cb6daee91b in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:02.175056 13382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.175756 13382 raft_consensus.cc:2468] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:02.176136 13205 leader_election.cc:304] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:02.178817 13715 raft_consensus.cc:2749] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:02.179816 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.181576 13312 raft_consensus.cc:2468] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:02.186118 13429 ts_tablet_manager.cc:1434] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 12:29:02.188437 13353 leader_election.cc:304] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.191634 13276 leader_election.cc:304] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:02.192018 13563 raft_consensus.cc:2804] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:02.192411 13563 raft_consensus.cc:493] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.192732 13563 raft_consensus.cc:3060] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.195797 13783 raft_consensus.cc:2804] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:02.196204 13783 raft_consensus.cc:493] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.196534 13783 raft_consensus.cc:3060] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:02.196972 13352 consensus_peers.cc:597] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:02.200291 13353 leader_election.cc:304] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:02.197645 13233 raft_consensus.cc:2393] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 in current term 2: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:29:02.202728 13803 raft_consensus.cc:2749] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.181541 13774 consensus_queue.cc:1048] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:29:02.208236 13430 raft_consensus.cc:359] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.208760 13430 raft_consensus.cc:385] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.208937 13430 raft_consensus.cc:740] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.213873 13430 consensus_queue.cc:260] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.215447 13430 ts_tablet_manager.cc:1434] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.001s
I20260709 12:29:02.216416 13430 tablet_bootstrap.cc:492] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
W20260709 12:29:02.217941 13278 leader_election.cc:343] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.219286 13429 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:02.227113 13430 tablet_bootstrap.cc:654] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.227270 13783 raft_consensus.cc:515] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.230966 13775 consensus_queue.cc:1048] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:02.232496 13783 leader_election.cc:290] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.237355 13431 tablet_bootstrap.cc:654] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.236938 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:02.240171 13716 raft_consensus.cc:493] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.240695 13716 raft_consensus.cc:515] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.191671 13646 raft_consensus.cc:515] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.242884 13716 leader_election.cc:290] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.244912 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.245628 13385 raft_consensus.cc:2468] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
W20260709 12:29:02.246488 13810 log.cc:927] Time spent T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:29:02.246876 13202 leader_election.cc:304] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:02.249369 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
W20260709 12:29:02.255359 13278 leader_election.cc:343] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.264962 13433 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:02.265499 13433 ts_tablet_manager.cc:1403] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.003s
I20260709 12:29:02.264766 13383 raft_consensus.cc:2368] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 for earlier term 2. Current term is 3.
I20260709 12:29:02.273640 13429 tablet_bootstrap.cc:654] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.276240 13433 raft_consensus.cc:359] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.279368 13433 raft_consensus.cc:385] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.279685 13433 raft_consensus.cc:740] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.282907 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:02.285192 13803 consensus_queue.cc:1048] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:02.280468 13433 consensus_queue.cc:260] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.288950 13796 raft_consensus.cc:493] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.289229 13433 ts_tablet_manager.cc:1434] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.003s
I20260709 12:29:02.289410 13796 raft_consensus.cc:515] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.290336 13433 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:02.292644 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:02.293316 13233 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:02.294824 13276 leader_election.cc:400] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Vote denied by peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499) with higher term. Message: Invalid argument: T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 for earlier term 2. Current term is 3.
I20260709 12:29:02.295171 13276 leader_election.cc:403] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:29:02.295773 13774 raft_consensus.cc:3060] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:29:02.295825 13796 leader_election.cc:290] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:02.299214 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:02.301694 13433 tablet_bootstrap.cc:654] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.314502 13484 raft_consensus.cc:493] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.315066 13484 raft_consensus.cc:515] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.317065 13484 leader_election.cc:290] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.318280 13803 consensus_queue.cc:1048] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:29:02.318544 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.319832 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.320535 13311 raft_consensus.cc:2468] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
W20260709 12:29:02.321740 13129 leader_election.cc:343] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.322561 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.323395 13383 raft_consensus.cc:2393] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:29:02.323760 13238 raft_consensus.cc:3060] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.324457 13130 leader_election.cc:304] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.324689 13202 leader_election.cc:304] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:02.323019 13563 raft_consensus.cc:515] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.325652 13784 raft_consensus.cc:2804] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:02.326107 13784 raft_consensus.cc:493] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.326457 13784 raft_consensus.cc:3060] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.326426 13385 raft_consensus.cc:2393] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:02.329852 13061 catalog_manager.cc:5697] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 1, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 1 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:02.330845 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:29:02.332434 13352 leader_election.cc:343] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.330627 13563 leader_election.cc:290] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.332964 13785 consensus_queue.cc:1048] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:02.339453 13430 tablet_bootstrap.cc:492] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:02.339972 13430 ts_tablet_manager.cc:1403] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.124s	user 0.009s	sys 0.011s
I20260709 12:29:02.326749 13646 leader_election.cc:290] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.323737 13774 raft_consensus.cc:2749] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499) with higher term. Message: Invalid argument: T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 for earlier term 2. Current term is 3.
I20260709 12:29:02.351039 13715 raft_consensus.cc:2804] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:02.353293 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30647cb538f54daea2c91dc8a1708e5f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:02.355525 13276 leader_election.cc:304] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:02.356822 13775 raft_consensus.cc:2749] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.358462 13715 raft_consensus.cc:493] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c15e995b6bee46f6a5dec636c28cb1b1)
I20260709 12:29:02.358948 13715 raft_consensus.cc:3060] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:02.358647 13784 raft_consensus.cc:515] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.355573 13796 raft_consensus.cc:2749] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.368573 13784 leader_election.cc:290] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.352629 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:02.375859 13308 raft_consensus.cc:2393] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fc0a5489897d4f6c8dd410cb6daee91b in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:02.388113 13353 leader_election.cc:304] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:02.401657 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:02.403218 13724 consensus_queue.cc:1048] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:02.393559 13711 raft_consensus.cc:2749] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.417086 13430 raft_consensus.cc:359] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.417626 13430 raft_consensus.cc:385] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.417824 13430 raft_consensus.cc:740] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.428063 13431 tablet_bootstrap.cc:492] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:02.428483 13431 ts_tablet_manager.cc:1403] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.289s	user 0.016s	sys 0.001s
I20260709 12:29:02.432402 13163 raft_consensus.cc:3060] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:02.432412 13129 leader_election.cc:343] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.431164 13430 consensus_queue.cc:260] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.438084 13311 raft_consensus.cc:2468] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 3.
I20260709 12:29:02.455188 13353 leader_election.cc:304] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:02.456128 13803 raft_consensus.cc:2804] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:02.456629 13803 raft_consensus.cc:697] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:02.439790 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:02.457511 13803 consensus_queue.cc:237] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.426188 13233 raft_consensus.cc:2468] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 3.
I20260709 12:29:02.457465 13308 raft_consensus.cc:3060] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.466585 13430 ts_tablet_manager.cc:1434] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.000s
I20260709 12:29:02.467660 13430 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:02.467840 13715 raft_consensus.cc:515] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.469964 13235 raft_consensus.cc:1240] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Rejecting Update request from peer c15e995b6bee46f6a5dec636c28cb1b1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:02.472539 13774 consensus_queue.cc:1059] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:02.473649 13774 raft_consensus.cc:3055] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:02.474077 13774 raft_consensus.cc:740] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:02.477126 13715 leader_election.cc:290] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.477327 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:02.479096 13308 raft_consensus.cc:2468] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:02.479578 13519 raft_consensus.cc:493] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.480106 13519 raft_consensus.cc:515] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.480369 13130 leader_election.cc:304] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.483217 13684 raft_consensus.cc:2804] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:02.483706 13684 raft_consensus.cc:697] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:02.484163 13519 leader_election.cc:290] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:02.484493 13684 consensus_queue.cc:237] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.476467 13774 consensus_queue.cc:260] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.487167 13774 raft_consensus.cc:3060] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:02.489658 13159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:02.483801 13431 raft_consensus.cc:359] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.495548 13431 raft_consensus.cc:385] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:02.498831 13353 leader_election.cc:343] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.494846 13433 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:02.500008 13433 ts_tablet_manager.cc:1403] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.210s	user 0.014s	sys 0.012s
I20260709 12:29:02.495886 13431 raft_consensus.cc:740] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.481966 13430 tablet_bootstrap.cc:654] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.480232 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cdd0c8711ba42c1bd4506afd7156e9a" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:02.494397 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.509919 13429 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:02.510375 13429 ts_tablet_manager.cc:1403] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.300s	user 0.012s	sys 0.004s
I20260709 12:29:02.513741 13484 consensus_queue.cc:1048] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:29:02.516244 13352 leader_election.cc:343] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.516716 13352 leader_election.cc:304] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.517886 13804 raft_consensus.cc:2749] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.515076 13431 consensus_queue.cc:260] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.536393 13724 consensus_queue.cc:1048] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:02.539147 13060 catalog_manager.cc:5697] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:02.521963 13429 raft_consensus.cc:359] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.542470 13429 raft_consensus.cc:385] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.542788 13429 raft_consensus.cc:740] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.545624 13431 ts_tablet_manager.cc:1434] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 12:29:02.546741 13431 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:02.552677 13431 tablet_bootstrap.cc:654] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.558275 13774 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.558274 13429 consensus_queue.cc:260] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.571298 13433 raft_consensus.cc:359] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.567495 13774 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.573890 13774 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:02.575830 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.578717 13429 ts_tablet_manager.cc:1434] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:29:02.572008 13433 raft_consensus.cc:385] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.579564 13433 raft_consensus.cc:740] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.581256 13433 consensus_queue.cc:260] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.582931 13309 raft_consensus.cc:2468] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
W20260709 12:29:02.584283 13278 leader_election.cc:343] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.585464 13205 leader_election.cc:304] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:02.580504 13429 tablet_bootstrap.cc:492] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:02.581475 13159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:02.586704 13796 raft_consensus.cc:2804] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:02.588222 13433 ts_tablet_manager.cc:1434] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 12:29:02.587277 13796 raft_consensus.cc:697] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:02.590020 13433 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:02.589684 13796 consensus_queue.cc:237] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
W20260709 12:29:02.593346 13279 leader_election.cc:343] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.594905 13279 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.596030 13720 raft_consensus.cc:2749] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.600538 13433 tablet_bootstrap.cc:654] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.600039 13061 catalog_manager.cc:5697] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:02.615581 13429 tablet_bootstrap.cc:654] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.621057 13430 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:02.624188 13784 raft_consensus.cc:493] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.625669 13784 raft_consensus.cc:515] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.628842 13234 raft_consensus.cc:3060] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.629930 13784 leader_election.cc:290] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:02.630787 13431 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:02.631250 13431 ts_tablet_manager.cc:1403] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.085s	user 0.010s	sys 0.004s
I20260709 12:29:02.631482 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:29:02.633953 13129 leader_election.cc:343] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.633519 13060 catalog_manager.cc:5697] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:02.631515 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.635353 13433 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:02.635885 13433 ts_tablet_manager.cc:1403] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.014s
I20260709 12:29:02.638484 13433 raft_consensus.cc:359] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.639109 13433 raft_consensus.cc:385] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.639358 13433 raft_consensus.cc:740] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.639986 13433 consensus_queue.cc:260] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.642045 13433 ts_tablet_manager.cc:1434] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 12:29:02.642935 13433 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:02.621590 13430 ts_tablet_manager.cc:1403] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.002s
I20260709 12:29:02.646216 13430 raft_consensus.cc:359] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.635783 13383 raft_consensus.cc:2468] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:02.652100 13430 raft_consensus.cc:385] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.652469 13430 raft_consensus.cc:740] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.653121 13430 consensus_queue.cc:260] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.655244 13430 ts_tablet_manager.cc:1434] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 12:29:02.648730 13433 tablet_bootstrap.cc:654] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.655726 13127 leader_election.cc:304] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.656922 13430 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:02.657092 13784 raft_consensus.cc:2804] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:02.657491 13784 raft_consensus.cc:493] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.657835 13784 raft_consensus.cc:3060] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.660251 13062 catalog_manager.cc:5697] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:02.633949 13431 raft_consensus.cc:359] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.663249 13431 raft_consensus.cc:385] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.665185 13430 tablet_bootstrap.cc:654] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.663532 13431 raft_consensus.cc:740] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.666036 13431 consensus_queue.cc:260] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.667793 13784 raft_consensus.cc:515] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.674901 13431 ts_tablet_manager.cc:1434] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 12:29:02.676910 13433 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:02.677420 13433 ts_tablet_manager.cc:1403] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.004s
I20260709 12:29:02.682309 13784 leader_election.cc:290] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:02.683020 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:02.675761 13803 raft_consensus.cc:493] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:02.684504 13129 leader_election.cc:343] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.685694 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:02.686314 13383 raft_consensus.cc:3060] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.689711 13803 raft_consensus.cc:515] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.696664 13803 leader_election.cc:290] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.697820 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db87327473744d9cb4d2c2836ad19c47" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.699327 13431 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
W20260709 12:29:02.701339 13353 leader_election.cc:343] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.703258 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db87327473744d9cb4d2c2836ad19c47" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.704460 13429 tablet_bootstrap.cc:492] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
W20260709 12:29:02.704790 13352 leader_election.cc:343] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.705292 13352 leader_election.cc:304] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:02.707149 13431 tablet_bootstrap.cc:654] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.704936 13429 ts_tablet_manager.cc:1403] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.010s
I20260709 12:29:02.709553 13646 raft_consensus.cc:2749] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.712082 13429 raft_consensus.cc:359] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.712795 13429 raft_consensus.cc:385] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.713048 13429 raft_consensus.cc:740] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.713673 13429 consensus_queue.cc:260] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.716437 13383 raft_consensus.cc:2468] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:02.718000 13127 leader_election.cc:304] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.693184 13433 raft_consensus.cc:359] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.720158 13433 raft_consensus.cc:385] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.720481 13433 raft_consensus.cc:740] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.721184 13433 consensus_queue.cc:260] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.721942 13784 raft_consensus.cc:2804] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:02.723326 13433 ts_tablet_manager.cc:1434] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.002s
I20260709 12:29:02.726219 13784 raft_consensus.cc:697] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:02.727139 13784 consensus_queue.cc:237] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.729149 13433 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:02.729059 13429 ts_tablet_manager.cc:1434] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:29:02.744151 13433 tablet_bootstrap.cc:654] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.745051 13430 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:02.745569 13430 ts_tablet_manager.cc:1403] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.000s
I20260709 12:29:02.747877 13429 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
I20260709 12:29:02.748431 13430 raft_consensus.cc:359] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.749118 13430 raft_consensus.cc:385] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.749378 13430 raft_consensus.cc:740] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.750120 13430 consensus_queue.cc:260] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.760213 13430 ts_tablet_manager.cc:1434] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:29:02.763120 13433 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:02.763123 13431 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:02.764240 13433 ts_tablet_manager.cc:1403] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.011s
I20260709 12:29:02.764278 13431 ts_tablet_manager.cc:1403] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.070s	user 0.028s	sys 0.013s
I20260709 12:29:02.765352 13429 tablet_bootstrap.cc:654] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.767443 13433 raft_consensus.cc:359] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.767455 13431 raft_consensus.cc:359] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.768415 13431 raft_consensus.cc:385] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.768652 13433 raft_consensus.cc:385] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.768754 13431 raft_consensus.cc:740] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.769033 13433 raft_consensus.cc:740] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.769586 13431 consensus_queue.cc:260] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.769726 13433 consensus_queue.cc:260] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.772145 13433 ts_tablet_manager.cc:1434] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:02.773193 13433 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:02.773908 13430 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b: Bootstrap starting.
I20260709 12:29:02.778487 13431 ts_tablet_manager.cc:1434] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:29:02.779129 13724 raft_consensus.cc:493] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.779597 13431 tablet_bootstrap.cc:492] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:02.779615 13433 tablet_bootstrap.cc:654] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.784415 13061 catalog_manager.cc:5697] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:02.786446 13431 tablet_bootstrap.cc:654] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.779700 13724 raft_consensus.cc:515] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.796289 13724 leader_election.cc:290] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.796891 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.797758 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.798578 13309 raft_consensus.cc:2393] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:02.797818 13383 raft_consensus.cc:2393] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:02.801100 13130 leader_election.cc:304] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:02.802146 13724 raft_consensus.cc:3060] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.824134 13430 tablet_bootstrap.cc:654] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.828750 13724 raft_consensus.cc:2749] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:02.836709 13431 tablet_bootstrap.cc:492] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:02.837190 13431 ts_tablet_manager.cc:1403] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.015s
I20260709 12:29:02.837815 13430 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b: No bootstrap required, opened a new log
I20260709 12:29:02.838264 13433 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:02.838294 13430 ts_tablet_manager.cc:1403] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.002s
I20260709 12:29:02.838969 13433 ts_tablet_manager.cc:1403] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.066s	user 0.033s	sys 0.026s
I20260709 12:29:02.839550 13784 raft_consensus.cc:493] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.839840 13431 raft_consensus.cc:359] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.840516 13431 raft_consensus.cc:385] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.840776 13431 raft_consensus.cc:740] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.840889 13429 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:02.841437 13429 ts_tablet_manager.cc:1403] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.094s	user 0.011s	sys 0.002s
I20260709 12:29:02.841488 13431 consensus_queue.cc:260] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.841614 13433 raft_consensus.cc:359] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.842021 13430 raft_consensus.cc:359] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.846709 13430 raft_consensus.cc:385] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.847007 13430 raft_consensus.cc:740] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.842413 13433 raft_consensus.cc:385] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.843966 13431 ts_tablet_manager.cc:1434] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:29:02.843663 13784 raft_consensus.cc:515] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.847644 13433 raft_consensus.cc:740] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.847697 13430 consensus_queue.cc:260] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.849180 13784 leader_election.cc:290] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.845557 13429 raft_consensus.cc:359] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.850028 13429 raft_consensus.cc:385] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.850315 13429 raft_consensus.cc:740] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.851008 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.851188 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.848877 13433 consensus_queue.cc:260] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.851697 13309 raft_consensus.cc:2468] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:02.852746 13130 leader_election.cc:304] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:02.853014 13429 consensus_queue.cc:260] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.854167 13430 ts_tablet_manager.cc:1434] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:29:02.855077 13429 ts_tablet_manager.cc:1434] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:29:02.851708 13431 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:02.855942 13784 raft_consensus.cc:2804] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:02.856343 13784 raft_consensus.cc:493] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.856683 13784 raft_consensus.cc:3060] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.858880 13429 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1: Bootstrap starting.
W20260709 12:29:02.862123 13129 leader_election.cc:343] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.867775 13784 raft_consensus.cc:515] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.869084 13429 tablet_bootstrap.cc:654] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.870820 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:02.871397 13309 raft_consensus.cc:3060] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.871495 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:29:02.873099 13129 leader_election.cc:343] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.878731 13721 raft_consensus.cc:493] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.879242 13721 raft_consensus.cc:515] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.881675 13721 leader_election.cc:290] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.883759 13431 tablet_bootstrap.cc:654] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.884766 13803 raft_consensus.cc:493] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.885244 13803 raft_consensus.cc:515] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.886040 13724 consensus_queue.cc:1048] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:02.886323 13309 raft_consensus.cc:2468] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:02.900415 13159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:02.891484 13716 raft_consensus.cc:493] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.889166 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db87327473744d9cb4d2c2836ad19c47" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.913363 13716 raft_consensus.cc:515] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.913959 13385 raft_consensus.cc:2468] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:02.898427 13308 raft_consensus.cc:1275] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:02.888051 13433 ts_tablet_manager.cc:1434] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.049s	user 0.001s	sys 0.005s
I20260709 12:29:02.916002 13433 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:02.916627 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:02.917435 13312 raft_consensus.cc:2393] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:02.888432 13784 leader_election.cc:290] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.921746 13716 leader_election.cc:290] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.890450 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db87327473744d9cb4d2c2836ad19c47" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.924401 13804 consensus_queue.cc:1048] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:02.926020 13278 leader_election.cc:343] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.887310 13803 leader_election.cc:290] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:02.893155 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.926539 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.904350 13130 leader_election.cc:304] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:02.931778 13431 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:02.932266 13431 ts_tablet_manager.cc:1403] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.081s	user 0.015s	sys 0.032s
I20260709 12:29:02.927878 13276 leader_election.cc:304] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
W20260709 12:29:02.933075 13352 leader_election.cc:343] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.933830 13429 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1: No bootstrap required, opened a new log
I20260709 12:29:02.933986 13684 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.934322 13429 ts_tablet_manager.cc:1403] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.000s
I20260709 12:29:02.934527 13684 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.934995 13431 raft_consensus.cc:359] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.934345 13721 raft_consensus.cc:2804] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:02.935722 13431 raft_consensus.cc:385] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.935918 13721 raft_consensus.cc:493] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.936452 13721 raft_consensus.cc:3060] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.936568 13720 raft_consensus.cc:493] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.936717 13684 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:02.937286 13684 raft_consensus.cc:493] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.937153 13720 raft_consensus.cc:515] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.939065 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:02.936059 13431 raft_consensus.cc:740] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.941776 13431 consensus_queue.cc:260] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.942459 13484 raft_consensus.cc:2804] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:02.942242 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.942590 13429 raft_consensus.cc:359] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.943315 13383 raft_consensus.cc:2468] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:02.943646 13429 raft_consensus.cc:385] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:02.946560 13429 raft_consensus.cc:740] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Initialized, Role: FOLLOWER
I20260709 12:29:02.947700 13429 consensus_queue.cc:260] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:02.948565 13385 raft_consensus.cc:2393] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:02.952421 13202 leader_election.cc:304] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:02.953500 13796 raft_consensus.cc:3060] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.937737 13684 raft_consensus.cc:515] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:02.954671 13433 tablet_bootstrap.cc:654] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:02.949849 13276 leader_election.cc:304] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:02.965036 13238 raft_consensus.cc:1275] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:02.945745 13720 leader_election.cc:290] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:02.972869 13684 leader_election.cc:290] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:02.974749 13519 consensus_queue.cc:1048] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:02.981217 13429 ts_tablet_manager.cc:1434] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:29:02.970522 13773 raft_consensus.cc:2804] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:29:02.971076 13129 leader_election.cc:343] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:02.986416 13130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:44667, user_credentials={real_user=slave}} blocked reactor thread for 44868.2us
I20260709 12:29:02.987959 13431 ts_tablet_manager.cc:1434] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
W20260709 12:29:02.987349 13353 leader_election.cc:343] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:02.983184 13774 raft_consensus.cc:493] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:02.990746 13774 raft_consensus.cc:515] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:02.992120 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:02.992717 13386 raft_consensus.cc:2468] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:02.992807 13774 leader_election.cc:290] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:02.994866 13127 leader_election.cc:304] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:02.986156 13773 raft_consensus.cc:493] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:02.995533 13773 raft_consensus.cc:3060] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.996379 13234 raft_consensus.cc:3060] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:02.991027 13721 raft_consensus.cc:515] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:02.998833 13431 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:02.997954 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:03.001251 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db87327473744d9cb4d2c2836ad19c47" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:29:03.002527 13278 leader_election.cc:343] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:03.003547 13721 leader_election.cc:290] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:02.988675 13353 leader_election.cc:304] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:03.003058 13773 raft_consensus.cc:515] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.011915 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432cdf291ee349b1a36ebef0910617fa" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:03.012264 13161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432cdf291ee349b1a36ebef0910617fa" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:03.012674 13385 raft_consensus.cc:2468] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:03.014106 13159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:29:03.007681 13129 leader_election.cc:343] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:03.014865 13684 raft_consensus.cc:2804] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:03.009301 13804 raft_consensus.cc:2749] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:03.032073 13784 consensus_queue.cc:1048] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.033548 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:03.034142 13383 raft_consensus.cc:3060] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.005080 13484 raft_consensus.cc:697] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:03.036489 13796 raft_consensus.cc:2749] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:03.036927 13484 consensus_queue.cc:237] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
W20260709 12:29:03.018998 13279 leader_election.cc:343] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:03.040262 13279 leader_election.cc:343] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:03.040627 13309 raft_consensus.cc:1275] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:03.021937 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db87327473744d9cb4d2c2836ad19c47" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:03.023572 13433 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:03.026157 13715 raft_consensus.cc:493] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.027115 13684 raft_consensus.cc:493] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.042289 13385 raft_consensus.cc:3060] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.042520 13684 raft_consensus.cc:3060] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.045325 13715 raft_consensus.cc:515] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.047252 13276 leader_election.cc:304] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:03.049033 13716 raft_consensus.cc:493] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.049575 13716 raft_consensus.cc:515] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.050668 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:03.047509 13433 ts_tablet_manager.cc:1403] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.132s	user 0.003s	sys 0.011s
I20260709 12:29:03.052155 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:03.052882 13386 raft_consensus.cc:2393] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:29:03.053115 13715 leader_election.cc:290] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:03.054603 13716 leader_election.cc:290] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:03.054369 13684 raft_consensus.cc:515] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.063676 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:03.064211 13386 raft_consensus.cc:3060] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.066923 13433 raft_consensus.cc:359] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.067631 13433 raft_consensus.cc:385] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.067845 13433 raft_consensus.cc:740] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.068414 13433 consensus_queue.cc:260] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.068915 13385 raft_consensus.cc:2468] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:03.070276 13276 leader_election.cc:304] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:03.071044 13720 raft_consensus.cc:2804] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.073871 13684 leader_election.cc:290] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:03.041781 13383 raft_consensus.cc:2468] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:03.055120 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:03.056609 13774 raft_consensus.cc:2804] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:03.077806 13774 raft_consensus.cc:493] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.078195 13774 raft_consensus.cc:3060] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.060061 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:03.079046 13311 raft_consensus.cc:2468] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:03.075501 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:03.080211 13205 leader_election.cc:304] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
W20260709 12:29:03.081022 13129 leader_election.cc:343] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:03.081308 13716 raft_consensus.cc:3060] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.076632 13386 raft_consensus.cc:2468] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:03.086107 13127 leader_election.cc:304] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:03.093465 13774 raft_consensus.cc:515] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.094885 13849 raft_consensus.cc:2804] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.095366 13720 raft_consensus.cc:697] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:03.096475 13720 consensus_queue.cc:237] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:03.099752 13849 raft_consensus.cc:697] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:03.100513 13849 consensus_queue.cc:237] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.106455 13276 leader_election.cc:304] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:03.110028 13431 tablet_bootstrap.cc:654] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.112735 13433 ts_tablet_manager.cc:1434] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 12:29:03.113827 13433 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:03.116696 13130 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:03.118538 13724 consensus_queue.cc:1048] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.119020 13684 raft_consensus.cc:2804] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:03.120846 13386 raft_consensus.cc:3060] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:03.121948 13684 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.125455 13684 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.140053 13386 raft_consensus.cc:1275] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:03.121834 13716 raft_consensus.cc:2749] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:03.144733 13715 consensus_queue.cc:1048] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:03.154572 13715 consensus_queue.cc:1048] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:03.156329 13309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:03.156698 13773 leader_election.cc:290] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:03.169251 13856 raft_consensus.cc:2804] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.187616 13205 leader_election.cc:304] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:03.197813 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:03.202557 13160 raft_consensus.cc:3060] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:03.160931 13276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 54581.9us
W20260709 12:29:03.204226 13278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 74602.7us
I20260709 12:29:03.213892 13856 raft_consensus.cc:697] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:03.222338 13856 consensus_queue.cc:237] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.224462 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432cdf291ee349b1a36ebef0910617fa" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
W20260709 12:29:03.228839 13110 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:29:03.233304 13279 leader_election.cc:343] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:03.222884 13854 log.cc:927] Time spent T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:29:03.248162 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432cdf291ee349b1a36ebef0910617fa" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:03.248893 13386 raft_consensus.cc:3060] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.202692 13684 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.243813 13484 consensus_queue.cc:1048] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:29:03.258659 13774 leader_election.cc:290] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:03.284860 13715 raft_consensus.cc:2749] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:03.286146 13684 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:03.286295 13433 tablet_bootstrap.cc:654] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.288862 13431 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:03.289310 13431 ts_tablet_manager.cc:1403] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.291s	user 0.018s	sys 0.003s
I20260709 12:29:03.294684 13386 raft_consensus.cc:2468] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:03.291648 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:29:03.324122 13848 log.cc:927] Time spent T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.003s
I20260709 12:29:03.313863 13062 catalog_manager.cc:5697] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:03.331933 13868 raft_consensus.cc:493] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.332476 13868 raft_consensus.cc:515] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.336151 13164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:03.350853 13431 raft_consensus.cc:359] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.351475 13431 raft_consensus.cc:385] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:29:03.350176 13202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 61072.2us
I20260709 12:29:03.353900 13431 raft_consensus.cc:740] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.356254 13433 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:03.356674 13433 ts_tablet_manager.cc:1403] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.243s	user 0.013s	sys 0.003s
I20260709 12:29:03.355264 13431 consensus_queue.cc:260] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.366122 13721 raft_consensus.cc:493] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.370975 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:03.366636 13868 leader_election.cc:290] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:03.368849 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:03.373903 13276 leader_election.cc:304] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:03.377012 13721 raft_consensus.cc:515] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.380782 13311 raft_consensus.cc:2393] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:29:03.386679 13310 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.387271 13721 leader_election.cc:290] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
W20260709 12:29:03.390197 13129 leader_election.cc:343] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:03.390744 13433 raft_consensus.cc:359] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.391810 13433 raft_consensus.cc:385] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.392081 13433 raft_consensus.cc:740] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
W20260709 12:29:03.381172 13853 log.cc:927] Time spent T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:29:03.392563 13205 leader_election.cc:304] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:03.393590 13159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf31b69250947228a7680fc301334a0" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:03.394471 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf31b69250947228a7680fc301334a0" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
W20260709 12:29:03.396479 13278 leader_election.cc:343] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:03.396135 13060 catalog_manager.cc:5697] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:03.398293 13863 raft_consensus.cc:2804] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.398038 13060 catalog_manager.cc:5697] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:03.398788 13863 raft_consensus.cc:697] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:03.399609 13863 consensus_queue.cc:237] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.392683 13433 consensus_queue.cc:260] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.393486 13868 raft_consensus.cc:3060] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.406119 13431 ts_tablet_manager.cc:1434] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.117s	user 0.017s	sys 0.002s
I20260709 12:29:03.406719 13433 ts_tablet_manager.cc:1434] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.050s	user 0.002s	sys 0.005s
I20260709 12:29:03.408463 13433 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:03.409682 13431 tablet_bootstrap.cc:492] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:03.409855 13159 raft_consensus.cc:2468] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 0.
I20260709 12:29:03.410986 13310 raft_consensus.cc:2468] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:03.412936 13160 raft_consensus.cc:2468] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:03.417937 13279 leader_election.cc:304] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:03.419440 13857 raft_consensus.cc:2804] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:03.419823 13857 raft_consensus.cc:493] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.420130 13857 raft_consensus.cc:3060] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.432092 13130 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:03.436058 13684 raft_consensus.cc:2804] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.437685 13684 raft_consensus.cc:697] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:03.438536 13684 consensus_queue.cc:237] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.441679 13431 tablet_bootstrap.cc:654] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.442233 13868 raft_consensus.cc:2749] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:03.451187 13857 raft_consensus.cc:515] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.456180 13857 leader_election.cc:290] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:03.457044 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf31b69250947228a7680fc301334a0" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:03.457257 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf31b69250947228a7680fc301334a0" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:03.457823 13160 raft_consensus.cc:3060] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:03.458492 13278 leader_election.cc:343] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:03.463128 13160 raft_consensus.cc:2468] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:03.464253 13279 leader_election.cc:304] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:03.465334 13857 raft_consensus.cc:2804] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.465931 13857 raft_consensus.cc:697] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:03.466982 13857 consensus_queue.cc:237] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.469476 13433 tablet_bootstrap.cc:654] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.477501 13431 tablet_bootstrap.cc:492] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:03.478264 13431 ts_tablet_manager.cc:1403] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.001s
I20260709 12:29:03.486696 13433 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:03.487241 13433 ts_tablet_manager.cc:1403] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.002s
I20260709 12:29:03.492828 13431 raft_consensus.cc:359] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:03.493566 13431 raft_consensus.cc:385] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.493818 13431 raft_consensus.cc:740] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.494592 13431 consensus_queue.cc:260] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:03.497167 13431 ts_tablet_manager.cc:1434] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:29:03.498209 13431 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:03.502094 13433 raft_consensus.cc:359] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.502745 13433 raft_consensus.cc:385] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.503007 13433 raft_consensus.cc:740] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.503635 13433 consensus_queue.cc:260] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.505119 13433 ts_tablet_manager.cc:1434] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:29:03.509840 13433 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:03.517175 13433 tablet_bootstrap.cc:654] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.517933 13431 tablet_bootstrap.cc:654] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.518435 13062 catalog_manager.cc:5697] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:03.534828 13784 consensus_queue.cc:1048] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.531001 13062 catalog_manager.cc:5697] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:03.549151 13431 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:03.549691 13431 ts_tablet_manager.cc:1403] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.002s
I20260709 12:29:03.557801 13875 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.558326 13875 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.560501 13875 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:03.561928 13060 catalog_manager.cc:5697] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:03.563782 13433 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: No bootstrap required, opened a new log
I20260709 12:29:03.564270 13433 ts_tablet_manager.cc:1403] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.017s
I20260709 12:29:03.565042 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:03.565145 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:03.565989 13308 raft_consensus.cc:2393] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate 2b4ab106e71748ef9a1c55bece2316e5 in this term.
I20260709 12:29:03.567214 13060 catalog_manager.cc:5697] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:03.562664 13684 consensus_queue.cc:1048] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:29:03.572010 13205 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:03.577572 13875 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:03.588923 13129 consensus_peers.cc:597] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:03.591895 13431 raft_consensus.cc:359] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.594138 13433 raft_consensus.cc:359] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.596278 13433 raft_consensus.cc:385] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.596547 13433 raft_consensus.cc:740] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.597358 13433 consensus_queue.cc:260] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.601748 13433 ts_tablet_manager.cc:1434] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.002s
I20260709 12:29:03.592741 13431 raft_consensus.cc:385] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.610463 13431 raft_consensus.cc:740] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.611294 13431 consensus_queue.cc:260] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.613476 13431 ts_tablet_manager.cc:1434] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 12:29:03.604036 13875 raft_consensus.cc:2749] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:03.608670 13684 consensus_queue.cc:1048] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:03.615494 13865 consensus_queue.cc:1048] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.627723 13431 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:03.640319 13431 tablet_bootstrap.cc:654] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.645216 13431 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:03.646097 13431 ts_tablet_manager.cc:1403] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.002s
I20260709 12:29:03.648975 13431 raft_consensus.cc:359] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.652632 13431 raft_consensus.cc:385] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.652927 13431 raft_consensus.cc:740] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.653558 13431 consensus_queue.cc:260] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.655750 13431 ts_tablet_manager.cc:1434] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:03.658339 13431 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5: Bootstrap starting.
I20260709 12:29:03.653635 13865 consensus_queue.cc:1048] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:29:03.666296 13431 tablet_bootstrap.cc:654] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:03.671685 13431 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5: No bootstrap required, opened a new log
I20260709 12:29:03.672204 13431 ts_tablet_manager.cc:1403] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:29:03.674737 13431 raft_consensus.cc:359] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.675223 13431 raft_consensus.cc:385] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:03.675572 13431 raft_consensus.cc:740] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31406ec9b44549329b74301b355264c5, State: Initialized, Role: FOLLOWER
I20260709 12:29:03.676149 13431 consensus_queue.cc:260] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.678332 13431 ts_tablet_manager.cc:1434] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:29:03.688868 13684 raft_consensus.cc:493] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.689293 13684 raft_consensus.cc:515] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:03.691947 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432cdf291ee349b1a36ebef0910617fa" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:03.692111 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432cdf291ee349b1a36ebef0910617fa" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:03.692960 13385 raft_consensus.cc:2393] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b4ab106e71748ef9a1c55bece2316e5 in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:03.691589 13684 leader_election.cc:290] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:03.693869 13127 leader_election.cc:304] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5; no voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:03.694469 13684 raft_consensus.cc:3060] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.701576 13684 raft_consensus.cc:2749] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:03.711110 13684 raft_consensus.cc:493] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.711534 13684 raft_consensus.cc:515] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.713721 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:03.713478 13684 leader_election.cc:290] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:03.714407 13385 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:03.714737 13235 raft_consensus.cc:3060] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.714077 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:03.715293 13127 leader_election.cc:304] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:03.715440 13234 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 0.
I20260709 12:29:03.716085 13684 raft_consensus.cc:2804] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:03.716485 13684 raft_consensus.cc:493] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:03.716810 13684 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.722460 13865 consensus_queue.cc:1048] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.723114 13684 raft_consensus.cc:515] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.725059 13684 leader_election.cc:290] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:03.726344 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:03.726967 13385 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.727056 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:03.727799 13234 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.732622 13868 raft_consensus.cc:493] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:03.733134 13868 raft_consensus.cc:515] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:03.734705 13234 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:03.735697 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf31b69250947228a7680fc301334a0" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:03.736439 13160 raft_consensus.cc:2393] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 1: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:03.739207 13129 leader_election.cc:304] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:03.739967 13684 raft_consensus.cc:2804] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:03.740542 13684 raft_consensus.cc:697] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:03.741400 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cf31b69250947228a7680fc301334a0" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:03.741464 13684 consensus_queue.cc:237] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:03.743058 13205 leader_election.cc:304] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:03.743873 13875 raft_consensus.cc:3060] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:03.745566 13385 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 1.
I20260709 12:29:03.740734 13868 leader_election.cc:290] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:03.753088 13875 raft_consensus.cc:2749] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:03.760517 13060 catalog_manager.cc:5697] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:03.764897 13865 consensus_queue.cc:1048] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.802304 13863 consensus_queue.cc:1048] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.814220 13863 consensus_queue.cc:1048] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.820991 13684 consensus_queue.cc:1048] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.834141 13860 consensus_queue.cc:1048] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.875751 13863 consensus_queue.cc:1048] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:03.887842 13863 consensus_queue.cc:1048] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:04.000146 13856 raft_consensus.cc:493] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.000581 13856 raft_consensus.cc:515] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:04.002260 13856 leader_election.cc:290] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:04.002751 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:04.003163 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:04.003355 13385 raft_consensus.cc:2468] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:04.003748 13160 raft_consensus.cc:2468] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:04.004488 13276 leader_election.cc:304] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:04.005115 13856 raft_consensus.cc:2804] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:04.005390 13856 raft_consensus.cc:493] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.005602 13856 raft_consensus.cc:3060] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:04.010651 13875 raft_consensus.cc:493] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.011246 13875 raft_consensus.cc:515] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:04.013240 13875 leader_election.cc:290] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:04.014518 13856 raft_consensus.cc:515] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:04.016774 13234 raft_consensus.cc:3060] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:04.016990 13856 leader_election.cc:290] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:04.017818 13159 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:04.026589 13160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:04.026755 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:04.027287 13160 raft_consensus.cc:3060] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:04.028364 13202 leader_election.cc:304] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:04.034957 13875 raft_consensus.cc:2749] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:04.037755 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f4842692fd4f269ece83c3726dc22f" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:04.038414 13383 raft_consensus.cc:3060] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:04.050603 13383 raft_consensus.cc:2468] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:04.052479 13276 leader_election.cc:304] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:04.055670 13856 raft_consensus.cc:2804] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:04.056154 13856 raft_consensus.cc:697] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:04.056959 13856 consensus_queue.cc:237] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:04.059243 13160 raft_consensus.cc:2468] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:04.074470 13060 catalog_manager.cc:5697] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 0 to 2, leader changed from <none> to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:04.083938 13803 raft_consensus.cc:493] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:04.084507 13803 raft_consensus.cc:515] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:04.087431 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:04.088122 13234 raft_consensus.cc:2468] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:04.088745 13803 leader_election.cc:290] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:04.089228 13352 leader_election.cc:304] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:04.089888 13803 raft_consensus.cc:2804] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:04.090236 13803 raft_consensus.cc:493] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:04.090548 13803 raft_consensus.cc:3060] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:04.091799 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:04.092309 13310 raft_consensus.cc:2468] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:04.096392 13803 raft_consensus.cc:515] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:04.098134 13803 leader_election.cc:290] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:04.098649 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:04.099189 13234 raft_consensus.cc:3060] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:04.099332 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62f989b065674a6b912d5fbd4f911f8f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:04.099977 13310 raft_consensus.cc:3060] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:04.106181 13234 raft_consensus.cc:2468] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:04.106631 13310 raft_consensus.cc:2468] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:04.107585 13352 leader_election.cc:304] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:04.108278 13803 raft_consensus.cc:2804] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:04.108762 13803 raft_consensus.cc:697] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:04.109378 13803 consensus_queue.cc:237] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:04.118258 13060 catalog_manager.cc:5697] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 0 to 2, leader changed from <none> to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:04.281471 13484 consensus_queue.cc:1048] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:04.288348 13860 consensus_queue.cc:1048] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:04.391219 13353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:44667, user_credentials={real_user=slave}} blocked reactor thread for 57859.8us
I20260709 12:29:04.497896 13385 raft_consensus.cc:1275] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:04.499078 13912 consensus_queue.cc:1048] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:04.513265 13160 raft_consensus.cc:1275] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:04.514585 13865 consensus_queue.cc:1048] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:04.516242 13235 raft_consensus.cc:1275] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:04.521353 13519 consensus_queue.cc:1048] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:04.541757 13310 raft_consensus.cc:1275] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:04.543648 13918 consensus_queue.cc:1048] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:05.263815  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
W20260709 12:29:05.270917 13279 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:29:05.275949 13279 consensus_peers.cc:597] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.286374 13353 consensus_peers.cc:597] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.292994 13353 consensus_peers.cc:597] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.303750 13279 consensus_peers.cc:597] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.314214  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:05.315104  7261 tablet_replica.cc:333] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.315964  7261 raft_consensus.cc:2243] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.316916  7261 raft_consensus.cc:2272] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.318859  7261 tablet_replica.cc:333] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.319447  7261 raft_consensus.cc:2243] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.320137  7261 raft_consensus.cc:2272] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.321799  7261 tablet_replica.cc:333] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.322320  7261 raft_consensus.cc:2243] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.323030  7261 raft_consensus.cc:2272] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.324908  7261 tablet_replica.cc:333] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.325650  7261 raft_consensus.cc:2243] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.326557  7261 raft_consensus.cc:2272] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.328752  7261 tablet_replica.cc:333] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.329540  7261 raft_consensus.cc:2243] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.330433  7261 raft_consensus.cc:2272] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.332669  7261 tablet_replica.cc:333] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.333456  7261 raft_consensus.cc:2243] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.333941  7261 raft_consensus.cc:2272] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.334426 13279 consensus_peers.cc:597] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.336143  7261 tablet_replica.cc:333] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.336786  7261 raft_consensus.cc:2243] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.337164  7261 raft_consensus.cc:2272] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.338997  7261 tablet_replica.cc:333] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.339735  7261 raft_consensus.cc:2243] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.340574  7261 raft_consensus.cc:2272] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.342708  7261 tablet_replica.cc:333] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.343257  7261 raft_consensus.cc:2243] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.344117  7261 raft_consensus.cc:2272] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.346194  7261 tablet_replica.cc:333] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.346954  7261 raft_consensus.cc:2243] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.347901  7261 raft_consensus.cc:2272] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.349885 13353 consensus_peers.cc:597] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.350351  7261 tablet_replica.cc:333] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.351085  7261 raft_consensus.cc:2243] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.351979  7261 raft_consensus.cc:2272] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.354562  7261 tablet_replica.cc:333] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.355334  7261 raft_consensus.cc:2243] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.356331  7261 raft_consensus.cc:2272] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.358543  7261 tablet_replica.cc:333] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.359084  7261 raft_consensus.cc:2243] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.359613  7261 raft_consensus.cc:2272] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.362006  7261 tablet_replica.cc:333] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.362702  7261 raft_consensus.cc:2243] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.363422  7261 raft_consensus.cc:2272] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.365365  7261 tablet_replica.cc:333] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.366067  7261 raft_consensus.cc:2243] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.366564  7261 raft_consensus.cc:2272] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.368968  7261 tablet_replica.cc:333] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.369573  7261 raft_consensus.cc:2243] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.369959  7261 raft_consensus.cc:2272] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.372048  7261 tablet_replica.cc:333] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.372679  7261 raft_consensus.cc:2243] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.373585  7261 raft_consensus.cc:2272] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.376295  7261 tablet_replica.cc:333] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.377220  7261 raft_consensus.cc:2243] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.377694  7261 raft_consensus.cc:2272] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.380180  7261 tablet_replica.cc:333] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
W20260709 12:29:05.380373 13205 consensus_peers.cc:597] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.380930  7261 raft_consensus.cc:2243] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:05.381400 13279 consensus_peers.cc:597] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.381484  7261 raft_consensus.cc:2272] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.383723  7261 tablet_replica.cc:333] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.384297  7261 raft_consensus.cc:2243] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.384692  7261 raft_consensus.cc:2272] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.386502  7261 tablet_replica.cc:333] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.387020  7261 raft_consensus.cc:2243] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.387430  7261 raft_consensus.cc:2272] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.389266  7261 tablet_replica.cc:333] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.389743  7261 raft_consensus.cc:2243] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.390504  7261 raft_consensus.cc:2272] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.392371  7261 tablet_replica.cc:333] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.392895  7261 raft_consensus.cc:2243] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.393281  7261 raft_consensus.cc:2272] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.395852  7261 tablet_replica.cc:333] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
W20260709 12:29:05.395949 13353 consensus_peers.cc:597] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.396642  7261 raft_consensus.cc:2243] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.397179  7261 raft_consensus.cc:2272] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.399351  7261 tablet_replica.cc:333] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.399902  7261 raft_consensus.cc:2243] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.400285  7261 raft_consensus.cc:2272] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.402047  7261 tablet_replica.cc:333] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.402522  7261 raft_consensus.cc:2243] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.402858  7261 raft_consensus.cc:2272] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.404486  7261 tablet_replica.cc:333] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.404960  7261 raft_consensus.cc:2243] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.405313  7261 raft_consensus.cc:2272] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.407022  7261 tablet_replica.cc:333] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.407619  7261 raft_consensus.cc:2243] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.407965  7261 raft_consensus.cc:2272] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.409629  7261 tablet_replica.cc:333] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.410290  7261 raft_consensus.cc:2243] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.410722  7261 raft_consensus.cc:2272] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.412341 13353 consensus_peers.cc:597] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.412983  7261 tablet_replica.cc:333] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.413808  7261 raft_consensus.cc:2243] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.414601  7261 raft_consensus.cc:2272] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.416780  7261 tablet_replica.cc:333] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.417462  7261 raft_consensus.cc:2243] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.417907  7261 raft_consensus.cc:2272] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.419590  7261 tablet_replica.cc:333] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.420141  7261 raft_consensus.cc:2243] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.420977  7261 raft_consensus.cc:2272] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.422626 13279 consensus_peers.cc:597] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.423200  7261 tablet_replica.cc:333] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.423832  7261 raft_consensus.cc:2243] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.424544  7261 raft_consensus.cc:2272] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.426740  7261 tablet_replica.cc:333] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.427450  7261 raft_consensus.cc:2243] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.427860  7261 raft_consensus.cc:2272] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.427914 13279 consensus_peers.cc:597] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.429834  7261 tablet_replica.cc:333] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.430335  7261 raft_consensus.cc:2243] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.430670  7261 raft_consensus.cc:2272] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.432425  7261 tablet_replica.cc:333] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.432883  7261 raft_consensus.cc:2243] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.433303  7261 raft_consensus.cc:2272] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.434974  7261 tablet_replica.cc:333] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.435539  7261 raft_consensus.cc:2243] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.436256  7261 raft_consensus.cc:2272] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.437897  7261 tablet_replica.cc:333] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.438385  7261 raft_consensus.cc:2243] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.438728  7261 raft_consensus.cc:2272] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.440680  7261 tablet_replica.cc:333] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.441326  7261 raft_consensus.cc:2243] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.441802  7261 raft_consensus.cc:2272] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.444283  7261 tablet_replica.cc:333] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.444945  7261 raft_consensus.cc:2243] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.445835  7261 raft_consensus.cc:2272] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.448129  7261 tablet_replica.cc:333] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.448781  7261 raft_consensus.cc:2243] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.449254  7261 raft_consensus.cc:2272] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.454384 13279 consensus_peers.cc:597] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.454744  7261 tablet_replica.cc:333] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
W20260709 12:29:05.454936 13279 consensus_peers.cc:597] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.455621  7261 raft_consensus.cc:2243] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.456418  7261 raft_consensus.cc:2272] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.458261  7261 tablet_replica.cc:333] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.458861  7261 raft_consensus.cc:2243] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.459337  7261 raft_consensus.cc:2272] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.461903  7261 tablet_replica.cc:333] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
W20260709 12:29:05.462157 13279 consensus_peers.cc:597] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.462556  7261 raft_consensus.cc:2243] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.463135  7261 raft_consensus.cc:2272] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.465406  7261 tablet_replica.cc:333] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: stopping tablet replica
I20260709 12:29:05.465981  7261 raft_consensus.cc:2243] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.466490  7261 raft_consensus.cc:2272] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.476542 13279 consensus_peers.cc:597] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.533214  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
W20260709 12:29:05.533635 13279 consensus_peers.cc:597] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.538993 13279 consensus_peers.cc:597] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.550652 13353 consensus_peers.cc:597] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.588408 13353 consensus_peers.cc:597] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.607686  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:05.607829 13205 consensus_peers.cc:597] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.609673 13205 consensus_peers.cc:597] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.614774 13929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:05.614704 13928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:05.616166 13931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:05.618062  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:05.621863  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:05.622068  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:05.622210  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600145622198 us; error 0 us; skew 500 ppm
I20260709 12:29:05.622682  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:05.625137  7261 webserver.cc:533] Webserver started at http://127.7.23.65:45927/ using document root <none> and password file <none>
I20260709 12:29:05.625589  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:05.625736  7261 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:29:05.629374  7261 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:29:05.637604 13936 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:05.638639  7261 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:29:05.639025  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "2b4ab106e71748ef9a1c55bece2316e5"
format_stamp: "Formatted at 2026-07-09 12:28:54 on dist-test-slave-ps85"
I20260709 12:29:05.639401  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:29:05.652511 13205 consensus_peers.cc:597] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.656198  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:05.657437  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:05.659129  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:05.665194 13943 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:29:05.697851 13353 consensus_peers.cc:597] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.751305 13279 consensus_peers.cc:597] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.799628 13279 consensus_peers.cc:597] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.900478  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:29:05.900842  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.237s	user 0.008s	sys 0.000s
I20260709 12:29:05.901139  7261 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:29:05.905725 13943 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:05.920691 13943 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:05.921612 13943 tablet_bootstrap.cc:492] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:05.922242 13943 ts_tablet_manager.cc:1403] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:29:05.924616 13943 raft_consensus.cc:359] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:05.925179 13943 raft_consensus.cc:740] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.926101 13943 consensus_queue.cc:260] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:05.929832 13943 ts_tablet_manager.cc:1434] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:05.930636 13943 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:05.945057 13943 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:05.946023 13943 tablet_bootstrap.cc:492] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:05.946677 13943 ts_tablet_manager.cc:1403] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:29:05.949118 13943 raft_consensus.cc:359] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:05.949764 13943 raft_consensus.cc:740] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.950419 13943 consensus_queue.cc:260] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:05.952292 13943 ts_tablet_manager.cc:1434] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:29:05.953034 13943 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:05.977914 13943 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:05.978853 13943 tablet_bootstrap.cc:492] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:05.979462 13943 ts_tablet_manager.cc:1403] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 12:29:05.981812 13943 raft_consensus.cc:359] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:05.982457 13943 raft_consensus.cc:740] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:05.983098 13943 consensus_queue.cc:260] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:05.984895 13943 ts_tablet_manager.cc:1434] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:05.995944 13943 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.068816 13943 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.069756 13943 tablet_bootstrap.cc:492] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.070437 13943 ts_tablet_manager.cc:1403] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.075s	user 0.029s	sys 0.020s
I20260709 12:29:06.073827 13943 raft_consensus.cc:359] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.074496 13943 raft_consensus.cc:740] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.075323 13943 consensus_queue.cc:260] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.077234 13943 ts_tablet_manager.cc:1434] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:06.077981 13943 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.093044 13943 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.093922 13943 tablet_bootstrap.cc:492] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.094516 13943 ts_tablet_manager.cc:1403] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:29:06.096777 13943 raft_consensus.cc:359] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.098140 13943 raft_consensus.cc:740] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.098868 13943 consensus_queue.cc:260] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.100497 13943 ts_tablet_manager.cc:1434] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:06.101068 13943 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.124112 13943 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.124934 13943 tablet_bootstrap.cc:492] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.125438 13943 ts_tablet_manager.cc:1403] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.008s
I20260709 12:29:06.127754 13943 raft_consensus.cc:359] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.128245 13943 raft_consensus.cc:740] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.128758 13943 consensus_queue.cc:260] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.130157 13943 ts_tablet_manager.cc:1434] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:06.130733 13943 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.142560 13943 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.143232 13943 tablet_bootstrap.cc:492] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.143755 13943 ts_tablet_manager.cc:1403] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:29:06.145565 13943 raft_consensus.cc:359] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.146042 13943 raft_consensus.cc:740] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.146566 13943 consensus_queue.cc:260] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.148074 13943 ts_tablet_manager.cc:1434] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:06.148655 13943 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.152666  7261 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:29:06.153026  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.252s	user 0.233s	sys 0.004s
I20260709 12:29:06.160288 13943 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.161439 13943 tablet_bootstrap.cc:492] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.162215 13943 ts_tablet_manager.cc:1403] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:29:06.164798 13943 raft_consensus.cc:359] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.165436 13943 raft_consensus.cc:740] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.166069 13943 consensus_queue.cc:260] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.168097 13943 ts_tablet_manager.cc:1434] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:06.168851 13943 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.181066 13943 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.181764 13943 tablet_bootstrap.cc:492] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.182269 13943 ts_tablet_manager.cc:1403] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:29:06.184111 13943 raft_consensus.cc:359] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.184605 13943 raft_consensus.cc:740] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.185173 13943 consensus_queue.cc:260] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.186797 13943 ts_tablet_manager.cc:1434] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:06.187495 13943 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.199725 13943 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.200613 13943 tablet_bootstrap.cc:492] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.201193 13943 ts_tablet_manager.cc:1403] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.007s
I20260709 12:29:06.203629 13943 raft_consensus.cc:359] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.204257 13943 raft_consensus.cc:740] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.204892 13943 consensus_queue.cc:260] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.206900 13943 ts_tablet_manager.cc:1434] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:06.207690 13943 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.230641 13943 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.231536 13943 tablet_bootstrap.cc:492] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.232137 13943 ts_tablet_manager.cc:1403] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 12:29:06.234491 13943 raft_consensus.cc:359] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.235126 13943 raft_consensus.cc:740] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.235895 13943 consensus_queue.cc:260] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.237788 13943 ts_tablet_manager.cc:1434] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:06.238539 13943 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.243970  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:35779
I20260709 12:29:06.244110 14013 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:35779 every 8 connection(s)
I20260709 12:29:06.250990 13943 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.251974 13943 tablet_bootstrap.cc:492] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.252628 13943 ts_tablet_manager.cc:1403] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:29:06.255026 13943 raft_consensus.cc:359] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.255688 13943 raft_consensus.cc:740] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.256424 13943 consensus_queue.cc:260] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.264827 13943 ts_tablet_manager.cc:1434] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:29:06.265662 13943 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.286969 13943 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.287883 13943 tablet_bootstrap.cc:492] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.288522 13943 ts_tablet_manager.cc:1403] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:29:06.291018 13943 raft_consensus.cc:359] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.291746 13943 raft_consensus.cc:740] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.292459 13943 consensus_queue.cc:260] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.294739 13943 ts_tablet_manager.cc:1434] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:06.295534 13943 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.312031 13943 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.312932 13943 tablet_bootstrap.cc:492] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.313541 13943 ts_tablet_manager.cc:1403] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:29:06.315958 13943 raft_consensus.cc:359] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.316946 13943 raft_consensus.cc:740] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.317683 13943 consensus_queue.cc:260] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.319792 13943 ts_tablet_manager.cc:1434] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:29:06.320883 13943 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.322557 13912 raft_consensus.cc:493] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.323114 13912 raft_consensus.cc:515] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.325304 13912 leader_election.cc:290] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.327168 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:06.332286 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.333460 13927 raft_consensus.cc:493] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.333995 13927 raft_consensus.cc:515] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.336097 14015 heartbeater.cc:344] Connected to a master server at 127.7.23.126:43005
I20260709 12:29:06.336614 14015 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:06.336735 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:06.337664 14015 heartbeater.cc:507] Master 127.7.23.126:43005 requested a full tablet report, sending...
W20260709 12:29:06.340291 13279 leader_election.cc:343] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.340801 13279 leader_election.cc:304] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:06.341361 13927 leader_election.cc:290] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.342391 13912 raft_consensus.cc:2749] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.346251 13943 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.346362 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.347220 13943 tablet_bootstrap.cc:492] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
W20260709 12:29:06.347774 13205 leader_election.cc:343] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.347920 13943 ts_tablet_manager.cc:1403] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 12:29:06.348235 13205 leader_election.cc:304] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:06.349241 13927 raft_consensus.cc:2749] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.350587 13943 raft_consensus.cc:359] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.351286 13943 raft_consensus.cc:740] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.351962 13943 consensus_queue.cc:260] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.353945 13943 ts_tablet_manager.cc:1434] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:29:06.355099 13943 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.370827 13943 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.371578 13943 tablet_bootstrap.cc:492] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.371803 13061 ts_manager.cc:194] Re-registered known tserver with Master: 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.372126 13943 ts_tablet_manager.cc:1403] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:29:06.374177 13943 raft_consensus.cc:359] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.374641 13943 raft_consensus.cc:740] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.375187 13943 consensus_queue.cc:260] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.376972 13943 ts_tablet_manager.cc:1434] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:06.377450 13927 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.377714 13943 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.381398 13927 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.383484 13927 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:06.384133 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.384850 13987 raft_consensus.cc:2468] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:06.385178 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:06.387982 13519 raft_consensus.cc:493] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.388525 13519 raft_consensus.cc:515] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.390384 13519 leader_election.cc:290] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.392406 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.393043 13987 raft_consensus.cc:2468] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.394296 13353 leader_election.cc:304] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.395804 13803 raft_consensus.cc:2804] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.396152 13803 raft_consensus.cc:493] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.396467 13803 raft_consensus.cc:3060] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.400360 13205 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:06.400976 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.401173 13951 raft_consensus.cc:493] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.401741 13951 raft_consensus.cc:515] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.403985 13943 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.404412 13927 raft_consensus.cc:2804] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.404937 13943 tablet_bootstrap.cc:492] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.406404 13927 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.406819 13943 ts_tablet_manager.cc:1403] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.008s
I20260709 12:29:06.406867 13927 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.407344 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:06.409602 13943 raft_consensus.cc:359] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.410302 13943 raft_consensus.cc:740] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.411082 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.410980 13943 consensus_queue.cc:260] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.413091 13943 ts_tablet_manager.cc:1434] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:06.413781 13519 raft_consensus.cc:493] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.414076 13943 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.414420 13519 raft_consensus.cc:515] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.415732 13868 raft_consensus.cc:493] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.416446 13519 leader_election.cc:290] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.416263 13868 raft_consensus.cc:515] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.417999 13061 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44378
I20260709 12:29:06.413637 13803 raft_consensus.cc:515] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.418658 13868 leader_election.cc:290] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:06.420771 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.424939 13986 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.425429 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.406126 13951 leader_election.cc:290] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.426357 13353 leader_election.cc:304] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.427682 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:06.424134 14015 heartbeater.cc:499] Master 127.7.23.126:43005 was elected leader, sending a full tablet report...
I20260709 12:29:06.423993 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.428766 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:06.428179 13918 raft_consensus.cc:2804] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.429363 13918 raft_consensus.cc:493] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.429751 13918 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.430485 13519 raft_consensus.cc:493] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.431003 13519 raft_consensus.cc:515] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.431351 13951 raft_consensus.cc:493] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.431886 13951 raft_consensus.cc:515] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.433254 13519 leader_election.cc:290] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.434157 13951 leader_election.cc:290] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
W20260709 12:29:06.428360 13205 leader_election.cc:343] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.435578 13205 leader_election.cc:304] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:06.436331 13868 raft_consensus.cc:2749] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.441102 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.441803 13986 raft_consensus.cc:2468] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.443095 13353 leader_election.cc:304] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.443841 13519 raft_consensus.cc:2804] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.444236 13519 raft_consensus.cc:493] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.444623 13519 raft_consensus.cc:3060] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.449329 13987 raft_consensus.cc:3060] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.451395 13519 raft_consensus.cc:515] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.423635 13927 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.454252 13519 leader_election.cc:290] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.456888 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:06.457512 13986 raft_consensus.cc:3060] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.458210 13927 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:06.460916 13912 raft_consensus.cc:493] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.461505 13912 raft_consensus.cc:515] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.464645 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.466019 13912 leader_election.cc:290] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.468559 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.469259 13235 raft_consensus.cc:2468] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
W20260709 12:29:06.466086 13279 leader_election.cc:343] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.471577 13278 leader_election.cc:304] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:06.473742 13918 raft_consensus.cc:515] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.474552 13944 raft_consensus.cc:2804] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.475024 13944 raft_consensus.cc:493] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.475392 13944 raft_consensus.cc:3060] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.482758 13987 raft_consensus.cc:2468] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:06.429008 13803 leader_election.cc:290] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.485503 13918 leader_election.cc:290] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.487044 13951 raft_consensus.cc:493] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.487627 13951 raft_consensus.cc:515] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.488711 13918 raft_consensus.cc:493] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.489286 13918 raft_consensus.cc:515] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.491372 13918 leader_election.cc:290] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.491793 13986 raft_consensus.cc:2468] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:06.494916 13944 raft_consensus.cc:515] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.489735 13951 leader_election.cc:290] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:06.486703 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:06.486459 13353 leader_election.cc:304] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.497043 13918 raft_consensus.cc:493] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.497619 13918 raft_consensus.cc:515] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.498246 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.498579 13353 leader_election.cc:304] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.499336 13519 raft_consensus.cc:2804] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.499444 13803 raft_consensus.cc:2804] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.499929 13519 raft_consensus.cc:697] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:06.499948 13985 raft_consensus.cc:2468] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.500814 13519 consensus_queue.cc:237] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.501454 13353 leader_election.cc:304] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.501621 13987 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.508920 14031 raft_consensus.cc:2804] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.509366 14031 raft_consensus.cc:493] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.509734 14031 raft_consensus.cc:3060] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.511008 13803 raft_consensus.cc:697] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:06.511971 13803 consensus_queue.cc:237] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.518812 13943 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.520275 13918 leader_election.cc:290] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.520823 13918 raft_consensus.cc:493] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.521322 13918 raft_consensus.cc:515] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.515133 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
W20260709 12:29:06.524720 13279 leader_election.cc:343] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.525390 13912 raft_consensus.cc:493] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.525983 13912 raft_consensus.cc:515] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.527968 13943 tablet_bootstrap.cc:492] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.528687 13943 ts_tablet_manager.cc:1403] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.115s	user 0.024s	sys 0.036s
I20260709 12:29:06.530200 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.532919 13943 raft_consensus.cc:359] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.533655 13912 leader_election.cc:290] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.523370 13918 leader_election.cc:290] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.533670 13943 raft_consensus.cc:740] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.535976 13943 consensus_queue.cc:260] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.537918 13943 ts_tablet_manager.cc:1434] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:29:06.538400 13927 raft_consensus.cc:493] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.540511 13927 raft_consensus.cc:515] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.540721 13912 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.538522 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.538306 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.541874 13986 raft_consensus.cc:2468] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:06.542460 13927 leader_election.cc:290] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:06.538842 13944 leader_election.cc:290] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.539479 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.539916 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75960847d868465384c0cdc655302584" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:06.543510 13943 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.541322 13912 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.543145 13279 leader_election.cc:304] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:06.545531 13912 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.546085 13912 raft_consensus.cc:2804] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.546439 13912 raft_consensus.cc:493] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.546799 13912 raft_consensus.cc:3060] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.547683 14031 raft_consensus.cc:515] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.548580 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.549526 13234 raft_consensus.cc:2393] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 in current term 2: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:29:06.550954 13235 raft_consensus.cc:3060] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.551045 14031 leader_election.cc:290] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.548678 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.553231 13986 raft_consensus.cc:2468] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:06.554502 13279 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
I20260709 12:29:06.555254 13920 raft_consensus.cc:2804] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.555642 13920 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.556005 13920 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.559902 13987 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:06.562915 13920 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.565725 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:06.566354 13987 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.568501 14032 raft_consensus.cc:493] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
W20260709 12:29:06.568643 13205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 140306us
I20260709 12:29:06.569187 14032 raft_consensus.cc:515] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.569188 13920 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.570354 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:29:06.570065 13205 leader_election.cc:343] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.572115 13234 raft_consensus.cc:2393] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c15e995b6bee46f6a5dec636c28cb1b1 in current term 2: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
I20260709 12:29:06.572890 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.560155 13235 raft_consensus.cc:2468] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:06.586118 14032 leader_election.cc:290] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.592540 13943 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.593513 13943 tablet_bootstrap.cc:492] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.594130 13943 ts_tablet_manager.cc:1403] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.011s
I20260709 12:29:06.596702 13943 raft_consensus.cc:359] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.597395 13943 raft_consensus.cc:740] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.598060 13943 consensus_queue.cc:260] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.608515 13943 ts_tablet_manager.cc:1434] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:29:06.609324 13943 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.620908 13803 raft_consensus.cc:493] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.621589 13927 raft_consensus.cc:493] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.621949 13803 raft_consensus.cc:515] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.624140 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:06.624153 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:06.623522 13278 leader_election.cc:304] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:06.627640 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.591054 13912 raft_consensus.cc:515] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.628574 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:06.624322 13927 raft_consensus.cc:515] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.630100 13944 raft_consensus.cc:2804] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.630016 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.630811 13985 raft_consensus.cc:2468] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:06.631471 13927 leader_election.cc:290] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.628139 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:06.633069 13984 raft_consensus.cc:3060] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.633576 13951 raft_consensus.cc:493] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.634133 13951 raft_consensus.cc:515] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.636281 13951 leader_election.cc:290] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.637423 13205 leader_election.cc:304] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:06.640530 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
W20260709 12:29:06.636215 13353 leader_election.cc:343] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.638020 14029 raft_consensus.cc:493] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.639506 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:06.643551 13311 raft_consensus.cc:2393] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
I20260709 12:29:06.643690 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.639782 13803 leader_election.cc:290] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.644001 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:06.644264 14029 raft_consensus.cc:515] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.645308 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:06.646068 13310 raft_consensus.cc:2393] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate c15e995b6bee46f6a5dec636c28cb1b1 in this term.
W20260709 12:29:06.641620 13353 leader_election.cc:343] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.645875 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29983fe14304e40925e693584d53f29" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:06.646670 14029 leader_election.cc:290] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.646749 13353 leader_election.cc:304] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.643080 13060 catalog_manager.cc:5697] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.648002 14031 raft_consensus.cc:2804] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.646952 13985 raft_consensus.cc:3060] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.641095 13235 raft_consensus.cc:3060] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.650902 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.646891 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:06.644804 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:06.644323 13238 raft_consensus.cc:2468] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.654691 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.657205 14031 raft_consensus.cc:697] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:06.654547 13060 catalog_manager.cc:5697] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:06.658126 14031 consensus_queue.cc:237] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.658592 14029 raft_consensus.cc:493] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.659128 14029 raft_consensus.cc:515] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:29:06.660221 13353 leader_election.cc:343] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.640568 14035 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.648605 13927 raft_consensus.cc:2749] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.659863 13984 raft_consensus.cc:2468] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:06.621348 13987 raft_consensus.cc:2468] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:06.639550 13912 leader_election.cc:290] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.661532 13353 leader_election.cc:304] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:06.684938 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:06.668336 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:06.682993 13235 raft_consensus.cc:2468] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:06.727698 13519 raft_consensus.cc:2749] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.689606 13279 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 31406ec9b44549329b74301b355264c5
W20260709 12:29:06.729097 13353 leader_election.cc:343] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.730453 13353 leader_election.cc:304] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.733635 13943 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:06.733098 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.734902 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.735324 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.736049 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:06.734438 13235 raft_consensus.cc:2468] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
W20260709 12:29:06.736150 13276 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.68:36499, user_credentials={real_user=slave}} blocked reactor thread for 74280us
I20260709 12:29:06.737658 13803 raft_consensus.cc:2804] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.685674 13382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:06.664424 14029 leader_election.cc:290] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.684211 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:06.662868 13920 raft_consensus.cc:493] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.741741 13920 raft_consensus.cc:515] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.727247 13944 raft_consensus.cc:697] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:06.739539 13803 raft_consensus.cc:697] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:06.740443 13943 tablet_bootstrap.cc:492] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:06.745007 13943 ts_tablet_manager.cc:1403] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.136s	user 0.042s	sys 0.008s
I20260709 12:29:06.666116 14035 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.743826 13920 leader_election.cc:290] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.739809 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:06.744755 13803 consensus_queue.cc:237] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.750010 14035 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.751266 13238 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.752733 14039 raft_consensus.cc:2804] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.753261 14039 raft_consensus.cc:697] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:06.754108 14039 consensus_queue.cc:237] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
W20260709 12:29:06.758024 13279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 68510.9us
I20260709 12:29:06.760367 13278 leader_election.cc:304] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:06.761966 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.762637 13239 raft_consensus.cc:2468] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:06.791357 13278 leader_election.cc:304] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:06.761799 14035 raft_consensus.cc:493] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.796797 13519 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.797968 13519 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.779032 14029 raft_consensus.cc:493] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.805605 13519 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.795570 13944 consensus_queue.cc:237] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.808423 13239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.793805 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:06.794988 14032 raft_consensus.cc:493] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.800577 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.825798 14043 raft_consensus.cc:2804] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:06.831297 13519 raft_consensus.cc:493] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.831830 13519 raft_consensus.cc:515] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.832156 13868 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.832456 13920 raft_consensus.cc:2804] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.846060 13519 leader_election.cc:290] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.811177 14029 raft_consensus.cc:515] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:29:06.842113 13278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 49555.9us
I20260709 12:29:06.802484 14035 raft_consensus.cc:515] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:06.828292 13233 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.832214 13951 raft_consensus.cc:493] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.835554 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.830315 14032 raft_consensus.cc:515] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.837630 14043 raft_consensus.cc:697] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:06.843351 14037 raft_consensus.cc:493] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.850349 13927 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.850140 13920 raft_consensus.cc:493] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.842999 13983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.842504 13868 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.860881 13352 leader_election.cc:304] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:06.854596 13985 raft_consensus.cc:2468] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:06.878410 13352 leader_election.cc:304] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:06.876868 13943 raft_consensus.cc:359] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:06.879050 13943 raft_consensus.cc:740] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:06.879750 13943 consensus_queue.cc:260] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:06.864218 13984 raft_consensus.cc:2468] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.871628 13920 raft_consensus.cc:3060] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.860060 13951 raft_consensus.cc:515] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.883889 13943 ts_tablet_manager.cc:1434] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.138s	user 0.007s	sys 0.000s
I20260709 12:29:06.889746 13943 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:06.880478 14031 raft_consensus.cc:2749] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.875447 13983 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:06.882144 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2eab5a50da6542d6afd870d484d29a8e" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.870364 14037 raft_consensus.cc:515] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.871522 13927 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:29:06.902532 13279 leader_election.cc:343] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.887524 14032 leader_election.cc:290] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.887326 13982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bd0a7112fea4d999c0ddebe3a4a74a0" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.910897 14028 raft_consensus.cc:2749] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:06.912093 14035 leader_election.cc:290] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.912530 13951 leader_election.cc:290] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.913892 14037 leader_election.cc:290] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.914667 13981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.915069 13927 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.924041 13927 raft_consensus.cc:493] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.924520 13927 raft_consensus.cc:515] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.886866 14043 consensus_queue.cc:237] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.916862 13986 raft_consensus.cc:2393] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:06.918119 14029 leader_election.cc:290] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.919693 13982 raft_consensus.cc:2393] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:06.940002 14052 raft_consensus.cc:493] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.940634 14052 raft_consensus.cc:515] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.942787 14052 leader_election.cc:290] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.919804 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.920132 13353 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
W20260709 12:29:06.943383 14046 log.cc:927] Time spent T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:29:06.948647 13519 raft_consensus.cc:2804] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:06.949093 13519 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.949422 13519 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.921001 13980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.922706 13983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.952782 13983 raft_consensus.cc:2393] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:06.927958 13868 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.913923 13951 raft_consensus.cc:493] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:06.955904 13951 raft_consensus.cc:515] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:06.959697 13353 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:06.966074 13519 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:06.980531 13519 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:06.982466 13980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:29:06.988634 13353 leader_election.cc:343] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:06.992328 13205 leader_election.cc:343] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:06.992897 13353 leader_election.cc:343] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:06.993808 13205 leader_election.cc:343] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:06.994685 13205 leader_election.cc:304] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:06.946807 13238 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:06.961727 13951 leader_election.cc:290] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:07.005213 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:06.992187 14035 raft_consensus.cc:2804] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.006556 14035 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.006944 14035 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:06.959432 13927 leader_election.cc:290] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:06.963768 13983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:07.008175 13980 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:07.000015 14052 raft_consensus.cc:493] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.021870 14052 raft_consensus.cc:515] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.023276 13205 leader_election.cc:304] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
W20260709 12:29:07.024282 13278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 133264us
I20260709 12:29:06.962296 13920 raft_consensus.cc:515] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.026010 13927 raft_consensus.cc:3060] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.026895 13205 leader_election.cc:304] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:07.012912 13951 raft_consensus.cc:2764] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:29:07.030659 13353 leader_election.cc:343] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:07.032310 13205 leader_election.cc:343] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.032719 13205 leader_election.cc:304] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:07.033810 13205 leader_election.cc:304] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:07.036686 13205 leader_election.cc:304] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:07.037358 14029 raft_consensus.cc:2749] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.038060 14059 raft_consensus.cc:2749] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.040447 13920 leader_election.cc:290] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:07.042148 14052 leader_election.cc:290] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:07.043563 13382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:07.044240 13382 raft_consensus.cc:2468] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:07.031445 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.045203 13986 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.045410 13276 leader_election.cc:304] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:07.046021 14029 raft_consensus.cc:2749] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.032850 13868 raft_consensus.cc:3060] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.048754 13205 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:07.050300 13951 raft_consensus.cc:2749] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.052624 13205 leader_election.cc:304] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:07.054283 13951 raft_consensus.cc:2749] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.068361 13352 leader_election.cc:304] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.068754 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:07.069419 14049 raft_consensus.cc:2804] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.069870 14049 raft_consensus.cc:493] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.070112 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:07.069893 13381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:07.071341 13381 raft_consensus.cc:2468] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:07.070283 14049 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.072346 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:07.074262 14044 raft_consensus.cc:2804] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.074455 13980 raft_consensus.cc:1275] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.069576 13385 raft_consensus.cc:2393] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:07.077598 14044 raft_consensus.cc:493] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.078130 14044 raft_consensus.cc:3060] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.079383 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:07.080049 13233 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:07.082875 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.083549 13235 raft_consensus.cc:3060] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.086537 14031 consensus_queue.cc:1048] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.087332 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:07.087980 13308 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:07.095604 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:07.096783 13981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:07.097417 13981 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:07.099123 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" is_pre_election: true
I20260709 12:29:07.099447 13987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:07.099128 13982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:07.101039 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.077543 13238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:07.101693 13237 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.102195 13238 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 1.
I20260709 12:29:07.103319 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:07.103973 13232 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:07.104897 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:07.105553 13234 raft_consensus.cc:2468] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:07.105049 13385 raft_consensus.cc:2468] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:07.108873 13278 leader_election.cc:304] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:07.106850 13982 raft_consensus.cc:1275] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.110728 13353 leader_election.cc:304] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.114728 13278 leader_election.cc:304] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:07.101591 13983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce26cf9001dc430da555ebca2768adca" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
W20260709 12:29:07.115363 13205 leader_election.cc:343] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.134721 13235 raft_consensus.cc:2468] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:07.120064 13202 leader_election.cc:304] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:07.125715 14035 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.129554 13927 raft_consensus.cc:2749] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.112558 14047 raft_consensus.cc:2804] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.140853 13352 leader_election.cc:304] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.144460 14047 raft_consensus.cc:493] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.144761 13803 raft_consensus.cc:2804] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.145136 13803 raft_consensus.cc:493] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.145442 13803 raft_consensus.cc:3060] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.145781 14044 raft_consensus.cc:515] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.146914 13230 raft_consensus.cc:3060] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.148713 14044 leader_election.cc:290] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:07.148780 13986 raft_consensus.cc:2468] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:07.149320 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:07.149899 13383 raft_consensus.cc:3060] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.143184 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5" is_pre_election: true
I20260709 12:29:07.138827 13202 leader_election.cc:304] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.153141 13233 raft_consensus.cc:2468] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 1.
I20260709 12:29:07.153460 13803 raft_consensus.cc:515] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.155470 13803 leader_election.cc:290] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:07.155958 13353 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:07.142051 14056 raft_consensus.cc:2804] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.156436 13951 raft_consensus.cc:2804] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.156893 13951 raft_consensus.cc:493] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.139322 13981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:07.157291 13951 raft_consensus.cc:3060] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.141512 14051 raft_consensus.cc:2804] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.157635 14049 raft_consensus.cc:515] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.116958 14043 raft_consensus.cc:2804] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.158517 14043 raft_consensus.cc:493] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.158898 14043 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.159757 13983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.158012 14051 raft_consensus.cc:493] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.160420 14051 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.161772 14056 raft_consensus.cc:493] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.162195 14056 raft_consensus.cc:3060] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:07.164211 13353 leader_election.cc:343] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.165202 14049 leader_election.cc:290] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:07.165014 13951 raft_consensus.cc:515] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.165835 14049 raft_consensus.cc:2804] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.166489 14049 raft_consensus.cc:697] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:07.167297 14049 consensus_queue.cc:237] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.167655 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.169031 14035 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
W20260709 12:29:07.169621 13353 leader_election.cc:343] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.144881 14047 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.171110 13981 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 1.
I20260709 12:29:07.172488 13239 raft_consensus.cc:1275] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.173892 13951 leader_election.cc:290] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:07.135076 13205 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
W20260709 12:29:07.205555 13205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 70577.1us
I20260709 12:29:07.206144 13205 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
W20260709 12:29:07.206967 13205 leader_election.cc:343] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.143110 13918 consensus_queue.cc:1048] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:29:07.195251 13386 raft_consensus.cc:2393] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:07.195755 13061 catalog_manager.cc:5697] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:07.208491 13279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 178281us
I20260709 12:29:07.199864 13383 raft_consensus.cc:2468] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:07.141000 13278 leader_election.cc:304] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:07.207731 13205 leader_election.cc:304] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:07.211513 13276 leader_election.cc:304] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
W20260709 12:29:07.211712 13278 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 70756.9us
I20260709 12:29:07.216187 13920 raft_consensus.cc:2804] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.205123 13868 raft_consensus.cc:2749] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.217769 13986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.204001 14051 raft_consensus.cc:515] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.218437 13986 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.218972 13943 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:07.219873 14051 leader_election.cc:290] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:07.221722 13982 raft_consensus.cc:1275] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.223330 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:07.223444 13918 consensus_queue.cc:1048] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.223994 13385 raft_consensus.cc:3060] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.209930 14029 raft_consensus.cc:2804] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.225997 14029 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.226382 14029 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.202169 13237 raft_consensus.cc:2468] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
W20260709 12:29:07.211916 13279 leader_election.cc:343] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.234385 13943 tablet_bootstrap.cc:492] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:07.235033 13943 ts_tablet_manager.cc:1403] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.345s	user 0.015s	sys 0.016s
I20260709 12:29:07.230753 13920 raft_consensus.cc:697] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:07.236292 13920 consensus_queue.cc:237] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.237737 13943 raft_consensus.cc:359] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.240406 13943 raft_consensus.cc:740] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:07.230140 14059 raft_consensus.cc:2749] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.241216 13943 consensus_queue.cc:260] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.244830 13943 ts_tablet_manager.cc:1434] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:29:07.245626 13943 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:07.231742 14051 raft_consensus.cc:2804] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.247320 13385 raft_consensus.cc:2468] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:07.250591 13202 leader_election.cc:304] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:07.250919 14047 raft_consensus.cc:515] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.251353 13951 raft_consensus.cc:2804] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.251917 13951 raft_consensus.cc:697] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:07.253031 14047 leader_election.cc:290] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:07.252728 13951 consensus_queue.cc:237] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.254192 13230 raft_consensus.cc:1275] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.262611 14051 raft_consensus.cc:697] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:07.263447 13981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.263604 14051 consensus_queue.cc:237] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.263324 13237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.266341 13237 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.271719 13986 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:07.263098 14056 raft_consensus.cc:515] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.274715 14056 leader_election.cc:290] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:07.257599 13927 raft_consensus.cc:2749] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.289841 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:07.290439 13385 raft_consensus.cc:3060] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.290800 14043 raft_consensus.cc:515] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.292898 13984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.293040 14043 leader_election.cc:290] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:07.297201 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146bc2757b61443cbd22d2ee03b646f1" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.297295 13385 raft_consensus.cc:2468] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:07.298406 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ada84c8013e4ff38f38e094b8c7f161" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5" is_pre_election: true
I20260709 12:29:07.299916 13202 leader_election.cc:304] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:07.300861 13868 raft_consensus.cc:2804] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.301381 13868 raft_consensus.cc:697] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:07.302284 13868 consensus_queue.cc:237] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.310089 14029 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.312474 13237 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:07.314071 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.314675 13230 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:07.315902 13353 leader_election.cc:343] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.316605 13353 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:07.318859 13278 leader_election.cc:304] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:07.318981 14031 raft_consensus.cc:2804] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.319634 14031 raft_consensus.cc:697] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:07.329025 14029 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:07.333176 13060 catalog_manager.cc:5697] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.335564 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" is_pre_election: true
I20260709 12:29:07.338048 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:07.338389 13386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:07.339850 13981 raft_consensus.cc:1275] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.345283 13239 raft_consensus.cc:1275] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.343626 13060 catalog_manager.cc:5697] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.346781 13060 catalog_manager.cc:5697] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.351747 14049 consensus_queue.cc:1048] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.331789 14039 raft_consensus.cc:2804] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.362668 13236 raft_consensus.cc:1275] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:29:07.361848 13205 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.65:35779, user_credentials={real_user=slave}} blocked reactor thread for 154162us
I20260709 12:29:07.366807 13982 raft_consensus.cc:1275] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.367352 13352 leader_election.cc:304] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.367750 13981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.368323 13981 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.368481 13918 raft_consensus.cc:2804] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:07.368927 13918 raft_consensus.cc:493] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:07.369287 13918 raft_consensus.cc:3060] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:07.374604 13279 leader_election.cc:343] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.357103 13311 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.379962 13803 consensus_queue.cc:1048] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.381183 13205 leader_election.cc:304] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:07.368554 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.390905 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.393363 14031 consensus_queue.cc:237] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.378119 14047 consensus_queue.cc:1048] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:29:07.372195 14039 raft_consensus.cc:697] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:07.361430 14040 consensus_queue.cc:1048] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:29:07.413515 13230 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:07.413856 13232 raft_consensus.cc:1275] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.416106 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68eb6588fa0842bd812b9f8976b51d79" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.416664 13234 raft_consensus.cc:3060] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.412010 13239 raft_consensus.cc:1275] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:29:07.418731 13279 leader_election.cc:343] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.419541 13278 leader_election.cc:304] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:07.425711 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.427634 13235 raft_consensus.cc:2393] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fc0a5489897d4f6c8dd410cb6daee91b in current term 2: Already voted for candidate 31406ec9b44549329b74301b355264c5 in this term.
W20260709 12:29:07.440393 13352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 66766.2us
I20260709 12:29:07.446419 13234 raft_consensus.cc:2468] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:07.415275 13236 raft_consensus.cc:1275] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.412199 13233 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.409284 14075 raft_consensus.cc:2764] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:29:07.441787 13061 catalog_manager.cc:5697] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:07.440553 14040 raft_consensus.cc:2804] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:29:07.466884 13279 leader_election.cc:343] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.418303 14057 consensus_queue.cc:1048] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:29:07.472046 13352 leader_election.cc:304] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.464167 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42bae5aac3664bdaae25c1b0bd68ed08" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.484205 14080 raft_consensus.cc:2804] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.472329 14040 raft_consensus.cc:697] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Leader. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:07.472244 14035 consensus_queue.cc:1048] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:29:07.496754 13981 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c15e995b6bee46f6a5dec636c28cb1b1 in term 2.
I20260709 12:29:07.502218 13981 raft_consensus.cc:1275] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.504323 13311 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:07.505640 14053 consensus_queue.cc:1048] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:29:07.477210 13985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.506717 13985 raft_consensus.cc:2393] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 31406ec9b44549329b74301b355264c5 in current term 2: Already voted for candidate fc0a5489897d4f6c8dd410cb6daee91b in this term.
I20260709 12:29:07.476411 14047 consensus_queue.cc:1048] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:29:07.484774 14080 raft_consensus.cc:697] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:07.509573 14051 consensus_queue.cc:1048] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:07.522569 13353 leader_election.cc:304] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c15e995b6bee46f6a5dec636c28cb1b1, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
W20260709 12:29:07.523662 13352 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.23.66:34623, user_credentials={real_user=slave}} blocked reactor thread for 51706.3us
I20260709 12:29:07.524056 13205 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31406ec9b44549329b74301b355264c5; no voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b
I20260709 12:29:07.526051 13980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff0db3c14eb4efaa3564a8f703a3936" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.522830 14080 consensus_queue.cc:237] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.526088 14028 raft_consensus.cc:2804] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:29:07.510768 13279 leader_election.cc:343] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.511650 14040 consensus_queue.cc:237] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.473615 14039 consensus_queue.cc:237] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.520502 13943 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:07.509637 13918 raft_consensus.cc:515] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:29:07.535494 13205 leader_election.cc:343] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:07.540375 13205 leader_election.cc:343] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.544719 13943 tablet_bootstrap.cc:492] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:07.545493 13943 ts_tablet_manager.cc:1403] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.300s	user 0.012s	sys 0.010s
I20260709 12:29:07.543004 13060 catalog_manager.cc:5697] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:07.547051 13060 catalog_manager.cc:5697] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:07.550628 13060 catalog_manager.cc:5697] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:07.551646 13060 catalog_manager.cc:5697] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.549417 13061 catalog_manager.cc:5697] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.536664 14075 raft_consensus.cc:2749] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:29:07.546337 13912 consensus_queue.cc:1048] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:29:07.583875 13987 raft_consensus.cc:3060] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:07.543834 14028 raft_consensus.cc:697] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:07.604946 14028 consensus_queue.cc:237] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.608368 13943 raft_consensus.cc:359] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.611503 13943 raft_consensus.cc:740] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:07.613085 13943 consensus_queue.cc:260] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.617621 13943 ts_tablet_manager.cc:1434] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.072s	user 0.005s	sys 0.000s
I20260709 12:29:07.635332 13239 raft_consensus.cc:1275] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.637646 13519 consensus_queue.cc:1048] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:07.646248 14090 log.cc:927] Time spent T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:29:07.640416 13233 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:07.673552 13980 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:07.674779 13352 leader_election.cc:304] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.679234 14080 raft_consensus.cc:2804] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.681308 14080 raft_consensus.cc:697] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:07.682166 14080 consensus_queue.cc:237] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:07.689476 13918 leader_election.cc:290] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Requested vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:07.690062 13943 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:07.705765 13987 raft_consensus.cc:1275] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.706080 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bc3d02f64b7429aa081f6d4ac732e20" candidate_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:07.706904 13233 raft_consensus.cc:3060] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:07.715312 13353 leader_election.cc:343] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:07.735754 14066 consensus_queue.cc:1048] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:07.742758 13279 consensus_peers.cc:597] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:07.745328 13386 raft_consensus.cc:1275] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.747066 14075 consensus_queue.cc:1048] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.749167 13062 catalog_manager.cc:5697] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:07.753182 13279 consensus_peers.cc:597] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:07.754657 13234 raft_consensus.cc:1275] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.756203 14043 consensus_queue.cc:1048] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.824577 13943 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:07.825489 13943 tablet_bootstrap.cc:492] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:07.828799 13233 raft_consensus.cc:2468] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc0a5489897d4f6c8dd410cb6daee91b in term 2.
I20260709 12:29:07.830547 13352 leader_election.cc:304] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:07.831720 13979 raft_consensus.cc:1275] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.832161 14035 raft_consensus.cc:2804] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:07.832728 14035 raft_consensus.cc:697] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Leader. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
W20260709 12:29:07.834982 13205 consensus_peers.cc:597] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:07.836663 13386 raft_consensus.cc:1275] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.833544 14035 consensus_queue.cc:237] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
W20260709 12:29:07.855924 13205 consensus_peers.cc:597] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:07.855832 14061 consensus_queue.cc:1048] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.837723 14088 consensus_queue.cc:1048] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:07.838894 13943 ts_tablet_manager.cc:1403] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.149s	user 0.023s	sys 0.004s
W20260709 12:29:07.840322 13279 consensus_peers.cc:597] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:07.853247 13385 raft_consensus.cc:1275] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.871227 13943 raft_consensus.cc:359] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.875860 13943 raft_consensus.cc:740] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:07.876636 13943 consensus_queue.cc:260] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:07.879048 13943 ts_tablet_manager.cc:1434] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:29:07.880136 13943 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:29:07.886250 13279 consensus_peers.cc:597] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:07.886725 13060 catalog_manager.cc:5697] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.888576 13060 catalog_manager.cc:5697] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.887286 13059 catalog_manager.cc:5697] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:07.891791 13059 catalog_manager.cc:5697] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67). New cstate: current_term: 2 leader_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:07.910929 14040 consensus_queue.cc:1048] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:07.919165 13353 consensus_peers.cc:597] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:07.919843 13353 consensus_peers.cc:597] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:07.930084 13279 consensus_peers.cc:597] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:07.941730 13353 consensus_peers.cc:597] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:07.977026 13061 catalog_manager.cc:5697] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.978830 13061 catalog_manager.cc:5697] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b reported cstate change: term changed from 1 to 2, leader changed from 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65) to fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68). New cstate: current_term: 2 leader_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:07.981665 13943 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:07.982649 13943 tablet_bootstrap.cc:492] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:07.983299 13943 ts_tablet_manager.cc:1403] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.002s
I20260709 12:29:07.985466 13234 raft_consensus.cc:1275] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.986117 13943 raft_consensus.cc:359] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.986797 13943 raft_consensus.cc:740] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:07.987039 14028 consensus_queue.cc:1048] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:07.987597 13943 consensus_queue.cc:260] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:07.989830 13943 ts_tablet_manager.cc:1434] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:07.990561 13943 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:07.994166 13979 raft_consensus.cc:1275] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:07.997905 14028 consensus_queue.cc:1048] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.010785 13984 raft_consensus.cc:1275] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.012789 14051 consensus_queue.cc:1048] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.023038 13234 raft_consensus.cc:1275] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.024902 14049 consensus_queue.cc:1048] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:08.054473 13353 consensus_peers.cc:597] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:08.066155 13234 raft_consensus.cc:1275] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.066210 13943 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.067523 13943 tablet_bootstrap.cc:492] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.067580 14031 consensus_queue.cc:1048] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.068194 13943 ts_tablet_manager.cc:1403] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.078s	user 0.027s	sys 0.007s
I20260709 12:29:08.070866 13230 raft_consensus.cc:1275] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.070761 13943 raft_consensus.cc:359] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.071476 13943 raft_consensus.cc:740] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.072271 13943 consensus_queue.cc:260] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.072486 14040 consensus_queue.cc:1048] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.081872 13943 ts_tablet_manager.cc:1434] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:29:08.082746 13943 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:29:08.088578 13353 consensus_peers.cc:597] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:08.097541 13311 raft_consensus.cc:1275] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.106827 13943 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.107914 13943 tablet_bootstrap.cc:492] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.108629 13943 ts_tablet_manager.cc:1403] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.007s
I20260709 12:29:08.111143 13943 raft_consensus.cc:359] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.111886 13943 raft_consensus.cc:740] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.112768 13943 consensus_queue.cc:260] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.115022 13943 ts_tablet_manager.cc:1434] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:29:08.115906 13943 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:29:08.117280 13353 consensus_peers.cc:597] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:08.118060 14088 consensus_queue.cc:1048] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.120688 13979 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.127734 13979 raft_consensus.cc:1275] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:29:08.134208 13279 consensus_peers.cc:597] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:08.137173 13803 consensus_queue.cc:1048] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.142988 13943 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.143970 13943 tablet_bootstrap.cc:492] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.144644 13943 ts_tablet_manager.cc:1403] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
I20260709 12:29:08.148079 13943 raft_consensus.cc:359] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.148744 13943 raft_consensus.cc:740] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.149391 13943 consensus_queue.cc:260] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.151355 13943 ts_tablet_manager.cc:1434] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:29:08.152109 13943 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:29:08.153303 13353 consensus_peers.cc:597] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:08.179919 13943 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.180913 13943 tablet_bootstrap.cc:492] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.181582 13943 ts_tablet_manager.cc:1403] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.008s
I20260709 12:29:08.185518 13943 raft_consensus.cc:359] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.186158 13943 raft_consensus.cc:740] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.186877 13943 consensus_queue.cc:260] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.188810 13943 ts_tablet_manager.cc:1434] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:29:08.190523 13943 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:29:08.191866 13279 consensus_peers.cc:597] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:08.203228 13943 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.204128 13943 tablet_bootstrap.cc:492] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.204732 13943 ts_tablet_manager.cc:1403] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:29:08.206887 13943 raft_consensus.cc:359] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.207543 13943 raft_consensus.cc:740] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.208199 13943 consensus_queue.cc:260] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.208981 13238 raft_consensus.cc:1275] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer c15e995b6bee46f6a5dec636c28cb1b1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.210234 13943 ts_tablet_manager.cc:1434] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 12:29:08.210916 13943 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.211117 14040 consensus_queue.cc:1048] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.231088 13943 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.232009 13943 tablet_bootstrap.cc:492] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.232659 13943 ts_tablet_manager.cc:1403] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:29:08.234972 13943 raft_consensus.cc:359] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.235620 13943 raft_consensus.cc:740] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.236256 13943 consensus_queue.cc:260] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.238894 13943 ts_tablet_manager.cc:1434] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:08.239794 13943 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.253958 13943 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.254637 13943 tablet_bootstrap.cc:492] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.255144 13943 ts_tablet_manager.cc:1403] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:29:08.256899 13943 raft_consensus.cc:359] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.257360 13943 raft_consensus.cc:740] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.257899 13943 consensus_queue.cc:260] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.259672 13943 ts_tablet_manager.cc:1434] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 12:29:08.260699 13943 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.274212 13943 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.275058 13943 tablet_bootstrap.cc:492] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.275656 13943 ts_tablet_manager.cc:1403] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:29:08.277987 13943 raft_consensus.cc:359] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.278478 13943 raft_consensus.cc:740] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.279099 13943 consensus_queue.cc:260] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.281107 13943 ts_tablet_manager.cc:1434] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:08.282410 13943 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
W20260709 12:29:08.283110 13279 consensus_peers.cc:597] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:08.296947 13943 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.297706 13943 tablet_bootstrap.cc:492] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.298254 13943 ts_tablet_manager.cc:1403] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:29:08.299953 13943 raft_consensus.cc:359] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.300410 13943 raft_consensus.cc:740] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.300935 13943 consensus_queue.cc:260] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.302639 13943 ts_tablet_manager.cc:1434] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:08.303635 13943 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.315056 13230 raft_consensus.cc:1275] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.316629 14088 consensus_queue.cc:1048] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.323645 13943 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.324671 13943 tablet_bootstrap.cc:492] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.325287 13943 ts_tablet_manager.cc:1403] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:29:08.329201 13943 raft_consensus.cc:359] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.329846 13943 raft_consensus.cc:740] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.330476 13943 consensus_queue.cc:260] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.332489 13943 ts_tablet_manager.cc:1434] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:29:08.333220 13943 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.338512 13984 raft_consensus.cc:3060] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:08.339875 13353 consensus_peers.cc:597] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:29:08.349438 13984 raft_consensus.cc:1275] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Refusing update from remote peer fc0a5489897d4f6c8dd410cb6daee91b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:08.357903 14088 consensus_queue.cc:1048] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:08.363937 13943 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.364871 13943 tablet_bootstrap.cc:492] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.365486 13943 ts_tablet_manager.cc:1403] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.008s
I20260709 12:29:08.365363 13979 raft_consensus.cc:3060] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.368252 13943 raft_consensus.cc:359] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.368885 13943 raft_consensus.cc:740] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.369524 13943 consensus_queue.cc:260] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.371516 13943 ts_tablet_manager.cc:1434] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:29:08.372257 13943 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.387249 13943 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.388131 13943 tablet_bootstrap.cc:492] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.388958 13943 ts_tablet_manager.cc:1403] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.001s
I20260709 12:29:08.391315 13943 raft_consensus.cc:359] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.391975 13943 raft_consensus.cc:740] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.392602 13943 consensus_queue.cc:260] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.394553 13943 ts_tablet_manager.cc:1434] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:29:08.395341 13943 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.409745 13943 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.410681 13943 tablet_bootstrap.cc:492] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.411268 13943 ts_tablet_manager.cc:1403] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 12:29:08.413462 13943 raft_consensus.cc:359] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.414101 13943 raft_consensus.cc:740] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.414716 13943 consensus_queue.cc:260] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.416697 13943 ts_tablet_manager.cc:1434] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:29:08.417428 13943 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.431079 13943 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.431892 13943 tablet_bootstrap.cc:492] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.432451 13943 ts_tablet_manager.cc:1403] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 12:29:08.434756 13943 raft_consensus.cc:359] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.435196 13943 raft_consensus.cc:740] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.435707 13943 consensus_queue.cc:260] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.437333 13943 ts_tablet_manager.cc:1434] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:29:08.438409 13943 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.455300 13943 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.456043 13943 tablet_bootstrap.cc:492] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.456568 13943 ts_tablet_manager.cc:1403] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:29:08.458346 13943 raft_consensus.cc:359] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.458978 13943 raft_consensus.cc:740] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.459592 13943 consensus_queue.cc:260] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.461378 13943 ts_tablet_manager.cc:1434] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:08.462782 13943 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.478392 13943 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.479136 13943 tablet_bootstrap.cc:492] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.479760 13943 ts_tablet_manager.cc:1403] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:29:08.482045 13943 raft_consensus.cc:359] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.482673 13943 raft_consensus.cc:740] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.483352 13943 consensus_queue.cc:260] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.485808 13943 ts_tablet_manager.cc:1434] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:08.486572 13943 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.506587 13943 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.507550 13943 tablet_bootstrap.cc:492] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.508232 13943 ts_tablet_manager.cc:1403] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:29:08.510553 13943 raft_consensus.cc:359] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.511204 13943 raft_consensus.cc:740] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.511852 13943 consensus_queue.cc:260] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.513828 13943 ts_tablet_manager.cc:1434] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:08.514456 13943 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.526512 13943 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.527190 13943 tablet_bootstrap.cc:492] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.527714 13943 ts_tablet_manager.cc:1403] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:29:08.529742 13943 raft_consensus.cc:359] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.530375 13943 raft_consensus.cc:740] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.530997 13943 consensus_queue.cc:260] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:08.532851 13943 ts_tablet_manager.cc:1434] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:08.533469 13943 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.544605 13943 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.545483 13943 tablet_bootstrap.cc:492] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.546103 13943 ts_tablet_manager.cc:1403] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:29:08.548291 13943 raft_consensus.cc:359] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.548803 13943 raft_consensus.cc:740] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.549371 13943 consensus_queue.cc:260] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.551169 13943 ts_tablet_manager.cc:1434] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:08.552229 13943 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.554070 13979 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.593858 13943 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.594770 13943 tablet_bootstrap.cc:492] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.595398 13943 ts_tablet_manager.cc:1403] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.020s
I20260709 12:29:08.597752 13943 raft_consensus.cc:359] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.598376 13943 raft_consensus.cc:740] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.599006 13979 raft_consensus.cc:3060] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.599007 13943 consensus_queue.cc:260] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:08.601497 13943 ts_tablet_manager.cc:1434] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:08.602252 13943 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap starting.
I20260709 12:29:08.616889 13979 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.622354 13943 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:08.623365 13943 tablet_bootstrap.cc:492] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Bootstrap complete.
I20260709 12:29:08.624004 13943 ts_tablet_manager.cc:1403] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 12:29:08.626628 13943 raft_consensus.cc:359] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.627281 13943 raft_consensus.cc:740] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.628013 13943 consensus_queue.cc:260] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:08.630129 13943 ts_tablet_manager.cc:1434] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:08.678664 13979 raft_consensus.cc:3060] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.683579 13984 raft_consensus.cc:3060] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:08.924780 13984 raft_consensus.cc:3060] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.265127  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:16.309648 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:16.310436 13311 raft_consensus.cc:606] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Received request to transfer leadership to TS 31406ec9b44549329b74301b355264c5
I20260709 12:29:16.321749 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f012632e884464d8749351b0ca69fef"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:16.322290 13385 raft_consensus.cc:606] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:16.324827 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:16.325299 13311 raft_consensus.cc:606] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:16.327517 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:16.327919 13311 raft_consensus.cc:606] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:16.330101 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:16.330485 13311 raft_consensus.cc:606] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Received request to transfer leadership to TS 31406ec9b44549329b74301b355264c5
I20260709 12:29:16.332302 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:16.332664 13311 raft_consensus.cc:606] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Received request to transfer leadership to TS 31406ec9b44549329b74301b355264c5
I20260709 12:29:16.333490  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:29:16.334612  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:16.335280  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:16.380380 14176 raft_consensus.cc:993] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:16.381044 14169 raft_consensus.cc:1081] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Signalling peer 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:16.382506 13238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043"
dest_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:58296
I20260709 12:29:16.382961 13238 raft_consensus.cc:493] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:16.383266 13238 raft_consensus.cc:3060] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.390411 13238 raft_consensus.cc:515] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.392529 13238 leader_election.cc:290] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:16.393482 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:16.393625 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "530182bf3a3f45e99ccc864a7f931043" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:16.394129 13311 raft_consensus.cc:3055] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:16.394266 13385 raft_consensus.cc:3060] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.394472 13311 raft_consensus.cc:740] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:16.395346 13311 consensus_queue.cc:260] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.396453 13311 raft_consensus.cc:3060] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.402870 13311 raft_consensus.cc:2468] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:16.403026 13385 raft_consensus.cc:2468] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:16.403937 13205 leader_election.cc:304] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:16.404892 14174 raft_consensus.cc:2804] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:16.405860 14174 raft_consensus.cc:697] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:16.406745 14174 consensus_queue.cc:237] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.417697 13060 catalog_manager.cc:5697] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:16.518181 14169 raft_consensus.cc:993] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:16.518682 14176 raft_consensus.cc:1081] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Signalling peer 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:16.520176 13238 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771"
dest_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:58296
I20260709 12:29:16.520699 13238 raft_consensus.cc:493] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:16.520977 13238 raft_consensus.cc:3060] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.526800 13238 raft_consensus.cc:515] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.528247 13238 leader_election.cc:290] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:16.528833 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:16.529177 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c1b0221c64d12960e29e5cb59e771" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:16.529413 13311 raft_consensus.cc:3055] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:16.529698 13311 raft_consensus.cc:740] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:16.529676 13385 raft_consensus.cc:3060] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.530578 13311 consensus_queue.cc:260] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.531580 13311 raft_consensus.cc:3060] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.534277 13385 raft_consensus.cc:2468] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:16.535290 13202 leader_election.cc:304] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:16.535952 14174 raft_consensus.cc:2804] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:16.536412 13311 raft_consensus.cc:2468] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:16.537573 14174 raft_consensus.cc:697] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:16.538460 14174 consensus_queue.cc:237] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.547487 13060 catalog_manager.cc:5697] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:16.624893 14177 raft_consensus.cc:993] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:16.625459 14173 raft_consensus.cc:1081] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:16.626850 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f012632e884464d8749351b0ca69fef"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:16.627334 13978 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:16.627636 13978 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.633701 13978 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:16.635861 13978 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:16.646112 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:16.646703 13385 raft_consensus.cc:3055] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:16.647001 13385 raft_consensus.cc:740] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:16.647722 13385 consensus_queue.cc:260] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:16.648917 13385 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.654071 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f012632e884464d8749351b0ca69fef" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:16.654693 13230 raft_consensus.cc:3060] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.658862 13385 raft_consensus.cc:2468] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:16.660394 13937 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:16.661216 13230 raft_consensus.cc:2468] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:16.662321 14192 raft_consensus.cc:2804] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:16.663630 14192 raft_consensus.cc:697] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:16.665324 14192 consensus_queue.cc:237] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:16.674198 13060 catalog_manager.cc:5697] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 2 to 3, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:16.680842 14176 raft_consensus.cc:993] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:16.681310 14169 raft_consensus.cc:1081] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:16.682691 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:29:16.683094 13978 raft_consensus.cc:493] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:16.683358 13978 raft_consensus.cc:3060] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.688123 13978 raft_consensus.cc:515] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:16.689725 13978 leader_election.cc:290] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:16.690621 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:16.691102 13385 raft_consensus.cc:3060] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.697515 13385 raft_consensus.cc:2468] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:16.698597 13937 leader_election.cc:304] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:16.699456 14192 raft_consensus.cc:2804] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:16.699599 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f91ee1828b41d4b41addb4bc0c39a6" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:16.699968 14192 raft_consensus.cc:697] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:16.700227 13311 raft_consensus.cc:3055] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:16.700537 13311 raft_consensus.cc:740] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:16.700896 14192 consensus_queue.cc:237] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:16.701270 13311 consensus_queue.cc:260] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:16.702502 13311 raft_consensus.cc:3060] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.709120 13311 raft_consensus.cc:2468] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:16.711675 13060 catalog_manager.cc:5697] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:16.726265 14169 raft_consensus.cc:993] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:16.726702 14176 raft_consensus.cc:1081] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:16.727991 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:29:16.728416 13978 raft_consensus.cc:493] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:16.728660 13978 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.733397 13978 raft_consensus.cc:515] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:16.735358 13978 leader_election.cc:290] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:16.735982 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:16.736533 13311 raft_consensus.cc:3055] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:16.736740 13311 raft_consensus.cc:740] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:16.737373 13311 consensus_queue.cc:260] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:16.738365 13311 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.735509 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78cf5898f4814d6e9bc0a55599d09ea8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:16.739255 13230 raft_consensus.cc:3060] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:16.743867 13311 raft_consensus.cc:2468] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:16.744927 13940 leader_election.cc:304] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:16.745095 13230 raft_consensus.cc:2468] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:16.745800 14192 raft_consensus.cc:2804] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:16.746326 14192 raft_consensus.cc:697] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:16.747205 14192 consensus_queue.cc:237] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:16.755923 13060 catalog_manager.cc:5697] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 2 to 3, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:16.774310 14176 raft_consensus.cc:993] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:16.774791 14169 raft_consensus.cc:1081] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Signalling peer 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:16.776252 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad"
dest_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:58296
I20260709 12:29:16.776811 13230 raft_consensus.cc:493] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:16.777130 13230 raft_consensus.cc:3060] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.783910 13230 raft_consensus.cc:515] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.786672 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:16.787194 13385 raft_consensus.cc:3060] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.787724 13230 leader_election.cc:290] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:16.788276 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5b079a944f8482f9dcfbc01251b99ad" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:16.788875 13311 raft_consensus.cc:3055] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:16.789152 13311 raft_consensus.cc:740] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:16.789933 13311 consensus_queue.cc:260] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.791123 13311 raft_consensus.cc:3060] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:16.793728 13385 raft_consensus.cc:2468] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:16.794801 13202 leader_election.cc:304] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:16.795560 14174 raft_consensus.cc:2804] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:16.795944 14174 raft_consensus.cc:697] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:16.797278 14174 consensus_queue.cc:237] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:16.799132 13311 raft_consensus.cc:2468] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:16.810616 13060 catalog_manager.cc:5697] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:16.910076 13308 raft_consensus.cc:1275] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:16.911396 14174 consensus_queue.cc:1048] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:16.927349 13385 raft_consensus.cc:1275] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:16.929150 14181 consensus_queue.cc:1048] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:17.017875 13308 raft_consensus.cc:1275] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:17.018839 14181 consensus_queue.cc:1048] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:17.026829 13385 raft_consensus.cc:1275] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:17.028440 14174 consensus_queue.cc:1048] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:17.101351 13230 raft_consensus.cc:1275] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:17.102540 14192 consensus_queue.cc:1048] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:17.113727 13385 raft_consensus.cc:1275] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:17.115684 14193 consensus_queue.cc:1048] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:17.136559 13385 raft_consensus.cc:1275] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:17.137569 14193 consensus_queue.cc:1048] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:17.152104 13308 raft_consensus.cc:1275] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:17.159523 14192 consensus_queue.cc:1048] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:17.260916 13308 raft_consensus.cc:1275] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:17.262338 14192 consensus_queue.cc:1048] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:17.267987 13308 raft_consensus.cc:1275] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:17.269126 14174 consensus_queue.cc:1048] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:17.273581 13230 raft_consensus.cc:1275] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:17.274821 14192 consensus_queue.cc:1048] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:17.279268 13383 raft_consensus.cc:1275] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:17.280604 14181 consensus_queue.cc:1048] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:17.373548  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:17.411291 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:17.411898 13311 raft_consensus.cc:606] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:17.414026 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:17.414531 13311 raft_consensus.cc:606] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:17.416538 13383 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:17.416942 13383 raft_consensus.cc:606] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:17.418955 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b37e0af275194677a945f05707b8be1b"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:17.419330 13311 raft_consensus.cc:606] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:17.421363 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:17.421749 13311 raft_consensus.cc:606] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:17.423743 13311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8343dc9896d484a95b73406414546bf"
dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:39642
I20260709 12:29:17.424189 13311 raft_consensus.cc:606] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:17.425093  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:29:17.426203  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:17.426738  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:17.563971 14169 raft_consensus.cc:993] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.564484 14176 raft_consensus.cc:1081] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.566015 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b37e0af275194677a945f05707b8be1b"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:29:17.566545 13978 raft_consensus.cc:493] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.566879 13978 raft_consensus.cc:3060] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.572157 13978 raft_consensus.cc:515] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.574543 13978 leader_election.cc:290] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:17.575258 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:17.576123 13230 raft_consensus.cc:3060] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.576865 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b37e0af275194677a945f05707b8be1b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:17.577378 13308 raft_consensus.cc:3055] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:17.577598 13308 raft_consensus.cc:740] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:17.578236 13308 consensus_queue.cc:260] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.579099 13308 raft_consensus.cc:3060] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.582406 13230 raft_consensus.cc:2468] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.583437 13939 leader_election.cc:304] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:17.584187 13308 raft_consensus.cc:2468] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.584221 14210 raft_consensus.cc:2804] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:17.584941 14210 raft_consensus.cc:697] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:17.585913 14210 consensus_queue.cc:237] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.594996 13056 catalog_manager.cc:5697] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.597832 14176 raft_consensus.cc:993] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.598398 14169 raft_consensus.cc:1081] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.599670 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:29:17.600140 13978 raft_consensus.cc:493] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.600481 13978 raft_consensus.cc:3060] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.606542 13978 raft_consensus.cc:515] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:17.607991 13978 leader_election.cc:290] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:17.608700 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:17.608839 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda9b6a2c2c84f739db973e6a815c956" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:17.609320 13308 raft_consensus.cc:3055] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:17.609402 13383 raft_consensus.cc:3060] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.609679 13308 raft_consensus.cc:740] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:17.610481 13308 consensus_queue.cc:260] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:17.611681 13308 raft_consensus.cc:3060] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.614841 13383 raft_consensus.cc:2468] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.615986 13937 leader_election.cc:304] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:17.616705 14210 raft_consensus.cc:2804] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:17.617142 14210 raft_consensus.cc:697] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:17.617822 14210 consensus_queue.cc:237] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:17.618096 13308 raft_consensus.cc:2468] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.627255 13056 catalog_manager.cc:5697] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:17.667331 14197 raft_consensus.cc:993] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.667768 14176 raft_consensus.cc:1081] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.669113 13979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8343dc9896d484a95b73406414546bf"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:29:17.669528 13979 raft_consensus.cc:493] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.669750 13979 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.676498 13979 raft_consensus.cc:515] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.678694 13979 leader_election.cc:290] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:17.678853 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:17.679265 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8343dc9896d484a95b73406414546bf" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:17.679714 13230 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.679870 13308 raft_consensus.cc:3055] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:17.680271 13308 raft_consensus.cc:740] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:17.681149 13308 consensus_queue.cc:260] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.682057 13308 raft_consensus.cc:3060] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.685273 13230 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:17.686182 13939 leader_election.cc:304] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:17.686827 14210 raft_consensus.cc:2804] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:17.687295 14210 raft_consensus.cc:697] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:17.687335 13308 raft_consensus.cc:2468] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:17.688279 14210 consensus_queue.cc:237] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.697324 13056 catalog_manager.cc:5697] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 2 to 3, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.702420 14169 raft_consensus.cc:993] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.702941 14169 raft_consensus.cc:1081] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.704507 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:29:17.704996 13978 raft_consensus.cc:493] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.705708 13978 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.712772 13978 raft_consensus.cc:515] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.714184 13978 leader_election.cc:290] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:17.714888 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:17.715399 13230 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.715517 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a904f1936a742d3a76ba3c33921147b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:17.716084 13308 raft_consensus.cc:3055] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:17.716305 13308 raft_consensus.cc:740] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:17.716990 13308 consensus_queue.cc:260] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.717785 13308 raft_consensus.cc:3060] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:17.720994 13230 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:17.722034 13939 leader_election.cc:304] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:17.722810 14210 raft_consensus.cc:2804] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:17.723531 14210 raft_consensus.cc:697] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:17.723941 13308 raft_consensus.cc:2468] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:17.724253 14210 consensus_queue.cc:237] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.727191 14169 raft_consensus.cc:993] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.727679 14169 raft_consensus.cc:1081] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.729504 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50150
I20260709 12:29:17.730027 13978 raft_consensus.cc:493] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.730690 13978 raft_consensus.cc:3060] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.737180 13978 raft_consensus.cc:515] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.739385 13978 leader_election.cc:290] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623), c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667)
I20260709 12:29:17.739735 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:17.740309 13230 raft_consensus.cc:3060] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.741570 13056 catalog_manager.cc:5697] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 2 to 3, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.739652 13308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a5c4ef154104170b8d7cc738da7ef6b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:17.743708 13308 raft_consensus.cc:3055] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:17.743988 13308 raft_consensus.cc:740] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c15e995b6bee46f6a5dec636c28cb1b1, State: Running, Role: LEADER
I20260709 12:29:17.744726 13308 consensus_queue.cc:260] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.745899 13308 raft_consensus.cc:3060] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.746085 13230 raft_consensus.cc:2468] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.748703 13939 leader_election.cc:304] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:17.750051 14193 raft_consensus.cc:2804] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:17.750519 14193 raft_consensus.cc:697] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:17.751397 14193 consensus_queue.cc:237] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } }
I20260709 12:29:17.756342 13308 raft_consensus.cc:2468] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.760219 14173 raft_consensus.cc:993] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.760639 14177 raft_consensus.cc:1081] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:17.762084 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:17.762545 13978 raft_consensus.cc:493] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:17.762881 13978 raft_consensus.cc:3060] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.767946 13056 catalog_manager.cc:5697] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:17.771147 13978 raft_consensus.cc:515] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:17.773340 13978 leader_election.cc:290] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:17.773941 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:17.773941 13311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c840c65e2e544c89a82d480e518a745" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:17.774533 13383 raft_consensus.cc:3055] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:17.774713 13311 raft_consensus.cc:3060] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.774935 13383 raft_consensus.cc:740] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:17.775709 13383 consensus_queue.cc:260] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:17.776834 13383 raft_consensus.cc:3060] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:17.780948 13311 raft_consensus.cc:2468] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.781936 13940 leader_election.cc:304] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:17.782785 14193 raft_consensus.cc:2804] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:17.783246 14193 raft_consensus.cc:697] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:17.783846 13383 raft_consensus.cc:2468] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:17.784354 14193 consensus_queue.cc:237] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:17.804327 13056 catalog_manager.cc:5697] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:18.120702 13310 raft_consensus.cc:1275] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.121951 14193 consensus_queue.cc:1048] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.134475 13238 raft_consensus.cc:1275] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.135697 14210 consensus_queue.cc:1048] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.144631 13311 raft_consensus.cc:1275] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:18.145862 14210 consensus_queue.cc:1048] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:18.153323 13230 raft_consensus.cc:1275] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:18.160181 13230 raft_consensus.cc:1275] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:18.160565 14193 consensus_queue.cc:1048] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:18.165009 14210 consensus_queue.cc:1048] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:18.181730 13383 raft_consensus.cc:1275] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.186553 14210 consensus_queue.cc:1048] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.192157 13310 raft_consensus.cc:1275] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.194340 14232 consensus_queue.cc:1048] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.201469 13310 raft_consensus.cc:1275] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:18.208619 14192 consensus_queue.cc:1048] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:18.214226 13308 raft_consensus.cc:1275] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.216140 14193 consensus_queue.cc:1048] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.222446 13312 raft_consensus.cc:1275] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.224998 14232 consensus_queue.cc:1048] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.236104 13383 raft_consensus.cc:1275] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.243777 14193 consensus_queue.cc:1048] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.291877 13234 raft_consensus.cc:1275] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:18.295580 14232 consensus_queue.cc:1048] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:18.466594  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:18.498946 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:18.499473 13385 raft_consensus.cc:606] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:18.501641 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16ba90b55562461497d50428e607bda4"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:18.502059 13385 raft_consensus.cc:606] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:18.504210 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:18.504733 13385 raft_consensus.cc:606] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:18.507119 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:18.507548 13385 raft_consensus.cc:606] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:18.509747 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a029386535a847ed873d186c825ac92a"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:18.510138 13385 raft_consensus.cc:606] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:18.511044  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:29:18.512715  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:18.513464  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:18.591912 14244 raft_consensus.cc:993] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.592334 14173 raft_consensus.cc:1081] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.593520 13979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:18.593901 13979 raft_consensus.cc:493] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.594116 13979 raft_consensus.cc:3060] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.598572 13979 raft_consensus.cc:515] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.600020 13979 leader_election.cc:290] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:18.600601 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:18.600965 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0445e72cb4464ff69b4fe5e1e67f061b" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:18.601225 13310 raft_consensus.cc:3060] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.601562 13385 raft_consensus.cc:3055] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.601841 13385 raft_consensus.cc:740] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:18.602511 13385 consensus_queue.cc:260] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.603641 13385 raft_consensus.cc:3060] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.610299 13310 raft_consensus.cc:2468] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.612399 13940 leader_election.cc:304] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:18.613257 14193 raft_consensus.cc:2804] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:18.613725 14193 raft_consensus.cc:697] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:18.614667 14193 consensus_queue.cc:237] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.623353 13385 raft_consensus.cc:2468] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.635933 13060 catalog_manager.cc:5697] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:18.701433 14244 raft_consensus.cc:993] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.701990 14177 raft_consensus.cc:1081] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.702265 14244 raft_consensus.cc:993] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.702721 14173 raft_consensus.cc:1081] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.703317 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a029386535a847ed873d186c825ac92a"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:18.703881 13978 raft_consensus.cc:493] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.704170 13978 raft_consensus.cc:3060] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.704092 13979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:18.704768 13979 raft_consensus.cc:493] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.705031 13979 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.708918 13978 raft_consensus.cc:515] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.709376 13979 raft_consensus.cc:515] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.710390 13978 leader_election.cc:290] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:18.711067 13979 leader_election.cc:290] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:18.711331 13383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:18.711920 13383 raft_consensus.cc:3055] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.711230 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a029386535a847ed873d186c825ac92a" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:18.712230 13383 raft_consensus.cc:740] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:18.712589 13310 raft_consensus.cc:3060] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.712697 13312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:18.713127 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51330eddaa8145f9931042b9bfb80ff8" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:18.713479 13312 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.713086 13383 consensus_queue.cc:260] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.713822 13385 raft_consensus.cc:3055] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:18.714282 13385 raft_consensus.cc:740] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:18.714434 13383 raft_consensus.cc:3060] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.714993 13385 consensus_queue.cc:260] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.716269 13385 raft_consensus.cc:3060] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.719203 13310 raft_consensus.cc:2468] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.720474 13940 leader_election.cc:304] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:18.720986 13383 raft_consensus.cc:2468] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.722153 14210 raft_consensus.cc:2804] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:18.722651 14210 raft_consensus.cc:697] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:18.722889 13385 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:18.723495 14210 consensus_queue.cc:237] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.725754 13937 leader_election.cc:304] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, fc0a5489897d4f6c8dd410cb6daee91b; no voters: 
I20260709 12:29:18.726549 14232 raft_consensus.cc:2804] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:18.727008 14232 raft_consensus.cc:697] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:18.727247 13312 raft_consensus.cc:2468] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:18.727861 14232 consensus_queue.cc:237] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.738937 13060 catalog_manager.cc:5697] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:18.753196 13060 catalog_manager.cc:5697] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 2 to 3, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:18.875202 14244 raft_consensus.cc:993] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.875701 14173 raft_consensus.cc:1081] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.877347 13979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:18.877946 13979 raft_consensus.cc:493] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.878635 13979 raft_consensus.cc:3060] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.885370 13979 raft_consensus.cc:515] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.888093 13979 leader_election.cc:290] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:18.888453 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:18.889045 13310 raft_consensus.cc:3060] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.889744 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70fae3d67b794456ad210d7e7ccbda1d" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:18.890313 13385 raft_consensus.cc:3055] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.890596 13385 raft_consensus.cc:740] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:18.891350 13385 consensus_queue.cc:260] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.892623 13385 raft_consensus.cc:3060] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.895438 13310 raft_consensus.cc:2468] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.896421 13940 leader_election.cc:304] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:18.897289 14210 raft_consensus.cc:2804] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:18.897966 14210 raft_consensus.cc:697] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:18.898856 14210 consensus_queue.cc:237] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:18.900064 13385 raft_consensus.cc:2468] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.905045 14177 raft_consensus.cc:993] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.905633 14244 raft_consensus.cc:1081] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:18.911260 13060 catalog_manager.cc:5697] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:18.912875 13979 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16ba90b55562461497d50428e607bda4"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:18.914424 13979 raft_consensus.cc:493] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.914776 13979 raft_consensus.cc:3060] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.922055 13979 raft_consensus.cc:515] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:18.923707 13979 leader_election.cc:290] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:18.924239 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:18.924703 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16ba90b55562461497d50428e607bda4" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:18.924885 13385 raft_consensus.cc:3055] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.925249 13385 raft_consensus.cc:740] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:18.925285 13230 raft_consensus.cc:3060] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.926069 13385 consensus_queue.cc:260] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:18.927284 13385 raft_consensus.cc:3060] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.932138 13230 raft_consensus.cc:2468] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.933323 13939 leader_election.cc:304] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:18.933535 13385 raft_consensus.cc:2468] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 2.
I20260709 12:29:18.934177 14210 raft_consensus.cc:2804] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:18.934660 14210 raft_consensus.cc:697] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:18.935441 14210 consensus_queue.cc:237] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:18.946033 13060 catalog_manager.cc:5697] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 1 to 2, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:19.147747 13385 raft_consensus.cc:1275] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:19.149140 14210 consensus_queue.cc:1048] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:19.169914 13310 raft_consensus.cc:1275] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.172526 14193 consensus_queue.cc:1048] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.181239 13312 raft_consensus.cc:1275] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:19.183032 14193 consensus_queue.cc:1048] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:19.186143 13383 raft_consensus.cc:1275] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.188683 14210 consensus_queue.cc:1048] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.281796 13385 raft_consensus.cc:1275] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.282795 14232 consensus_queue.cc:1048] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.293121 13310 raft_consensus.cc:1275] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.294279 14193 consensus_queue.cc:1048] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.304453 13310 raft_consensus.cc:1275] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.305550 14232 consensus_queue.cc:1048] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.317771 13385 raft_consensus.cc:1275] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.319278 13385 raft_consensus.cc:1275] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.320152 14232 consensus_queue.cc:1048] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.321820 14232 consensus_queue.cc:1048] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.333892 13234 raft_consensus.cc:1275] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.335204 14210 consensus_queue.cc:1048] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.563830  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:19.613262 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:19.613847 13385 raft_consensus.cc:606] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Received request to transfer leadership to TS 2b4ab106e71748ef9a1c55bece2316e5
I20260709 12:29:19.616606 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:19.617025 13385 raft_consensus.cc:606] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Received request to transfer leadership to TS 31406ec9b44549329b74301b355264c5
I20260709 12:29:19.619227 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:19.619738 13385 raft_consensus.cc:606] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Received request to transfer leadership to TS 31406ec9b44549329b74301b355264c5
I20260709 12:29:19.621920 13385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8"
dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
mode: GRACEFUL
new_leader_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:43758
I20260709 12:29:19.622306 13385 raft_consensus.cc:606] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Received request to transfer leadership to TS 31406ec9b44549329b74301b355264c5
I20260709 12:29:19.623181  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:29:19.624521  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:19.625170  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:19.690299 14177 raft_consensus.cc:993] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:19.690791 14244 raft_consensus.cc:1081] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Signalling peer 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:19.692273 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8"
dest_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:58280
I20260709 12:29:19.692811 13230 raft_consensus.cc:493] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:19.693154 13230 raft_consensus.cc:3060] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:19.699193 13230 raft_consensus.cc:515] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:19.700722 13230 leader_election.cc:290] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Requested vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499)
I20260709 12:29:19.701483 13310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c15e995b6bee46f6a5dec636c28cb1b1"
I20260709 12:29:19.701558 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8f2402480454364bf123ad3e9b49cb8" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:19.702154 13310 raft_consensus.cc:3060] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:19.702227 13385 raft_consensus.cc:3055] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:19.702610 13385 raft_consensus.cc:740] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:19.703464 13385 consensus_queue.cc:260] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:19.704633 13385 raft_consensus.cc:3060] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:19.708628 13310 raft_consensus.cc:2468] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:19.709658 13205 leader_election.cc:304] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31406ec9b44549329b74301b355264c5, c15e995b6bee46f6a5dec636c28cb1b1; no voters: 
I20260709 12:29:19.710423 14247 raft_consensus.cc:2804] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:19.710810 14247 raft_consensus.cc:697] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:19.710837 13385 raft_consensus.cc:2468] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 2.
I20260709 12:29:19.711602 14247 consensus_queue.cc:237] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } }
I20260709 12:29:19.719786 13056 catalog_manager.cc:5697] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 1 to 2, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.011662 14274 raft_consensus.cc:993] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:20.012092 14177 raft_consensus.cc:1081] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Signalling peer 2b4ab106e71748ef9a1c55bece2316e5 to start an election
I20260709 12:29:20.013433 13978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185"
dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
 from {username='slave'} at 127.0.0.1:50154
I20260709 12:29:20.013854 13978 raft_consensus.cc:493] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.014130 13978 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.020269 13978 raft_consensus.cc:515] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.021795 13978 leader_election.cc:290] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:20.022375 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:20.022740 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "087a84ebe1094974b567d0e394b5c185" candidate_uuid: "2b4ab106e71748ef9a1c55bece2316e5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31406ec9b44549329b74301b355264c5"
I20260709 12:29:20.023005 13385 raft_consensus.cc:3055] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:20.023316 13385 raft_consensus.cc:740] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:20.023324 13234 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.024112 13385 consensus_queue.cc:260] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.025346 13385 raft_consensus.cc:3060] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.029069 14274 raft_consensus.cc:993] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:20.029511 14177 raft_consensus.cc:1081] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Signalling peer 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:20.030052 13234 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:20.030771 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f"
dest_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:58280
I20260709 12:29:20.031343 13230 raft_consensus.cc:493] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.031248 13939 leader_election.cc:304] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:20.031632 13385 raft_consensus.cc:2468] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b4ab106e71748ef9a1c55bece2316e5 in term 3.
I20260709 12:29:20.031745 13230 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.036150 14210 raft_consensus.cc:2804] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:20.036621 14210 raft_consensus.cc:697] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Becoming Leader. State: Replica: 2b4ab106e71748ef9a1c55bece2316e5, State: Running, Role: LEADER
I20260709 12:29:20.037447 14210 consensus_queue.cc:237] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.039829 13230 raft_consensus.cc:515] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.041700 13230 leader_election.cc:290] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 3 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:20.043430 13978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:20.043382 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80ea8d04a10d4404b3a0dad7e62a595f" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:20.043934 13978 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.044149 13385 raft_consensus.cc:3055] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:20.044488 13385 raft_consensus.cc:740] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:20.045147 13385 consensus_queue.cc:260] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.046240 13385 raft_consensus.cc:3060] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.048635 13978 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 3.
I20260709 12:29:20.048465 13056 catalog_manager.cc:5697] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 reported cstate change: term changed from 2 to 3, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65). New cstate: current_term: 3 leader_uuid: "2b4ab106e71748ef9a1c55bece2316e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:20.049590 13205 leader_election.cc:304] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:20.050215 14247 raft_consensus.cc:2804] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:20.051157 14247 raft_consensus.cc:697] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 3 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:20.051967 14247 consensus_queue.cc:237] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.052492 13385 raft_consensus.cc:2468] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 3.
I20260709 12:29:20.063820 13056 catalog_manager.cc:5697] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 2 to 3, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 3 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.112510 13385 raft_consensus.cc:1275] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:20.113340 14274 raft_consensus.cc:993] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b: : Instructing follower 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:20.113555 14247 consensus_queue.cc:1048] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:20.113799 14177 raft_consensus.cc:1081] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Signalling peer 31406ec9b44549329b74301b355264c5 to start an election
I20260709 12:29:20.115134 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2"
dest_uuid: "31406ec9b44549329b74301b355264c5"
 from {username='slave'} at 127.0.0.1:58280
I20260709 12:29:20.115554 13234 raft_consensus.cc:493] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:20.115911 13234 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.131371 13312 raft_consensus.cc:1275] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:20.132779 14280 consensus_queue.cc:1048] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:20.147820 13234 raft_consensus.cc:515] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.156167 13234 leader_election.cc:290] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 3 election: Requested vote from peers fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68:36499), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:20.157238 13979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2b4ab106e71748ef9a1c55bece2316e5"
I20260709 12:29:20.157902 13979 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.161767 13385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e3ee9867f0f4c9983ee1092284810a2" candidate_uuid: "31406ec9b44549329b74301b355264c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fc0a5489897d4f6c8dd410cb6daee91b"
I20260709 12:29:20.162355 13385 raft_consensus.cc:3055] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:20.162638 13385 raft_consensus.cc:740] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc0a5489897d4f6c8dd410cb6daee91b, State: Running, Role: LEADER
I20260709 12:29:20.163312 13385 consensus_queue.cc:260] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.164397 13385 raft_consensus.cc:3060] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:20.165206 13979 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 3.
I20260709 12:29:20.165877 13978 raft_consensus.cc:1240] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Rejecting Update request from peer fc0a5489897d4f6c8dd410cb6daee91b for earlier term 2. Current term is 3. Ops: []
I20260709 12:29:20.167655 13205 leader_election.cc:304] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5; no voters: 
I20260709 12:29:20.168403 14280 raft_consensus.cc:2804] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:20.168854 14280 raft_consensus.cc:697] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 3 LEADER]: Becoming Leader. State: Replica: 31406ec9b44549329b74301b355264c5, State: Running, Role: LEADER
I20260709 12:29:20.169691 14280 consensus_queue.cc:237] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:20.170990 13385 raft_consensus.cc:2468] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31406ec9b44549329b74301b355264c5 in term 3.
I20260709 12:29:20.181604 13060 catalog_manager.cc:5697] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 reported cstate change: term changed from 2 to 3, leader changed from fc0a5489897d4f6c8dd410cb6daee91b (127.7.23.68) to 31406ec9b44549329b74301b355264c5 (127.7.23.66). New cstate: current_term: 3 leader_uuid: "31406ec9b44549329b74301b355264c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:20.470561 13979 raft_consensus.cc:1275] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.471670 14280 consensus_queue.cc:1048] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:20.484840 13383 raft_consensus.cc:1275] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.486907 14247 consensus_queue.cc:1048] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:20.505535 13383 raft_consensus.cc:1275] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.506897 14210 consensus_queue.cc:1048] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:20.516222 13234 raft_consensus.cc:1275] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Refusing update from remote peer 2b4ab106e71748ef9a1c55bece2316e5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.520264 14289 consensus_queue.cc:1048] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:20.610002 13979 raft_consensus.cc:1275] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.611292 14187 consensus_queue.cc:1048] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:20.617962 13385 raft_consensus.cc:1275] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Refusing update from remote peer 31406ec9b44549329b74301b355264c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:20.619388 14280 consensus_queue.cc:1048] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:20.662788  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:20.706524  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:20.707669  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:20.708103  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:20.744549  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:20.780289  7261 tablet_server.cc:179] TabletServer@127.7.23.65:35779 shutting down...
W20260709 12:29:20.794226 13205 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 49 similar messages]
W20260709 12:29:20.800938 13205 consensus_peers.cc:597] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:20.809476 13353 consensus_peers.cc:597] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:20.810137 13353 consensus_peers.cc:597] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:20.811266 13279 consensus_peers.cc:597] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.825994  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:20.827044  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.827839  7261 raft_consensus.cc:2243] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.828574  7261 raft_consensus.cc:2272] T a029386535a847ed873d186c825ac92a P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.830973  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.831749  7261 raft_consensus.cc:2243] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.832585  7261 raft_consensus.cc:2272] T 7a5c4ef154104170b8d7cc738da7ef6b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.833033 13279 consensus_peers.cc:597] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.834697  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.835738  7261 raft_consensus.cc:2243] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.836246  7261 raft_consensus.cc:2272] T 146bc2757b61443cbd22d2ee03b646f1 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.838232 13205 consensus_peers.cc:597] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.839169  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.840047  7261 raft_consensus.cc:2243] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.840528  7261 raft_consensus.cc:2272] T 68eb6588fa0842bd812b9f8976b51d79 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.840768 13279 consensus_peers.cc:597] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.842734  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.843361  7261 raft_consensus.cc:2243] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.843760  7261 raft_consensus.cc:2272] T 3f3f1c6c0d994184845443c82d412358 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.845646  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.846167  7261 raft_consensus.cc:2243] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.846518  7261 raft_consensus.cc:2272] T 215896cbd30347de953b41e58793fe69 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.848378  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.849063  7261 raft_consensus.cc:2243] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.849505  7261 raft_consensus.cc:2272] T 342a1932e1f84a15837148bd0ca8d0c8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.851643  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.852191  7261 raft_consensus.cc:2243] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.852563  7261 raft_consensus.cc:2272] T 8cf31b69250947228a7680fc301334a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.854353  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.854879  7261 raft_consensus.cc:2243] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.855563  7261 raft_consensus.cc:2272] T f8343dc9896d484a95b73406414546bf P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.857262  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.857744  7261 raft_consensus.cc:2243] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.858100  7261 raft_consensus.cc:2272] T 3ada84c8013e4ff38f38e094b8c7f161 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.859902  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.860419  7261 raft_consensus.cc:2243] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.861075  7261 raft_consensus.cc:2272] T 16ba90b55562461497d50428e607bda4 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.862927  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.863504  7261 raft_consensus.cc:2243] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.863874  7261 raft_consensus.cc:2272] T 2bc3d02f64b7429aa081f6d4ac732e20 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.865803  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.866299  7261 raft_consensus.cc:2243] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.866676  7261 raft_consensus.cc:2272] T 80ea8d04a10d4404b3a0dad7e62a595f P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.868834  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.869764  7261 raft_consensus.cc:2243] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.870225  7261 raft_consensus.cc:2272] T 42bae5aac3664bdaae25c1b0bd68ed08 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.872464  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.872946  7261 raft_consensus.cc:2243] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.873690  7261 raft_consensus.cc:2272] T 0445e72cb4464ff69b4fe5e1e67f061b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.875476  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.876000  7261 raft_consensus.cc:2243] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.876327  7261 raft_consensus.cc:2272] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.878096  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.878587  7261 raft_consensus.cc:2243] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.879355  7261 raft_consensus.cc:2272] T 70fae3d67b794456ad210d7e7ccbda1d P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.881714  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.882493  7261 raft_consensus.cc:2243] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.882916  7261 raft_consensus.cc:2272] T b8cd3149d5184714857f3c05a1fcaa4c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.884743  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.885366  7261 raft_consensus.cc:2243] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.886056  7261 raft_consensus.cc:2272] T 51330eddaa8145f9931042b9bfb80ff8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.887894  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.888410  7261 raft_consensus.cc:2243] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.888751  7261 raft_consensus.cc:2272] T d1f4842692fd4f269ece83c3726dc22f P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.890498  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.890998  7261 raft_consensus.cc:2243] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.891394  7261 raft_consensus.cc:2272] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.893625  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.894191  7261 raft_consensus.cc:2243] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.894865  7261 raft_consensus.cc:2272] T 78cf5898f4814d6e9bc0a55599d09ea8 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.896611  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.897130  7261 raft_consensus.cc:2243] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.897508  7261 raft_consensus.cc:2272] T 3947397e0615475ca34744de551446cc P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.900067  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.900763  7261 raft_consensus.cc:2243] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.901257  7261 raft_consensus.cc:2272] T 8ff0db3c14eb4efaa3564a8f703a3936 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.902005 13205 consensus_peers.cc:597] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.903326  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.903952  7261 raft_consensus.cc:2243] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.904346  7261 raft_consensus.cc:2272] T dc51d4b5af42468e901c06d37a30ea2b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.906548  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.907158  7261 raft_consensus.cc:2243] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:29:20.907727 13279 consensus_peers.cc:597] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.908023  7261 raft_consensus.cc:2272] T b37e0af275194677a945f05707b8be1b P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.910211  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.910802  7261 raft_consensus.cc:2243] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.911350  7261 raft_consensus.cc:2272] T ce26cf9001dc430da555ebca2768adca P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.911911 13279 consensus_peers.cc:597] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.913362  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.913938  7261 raft_consensus.cc:2243] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.914294  7261 raft_consensus.cc:2272] T c9e399f6ac1043a89507e6aaab9a2d78 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.916146  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.916651  7261 raft_consensus.cc:2243] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.917023  7261 raft_consensus.cc:2272] T b29983fe14304e40925e693584d53f29 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.919714  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.920423  7261 raft_consensus.cc:2243] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:29:20.920940 13353 consensus_peers.cc:597] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.921415  7261 raft_consensus.cc:2272] T 087a84ebe1094974b567d0e394b5c185 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.921597 13279 consensus_peers.cc:597] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.925458  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.926183  7261 raft_consensus.cc:2243] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.926889  7261 raft_consensus.cc:2272] T dda9b6a2c2c84f739db973e6a815c956 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.928745  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.929241  7261 raft_consensus.cc:2243] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.929903  7261 raft_consensus.cc:2272] T 5f012632e884464d8749351b0ca69fef P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.931744  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.932448  7261 raft_consensus.cc:2243] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.932859  7261 raft_consensus.cc:2272] T 2eab5a50da6542d6afd870d484d29a8e P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.935091  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.935616  7261 raft_consensus.cc:2243] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.935941  7261 raft_consensus.cc:2272] T de739c8902184de3b342f8d748c12a0e P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.937716  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.938167  7261 raft_consensus.cc:2243] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.938498  7261 raft_consensus.cc:2272] T 432cdf291ee349b1a36ebef0910617fa P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.940254  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.940768  7261 raft_consensus.cc:2243] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.941193  7261 raft_consensus.cc:2272] T ceab57fea69f4fb2b92768c69ccf1acd P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.943868  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.944587  7261 raft_consensus.cc:2243] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.945386  7261 raft_consensus.cc:2272] T 9c840c65e2e544c89a82d480e518a745 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.947852  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.948558  7261 raft_consensus.cc:2243] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.949028  7261 raft_consensus.cc:2272] T 687b69d2c0ed4789a4464687de621d9f P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.951272  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.951923  7261 raft_consensus.cc:2243] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.952430  7261 raft_consensus.cc:2272] T e62a312762f44d1fa9089e42d4241ffe P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.955029  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.955711  7261 raft_consensus.cc:2243] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.956161  7261 raft_consensus.cc:2272] T 2415dad8fe444e70843baac50519f73c P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.958175  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.958895  7261 raft_consensus.cc:2243] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:20.959348  7261 raft_consensus.cc:2272] T 75960847d868465384c0cdc655302584 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.961651  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.962287  7261 raft_consensus.cc:2243] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:20.962627 13279 consensus_peers.cc:597] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.962821  7261 raft_consensus.cc:2272] T 6e3ee9867f0f4c9983ee1092284810a2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.963254 13279 consensus_peers.cc:597] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.965471  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.966003  7261 raft_consensus.cc:2243] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:20.966123 13205 consensus_peers.cc:597] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.966459  7261 raft_consensus.cc:2272] T f143366d33a942e6a4da9183209575b2 P 2b4ab106e71748ef9a1c55bece2316e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.968401 13279 consensus_peers.cc:597] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:20.968804  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.969305  7261 raft_consensus.cc:2243] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.969973  7261 raft_consensus.cc:2272] T b2f91ee1828b41d4b41addb4bc0c39a6 P 2b4ab106e71748ef9a1c55bece2316e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:20.972424  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:20.972981  7261 raft_consensus.cc:2243] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:20.973760  7261 raft_consensus.cc:2272] T 2a904f1936a742d3a76ba3c33921147b P 2b4ab106e71748ef9a1c55bece2316e5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:20.975800 13205 consensus_peers.cc:597] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:20.976544 13279 consensus_peers.cc:597] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.026346 13205 consensus_peers.cc:597] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.028692 13938 connection.cc:466] server connection from 127.0.0.1:50150 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50150 (request call id 593) could send its response
W20260709 12:29:21.033283 13279 consensus_peers.cc:597] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.047340  7261 tablet_server.cc:196] TabletServer@127.7.23.65:35779 shutdown complete.
W20260709 12:29:21.081284 13353 consensus_peers.cc:597] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.098245 13353 consensus_peers.cc:597] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.104770 13279 consensus_peers.cc:597] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.124900  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
W20260709 12:29:21.134117 13353 consensus_peers.cc:597] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.142310 13205 consensus_peers.cc:597] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.146019 13279 consensus_peers.cc:597] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.151757 13352 consensus_peers.cc:597] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.160835 13205 consensus_peers.cc:597] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.167201  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:21.167968  7261 tablet_replica.cc:333] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.168633  7261 raft_consensus.cc:2243] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.169095  7261 raft_consensus.cc:2272] T 2eab5a50da6542d6afd870d484d29a8e P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.171574  7261 tablet_replica.cc:333] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.172297  7261 raft_consensus.cc:2243] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.172747  7261 raft_consensus.cc:2272] T db87327473744d9cb4d2c2836ad19c47 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.174681  7261 tablet_replica.cc:333] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.175544  7261 raft_consensus.cc:2243] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.176021  7261 raft_consensus.cc:2272] T 087a84ebe1094974b567d0e394b5c185 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.178445 13352 consensus_peers.cc:597] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.178973  7261 tablet_replica.cc:333] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.179802  7261 raft_consensus.cc:2243] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.180260  7261 raft_consensus.cc:2272] T b29983fe14304e40925e693584d53f29 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.182058 13352 consensus_peers.cc:597] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.182608  7261 tablet_replica.cc:333] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.183386  7261 raft_consensus.cc:2243] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.183930  7261 raft_consensus.cc:2272] T 2bc3d02f64b7429aa081f6d4ac732e20 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.184890 13278 consensus_peers.cc:597] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.186630  7261 tablet_replica.cc:333] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.187503  7261 raft_consensus.cc:2243] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.188033  7261 raft_consensus.cc:2272] T 75960847d868465384c0cdc655302584 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.190559  7261 tablet_replica.cc:333] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.191226  7261 raft_consensus.cc:2243] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.191712  7261 raft_consensus.cc:2272] T 78cf5898f4814d6e9bc0a55599d09ea8 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.193930  7261 tablet_replica.cc:333] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.194656  7261 raft_consensus.cc:2243] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.195152  7261 raft_consensus.cc:2272] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.197849  7261 tablet_replica.cc:333] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.198658  7261 raft_consensus.cc:2243] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.199234  7261 raft_consensus.cc:2272] T 146bc2757b61443cbd22d2ee03b646f1 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.201815  7261 tablet_replica.cc:333] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.202545  7261 raft_consensus.cc:2243] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.203459  7261 raft_consensus.cc:2272] T b8f2402480454364bf123ad3e9b49cb8 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.204604 13278 consensus_peers.cc:597] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.205885  7261 tablet_replica.cc:333] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.206629  7261 raft_consensus.cc:2243] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.207310  7261 raft_consensus.cc:2272] T 80ea8d04a10d4404b3a0dad7e62a595f P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.209686  7261 tablet_replica.cc:333] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.210367  7261 raft_consensus.cc:2243] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.210837  7261 raft_consensus.cc:2272] T 8cf31b69250947228a7680fc301334a0 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.210909 13278 consensus_peers.cc:597] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.213107  7261 tablet_replica.cc:333] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.213771  7261 raft_consensus.cc:2243] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.214167  7261 raft_consensus.cc:2272] T f8343dc9896d484a95b73406414546bf P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.215545 13279 consensus_peers.cc:597] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.216310  7261 tablet_replica.cc:333] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.216928  7261 raft_consensus.cc:2243] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.217645  7261 raft_consensus.cc:2272] T 42bae5aac3664bdaae25c1b0bd68ed08 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.219566  7261 tablet_replica.cc:333] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.220068  7261 raft_consensus.cc:2243] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.220460  7261 raft_consensus.cc:2272] T 5f012632e884464d8749351b0ca69fef P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.222117  7261 tablet_replica.cc:333] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.222632  7261 raft_consensus.cc:2243] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.223335  7261 raft_consensus.cc:2272] T 342a1932e1f84a15837148bd0ca8d0c8 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.225167  7261 tablet_replica.cc:333] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.225660  7261 raft_consensus.cc:2243] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.226106  7261 raft_consensus.cc:2272] T fde9f8bf8cdf4ce08f666bdc04a7c318 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.228425  7261 tablet_replica.cc:333] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.229054  7261 raft_consensus.cc:2243] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:29:21.229498 13352 consensus_peers.cc:597] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.229897  7261 raft_consensus.cc:2272] T 1cdd0c8711ba42c1bd4506afd7156e9a P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.231807  7261 tablet_replica.cc:333] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.232316  7261 raft_consensus.cc:2243] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.232674  7261 raft_consensus.cc:2272] T a9b658edca804986a4f3a9879589f0d2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.234421  7261 tablet_replica.cc:333] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.234953  7261 raft_consensus.cc:2243] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.235313  7261 raft_consensus.cc:2272] T 62f989b065674a6b912d5fbd4f911f8f P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.236992  7261 tablet_replica.cc:333] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.237519  7261 raft_consensus.cc:2243] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.238183  7261 raft_consensus.cc:2272] T f5b079a944f8482f9dcfbc01251b99ad P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.239885  7261 tablet_replica.cc:333] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.240348  7261 raft_consensus.cc:2243] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.240713  7261 raft_consensus.cc:2272] T 2a904f1936a742d3a76ba3c33921147b P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.242336  7261 tablet_replica.cc:333] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.242826  7261 raft_consensus.cc:2243] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.243547  7261 raft_consensus.cc:2272] T dc51d4b5af42468e901c06d37a30ea2b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.245317  7261 tablet_replica.cc:333] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.245903  7261 raft_consensus.cc:2243] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.246753  7261 raft_consensus.cc:2272] T 8ff0db3c14eb4efaa3564a8f703a3936 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.249169  7261 tablet_replica.cc:333] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
W20260709 12:29:21.249222 13353 consensus_peers.cc:597] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.249897  7261 raft_consensus.cc:2243] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.250584  7261 raft_consensus.cc:2272] T 530182bf3a3f45e99ccc864a7f931043 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.252445  7261 tablet_replica.cc:333] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.252938  7261 raft_consensus.cc:2243] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.253307  7261 raft_consensus.cc:2272] T c9e399f6ac1043a89507e6aaab9a2d78 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.254930  7261 tablet_replica.cc:333] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.255474  7261 raft_consensus.cc:2243] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.255846  7261 raft_consensus.cc:2272] T ce26cf9001dc430da555ebca2768adca P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.257642  7261 tablet_replica.cc:333] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.258137  7261 raft_consensus.cc:2243] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.258579  7261 raft_consensus.cc:2272] T 728ff7f7b916431596bad2058abcff08 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.260666  7261 tablet_replica.cc:333] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.261140  7261 raft_consensus.cc:2243] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.261775  7261 raft_consensus.cc:2272] T b76c1b0221c64d12960e29e5cb59e771 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.263368  7261 tablet_replica.cc:333] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.263882  7261 raft_consensus.cc:2243] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.264562  7261 raft_consensus.cc:2272] T ceab57fea69f4fb2b92768c69ccf1acd P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.266304  7261 tablet_replica.cc:333] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.266760  7261 raft_consensus.cc:2243] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.267453  7261 raft_consensus.cc:2272] T 40227371d9284c11a346c1bf59ce0837 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.269166  7261 tablet_replica.cc:333] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.269636  7261 raft_consensus.cc:2243] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.269986  7261 raft_consensus.cc:2272] T f143366d33a942e6a4da9183209575b2 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.271958  7261 tablet_replica.cc:333] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.272444  7261 raft_consensus.cc:2243] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.273196  7261 raft_consensus.cc:2272] T 6e3ee9867f0f4c9983ee1092284810a2 P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.275107  7261 tablet_replica.cc:333] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.275632  7261 raft_consensus.cc:2243] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.276018  7261 raft_consensus.cc:2272] T 68eb6588fa0842bd812b9f8976b51d79 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.277774  7261 tablet_replica.cc:333] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.278254  7261 raft_consensus.cc:2243] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.278611  7261 raft_consensus.cc:2272] T c9028d57790342829a18f33502b1c412 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.280288  7261 tablet_replica.cc:333] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.280761  7261 raft_consensus.cc:2243] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.281458  7261 raft_consensus.cc:2272] T e62a312762f44d1fa9089e42d4241ffe P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.283157  7261 tablet_replica.cc:333] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.283684  7261 raft_consensus.cc:2243] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.284039  7261 raft_consensus.cc:2272] T 687b69d2c0ed4789a4464687de621d9f P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.285686  7261 tablet_replica.cc:333] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.286156  7261 raft_consensus.cc:2243] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.286562  7261 raft_consensus.cc:2272] T 30647cb538f54daea2c91dc8a1708e5f P 31406ec9b44549329b74301b355264c5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.288290  7261 tablet_replica.cc:333] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.288756  7261 raft_consensus.cc:2243] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.289108  7261 raft_consensus.cc:2272] T 16ba90b55562461497d50428e607bda4 P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.290786  7261 tablet_replica.cc:333] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.291235  7261 raft_consensus.cc:2243] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.291639  7261 raft_consensus.cc:2272] T b8cd3149d5184714857f3c05a1fcaa4c P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.293339  7261 tablet_replica.cc:333] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.293799  7261 raft_consensus.cc:2243] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.294169  7261 raft_consensus.cc:2272] T efa7a585187844a68f08b1d640f1cf7c P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.295871  7261 tablet_replica.cc:333] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.296305  7261 raft_consensus.cc:2243] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.296803  7261 raft_consensus.cc:2272] T e7189f0f0b184d46b795d6b9f0fb88e3 P 31406ec9b44549329b74301b355264c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.298619  7261 tablet_replica.cc:333] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.299032  7261 raft_consensus.cc:2243] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.299448  7261 raft_consensus.cc:2272] T 7a5c4ef154104170b8d7cc738da7ef6b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.301781  7261 tablet_replica.cc:333] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5: stopping tablet replica
I20260709 12:29:21.302340  7261 raft_consensus.cc:2243] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.302805  7261 raft_consensus.cc:2272] T b37e0af275194677a945f05707b8be1b P 31406ec9b44549329b74301b355264c5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.305832 13352 consensus_peers.cc:597] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.340037 13352 consensus_peers.cc:597] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.345448 13278 consensus_peers.cc:597] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.345753 13353 consensus_peers.cc:597] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Couldn't send request to peer 2b4ab106e71748ef9a1c55bece2316e5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.345454 13352 consensus_peers.cc:597] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.358862 13278 consensus_peers.cc:597] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.372411 13278 consensus_peers.cc:597] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.390569  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
W20260709 12:29:21.398509 13278 consensus_peers.cc:597] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.410411 13352 consensus_peers.cc:597] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.453786 13352 consensus_peers.cc:597] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.457875  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
I20260709 12:29:21.497632  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:21.498411  7261 tablet_replica.cc:333] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.499229  7261 raft_consensus.cc:2243] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.500279  7261 raft_consensus.cc:2272] T db87327473744d9cb4d2c2836ad19c47 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.503255  7261 tablet_replica.cc:333] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.504061  7261 raft_consensus.cc:2243] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.504550  7261 raft_consensus.cc:2272] T b2f91ee1828b41d4b41addb4bc0c39a6 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.506983  7261 tablet_replica.cc:333] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.507717  7261 raft_consensus.cc:2243] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.508560  7261 raft_consensus.cc:2272] T b29983fe14304e40925e693584d53f29 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.511166  7261 tablet_replica.cc:333] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.512060  7261 raft_consensus.cc:2243] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.512627  7261 raft_consensus.cc:2272] T a029386535a847ed873d186c825ac92a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.512727 13278 consensus_peers.cc:597] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.513054 13352 consensus_peers.cc:597] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.513864 13353 consensus_peers.cc:597] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.514849  7261 tablet_replica.cc:333] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.515473  7261 raft_consensus.cc:2243] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.516184  7261 raft_consensus.cc:2272] T 75960847d868465384c0cdc655302584 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.518011  7261 tablet_replica.cc:333] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.518556  7261 raft_consensus.cc:2243] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.519311  7261 raft_consensus.cc:2272] T 146bc2757b61443cbd22d2ee03b646f1 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.521601  7261 tablet_replica.cc:333] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.522096  7261 raft_consensus.cc:2243] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.522426  7261 raft_consensus.cc:2272] T b8f2402480454364bf123ad3e9b49cb8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.524113  7261 tablet_replica.cc:333] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.524643  7261 raft_consensus.cc:2243] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.524969  7261 raft_consensus.cc:2272] T 51330eddaa8145f9931042b9bfb80ff8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.526693  7261 tablet_replica.cc:333] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.527189  7261 raft_consensus.cc:2243] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.527585  7261 raft_consensus.cc:2272] T 342a1932e1f84a15837148bd0ca8d0c8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.529410  7261 tablet_replica.cc:333] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.529891  7261 raft_consensus.cc:2243] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.530272  7261 raft_consensus.cc:2272] T 1cdd0c8711ba42c1bd4506afd7156e9a P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.532048  7261 tablet_replica.cc:333] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.532543  7261 raft_consensus.cc:2243] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.532894  7261 raft_consensus.cc:2272] T a9b658edca804986a4f3a9879589f0d2 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.534710  7261 tablet_replica.cc:333] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.535190  7261 raft_consensus.cc:2243] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.535948  7261 raft_consensus.cc:2272] T fde9f8bf8cdf4ce08f666bdc04a7c318 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.537808  7261 tablet_replica.cc:333] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.538317  7261 raft_consensus.cc:2243] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.538650  7261 raft_consensus.cc:2272] T dda9b6a2c2c84f739db973e6a815c956 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.540316  7261 tablet_replica.cc:333] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.540791  7261 raft_consensus.cc:2243] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.541154  7261 raft_consensus.cc:2272] T 30647cb538f54daea2c91dc8a1708e5f P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.542843  7261 tablet_replica.cc:333] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.543321  7261 raft_consensus.cc:2243] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.543708  7261 raft_consensus.cc:2272] T 2415dad8fe444e70843baac50519f73c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.545516  7261 tablet_replica.cc:333] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.545997  7261 raft_consensus.cc:2243] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.546388  7261 raft_consensus.cc:2272] T 62f989b065674a6b912d5fbd4f911f8f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.548411  7261 tablet_replica.cc:333] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.548950  7261 raft_consensus.cc:2243] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.549319  7261 raft_consensus.cc:2272] T f5b079a944f8482f9dcfbc01251b99ad P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.551039  7261 tablet_replica.cc:333] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.551553  7261 raft_consensus.cc:2243] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.551901  7261 raft_consensus.cc:2272] T 2a904f1936a742d3a76ba3c33921147b P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.553610  7261 tablet_replica.cc:333] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.554142  7261 raft_consensus.cc:2243] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.554512  7261 raft_consensus.cc:2272] T 9c840c65e2e544c89a82d480e518a745 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.556615  7261 tablet_replica.cc:333] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.557281  7261 raft_consensus.cc:2243] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.558156  7261 raft_consensus.cc:2272] T 687b69d2c0ed4789a4464687de621d9f P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.558851 13353 consensus_peers.cc:597] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.560508  7261 tablet_replica.cc:333] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.561271  7261 raft_consensus.cc:2243] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.561748  7261 raft_consensus.cc:2272] T c9028d57790342829a18f33502b1c412 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.563623  7261 tablet_replica.cc:333] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.564152  7261 raft_consensus.cc:2243] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.564527  7261 raft_consensus.cc:2272] T b37e0af275194677a945f05707b8be1b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.566191  7261 tablet_replica.cc:333] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.566743  7261 raft_consensus.cc:2243] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.567485  7261 raft_consensus.cc:2272] T b8cd3149d5184714857f3c05a1fcaa4c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.569110  7261 tablet_replica.cc:333] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.569593  7261 raft_consensus.cc:2243] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.569972  7261 raft_consensus.cc:2272] T efa7a585187844a68f08b1d640f1cf7c P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.571616  7261 tablet_replica.cc:333] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.572091  7261 raft_consensus.cc:2243] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.572464  7261 raft_consensus.cc:2272] T e7189f0f0b184d46b795d6b9f0fb88e3 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.574110  7261 tablet_replica.cc:333] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.574602  7261 raft_consensus.cc:2243] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.574975  7261 raft_consensus.cc:2272] T 7a5c4ef154104170b8d7cc738da7ef6b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.576766  7261 tablet_replica.cc:333] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.577324  7261 raft_consensus.cc:2243] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.577775  7261 raft_consensus.cc:2272] T 728ff7f7b916431596bad2058abcff08 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.579566  7261 tablet_replica.cc:333] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.580060  7261 raft_consensus.cc:2243] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.580760  7261 raft_consensus.cc:2272] T 3f3f1c6c0d994184845443c82d412358 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.582580  7261 tablet_replica.cc:333] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.583074  7261 raft_consensus.cc:2243] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.583532  7261 raft_consensus.cc:2272] T 70fae3d67b794456ad210d7e7ccbda1d P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.585098  7261 tablet_replica.cc:333] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.585543  7261 raft_consensus.cc:2243] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.585920  7261 raft_consensus.cc:2272] T b76c1b0221c64d12960e29e5cb59e771 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.587646  7261 tablet_replica.cc:333] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.588081  7261 raft_consensus.cc:2243] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.588428  7261 raft_consensus.cc:2272] T ceab57fea69f4fb2b92768c69ccf1acd P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.590184  7261 tablet_replica.cc:333] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.590679  7261 raft_consensus.cc:2243] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.591120  7261 raft_consensus.cc:2272] T 215896cbd30347de953b41e58793fe69 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.593118  7261 tablet_replica.cc:333] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.593768  7261 raft_consensus.cc:2243] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.594213  7261 raft_consensus.cc:2272] T 40227371d9284c11a346c1bf59ce0837 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.594225 13352 consensus_peers.cc:597] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.596496  7261 tablet_replica.cc:333] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.597199  7261 raft_consensus.cc:2243] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.597987  7261 raft_consensus.cc:2272] T 432cdf291ee349b1a36ebef0910617fa P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.600282  7261 tablet_replica.cc:333] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
W20260709 12:29:21.600332 13352 consensus_peers.cc:597] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.600966  7261 raft_consensus.cc:2243] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.601773  7261 raft_consensus.cc:2272] T de739c8902184de3b342f8d748c12a0e P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.603816  7261 tablet_replica.cc:333] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.604518  7261 raft_consensus.cc:2243] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.604979  7261 raft_consensus.cc:2272] T 78cf5898f4814d6e9bc0a55599d09ea8 P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.607242  7261 tablet_replica.cc:333] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.607949  7261 raft_consensus.cc:2243] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.608891  7261 raft_consensus.cc:2272] T d1f4842692fd4f269ece83c3726dc22f P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.609653 13352 consensus_peers.cc:597] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Couldn't send request to peer 31406ec9b44549329b74301b355264c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.611380  7261 tablet_replica.cc:333] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.612092  7261 raft_consensus.cc:2243] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.612991  7261 raft_consensus.cc:2272] T 3947397e0615475ca34744de551446cc P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.614974  7261 tablet_replica.cc:333] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.615532  7261 raft_consensus.cc:2243] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.615906  7261 raft_consensus.cc:2272] T 0445e72cb4464ff69b4fe5e1e67f061b P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.617555  7261 tablet_replica.cc:333] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.618009  7261 raft_consensus.cc:2243] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.618386  7261 raft_consensus.cc:2272] T 530182bf3a3f45e99ccc864a7f931043 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.620051  7261 tablet_replica.cc:333] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.620505  7261 raft_consensus.cc:2243] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.621178  7261 raft_consensus.cc:2272] T c9e399f6ac1043a89507e6aaab9a2d78 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.622831  7261 tablet_replica.cc:333] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.623270  7261 raft_consensus.cc:2243] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.624015  7261 raft_consensus.cc:2272] T 8cf31b69250947228a7680fc301334a0 P c15e995b6bee46f6a5dec636c28cb1b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.625814  7261 tablet_replica.cc:333] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.626245  7261 raft_consensus.cc:2243] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.626603  7261 raft_consensus.cc:2272] T f8343dc9896d484a95b73406414546bf P c15e995b6bee46f6a5dec636c28cb1b1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.628517  7261 tablet_replica.cc:333] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1: stopping tablet replica
I20260709 12:29:21.628925  7261 raft_consensus.cc:2243] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.629609  7261 raft_consensus.cc:2272] T 3ada84c8013e4ff38f38e094b8c7f161 P c15e995b6bee46f6a5dec636c28cb1b1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.654770 13353 consensus_peers.cc:597] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.709623 13353 consensus_peers.cc:597] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.738996  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
W20260709 12:29:21.794378 13353 consensus_peers.cc:597] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:21.837332 13353 consensus_peers.cc:597] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.844732 14306 raft_consensus.cc:493] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:21.845642 14306 raft_consensus.cc:515] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
I20260709 12:29:21.848901 14306 leader_election.cc:290] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
W20260709 12:29:21.856655 13353 leader_election.cc:336] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111)
W20260709 12:29:21.857661 13353 leader_election.cc:336] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111)
I20260709 12:29:21.858072 13353 leader_election.cc:304] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:21.858747 14306 raft_consensus.cc:2749] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:21.879312 13353 consensus_peers.cc:597] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.888170  7261 tablet_server.cc:179] TabletServer@127.7.23.68:0 shutting down...
I20260709 12:29:21.908252 14306 raft_consensus.cc:493] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:21.909008 14306 raft_consensus.cc:515] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
W20260709 12:29:21.910313 13353 consensus_peers.cc:597] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.911876 14306 leader_election.cc:290] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:21.917353 14306 raft_consensus.cc:493] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:21.918051 14306 raft_consensus.cc:515] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
W20260709 12:29:21.918898 13353 leader_election.cc:336] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111)
W20260709 12:29:21.919577 13353 leader_election.cc:336] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111)
I20260709 12:29:21.919971 13353 leader_election.cc:304] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:21.920208 14306 leader_election.cc:290] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:21.920841 14244 raft_consensus.cc:2749] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:29:21.928301 13353 leader_election.cc:336] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111)
W20260709 12:29:21.928987 13353 leader_election.cc:336] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111)
I20260709 12:29:21.929332 13353 leader_election.cc:304] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:21.930048 14244 raft_consensus.cc:2749] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:21.939965  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:21.941241  7261 tablet_replica.cc:333] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.944342  7261 raft_consensus.cc:2243] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.945222  7261 raft_consensus.cc:2272] T 087a84ebe1094974b567d0e394b5c185 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.945724 14306 raft_consensus.cc:493] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:21.946230 14306 raft_consensus.cc:515] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c15e995b6bee46f6a5dec636c28cb1b1" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44667 } } peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } }
W20260709 12:29:21.947973 13353 consensus_peers.cc:597] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b -> Peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Couldn't send request to peer c15e995b6bee46f6a5dec636c28cb1b1. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:21.948654  7261 tablet_replica.cc:333] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.948557 14306 leader_election.cc:290] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667), 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779)
I20260709 12:29:21.949772  7261 raft_consensus.cc:2243] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.950582  7261 raft_consensus.cc:2272] T db87327473744d9cb4d2c2836ad19c47 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:21.952610 13353 leader_election.cc:336] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c15e995b6bee46f6a5dec636c28cb1b1 (127.7.23.67:44667): Network error: Client connection negotiation failed: client connection to 127.7.23.67:44667: connect: Connection refused (error 111)
W20260709 12:29:21.953264 13353 leader_election.cc:336] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111)
I20260709 12:29:21.953591  7261 tablet_replica.cc:333] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.953560 13353 leader_election.cc:304] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, c15e995b6bee46f6a5dec636c28cb1b1
I20260709 12:29:21.954181 14306 raft_consensus.cc:2749] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:29:21.954655  7261 raft_consensus.cc:2243] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.955621  7261 raft_consensus.cc:2272] T 2eab5a50da6542d6afd870d484d29a8e P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.957813  7261 tablet_replica.cc:333] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.958580  7261 raft_consensus.cc:2243] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.959733  7261 raft_consensus.cc:2272] T 2bc3d02f64b7429aa081f6d4ac732e20 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.962045  7261 tablet_replica.cc:333] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.962637  7261 raft_consensus.cc:2243] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.963091  7261 raft_consensus.cc:2272] T a029386535a847ed873d186c825ac92a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.964087 14306 raft_consensus.cc:493] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 2b4ab106e71748ef9a1c55bece2316e5)
I20260709 12:29:21.964675 14306 raft_consensus.cc:515] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc0a5489897d4f6c8dd410cb6daee91b" member_type: VOTER last_known_addr { host: "127.7.23.68" port: 36499 } } peers { permanent_uuid: "2b4ab106e71748ef9a1c55bece2316e5" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35779 } } peers { permanent_uuid: "31406ec9b44549329b74301b355264c5" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 34623 } }
I20260709 12:29:21.966122  7261 tablet_replica.cc:333] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.967168  7261 raft_consensus.cc:2243] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.968294 14306 leader_election.cc:290] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779), 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623)
I20260709 12:29:21.968976  7261 raft_consensus.cc:2272] T e7189f0f0b184d46b795d6b9f0fb88e3 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.971926  7261 tablet_replica.cc:333] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.972594  7261 raft_consensus.cc:2243] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:29:21.972658 13353 leader_election.cc:336] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2b4ab106e71748ef9a1c55bece2316e5 (127.7.23.65:35779): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35779: connect: Connection refused (error 111)
W20260709 12:29:21.973278 13352 leader_election.cc:336] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 31406ec9b44549329b74301b355264c5 (127.7.23.66:34623): Network error: Client connection negotiation failed: client connection to 127.7.23.66:34623: connect: Connection refused (error 111)
I20260709 12:29:21.973272  7261 raft_consensus.cc:2272] T 80ea8d04a10d4404b3a0dad7e62a595f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.973628 13352 leader_election.cc:304] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc0a5489897d4f6c8dd410cb6daee91b; no voters: 2b4ab106e71748ef9a1c55bece2316e5, 31406ec9b44549329b74301b355264c5
I20260709 12:29:21.974228 14306 raft_consensus.cc:2749] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:29:21.976042  7261 tablet_replica.cc:333] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.976671  7261 raft_consensus.cc:2243] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.977169  7261 raft_consensus.cc:2272] T b8f2402480454364bf123ad3e9b49cb8 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.979275  7261 tablet_replica.cc:333] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.979879  7261 raft_consensus.cc:2243] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.980336  7261 raft_consensus.cc:2272] T 42bae5aac3664bdaae25c1b0bd68ed08 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.982175  7261 tablet_replica.cc:333] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.982640  7261 raft_consensus.cc:2243] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:21.983680  7261 raft_consensus.cc:2272] T efa7a585187844a68f08b1d640f1cf7c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.985538  7261 tablet_replica.cc:333] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.986071  7261 raft_consensus.cc:2243] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.986505  7261 raft_consensus.cc:2272] T 51330eddaa8145f9931042b9bfb80ff8 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.988471  7261 tablet_replica.cc:333] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.989157  7261 raft_consensus.cc:2243] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.989868  7261 raft_consensus.cc:2272] T 5f012632e884464d8749351b0ca69fef P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.992333  7261 tablet_replica.cc:333] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.992933  7261 raft_consensus.cc:2243] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.993415  7261 raft_consensus.cc:2272] T dda9b6a2c2c84f739db973e6a815c956 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.995960  7261 tablet_replica.cc:333] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:21.996515  7261 raft_consensus.cc:2243] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:21.997180  7261 raft_consensus.cc:2272] T 1cdd0c8711ba42c1bd4506afd7156e9a P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:21.999965  7261 tablet_replica.cc:333] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.000469  7261 raft_consensus.cc:2243] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.001263  7261 raft_consensus.cc:2272] T a9b658edca804986a4f3a9879589f0d2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.003099  7261 tablet_replica.cc:333] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.003649  7261 raft_consensus.cc:2243] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.004081  7261 raft_consensus.cc:2272] T 8ff0db3c14eb4efaa3564a8f703a3936 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.005935  7261 tablet_replica.cc:333] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.006443  7261 raft_consensus.cc:2243] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.006810  7261 raft_consensus.cc:2272] T dc51d4b5af42468e901c06d37a30ea2b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.008731  7261 tablet_replica.cc:333] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.009271  7261 raft_consensus.cc:2243] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.010102  7261 raft_consensus.cc:2272] T 68eb6588fa0842bd812b9f8976b51d79 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.012145  7261 tablet_replica.cc:333] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.012612  7261 raft_consensus.cc:2243] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.013455  7261 raft_consensus.cc:2272] T c9028d57790342829a18f33502b1c412 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.016088  7261 tablet_replica.cc:333] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.016800  7261 raft_consensus.cc:2243] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.017748  7261 raft_consensus.cc:2272] T 30647cb538f54daea2c91dc8a1708e5f P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.020072  7261 tablet_replica.cc:333] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.020586  7261 raft_consensus.cc:2243] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.021412  7261 raft_consensus.cc:2272] T 2415dad8fe444e70843baac50519f73c P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.023346  7261 tablet_replica.cc:333] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.023904  7261 raft_consensus.cc:2243] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.024367  7261 raft_consensus.cc:2272] T 9c840c65e2e544c89a82d480e518a745 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.026166  7261 tablet_replica.cc:333] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.026762  7261 raft_consensus.cc:2243] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.027186  7261 raft_consensus.cc:2272] T e62a312762f44d1fa9089e42d4241ffe P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.029151  7261 tablet_replica.cc:333] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.029682  7261 raft_consensus.cc:2243] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.030135  7261 raft_consensus.cc:2272] T 16ba90b55562461497d50428e607bda4 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.032228  7261 tablet_replica.cc:333] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.032922  7261 raft_consensus.cc:2243] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.033408  7261 raft_consensus.cc:2272] T 40227371d9284c11a346c1bf59ce0837 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.035395  7261 tablet_replica.cc:333] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.036080  7261 raft_consensus.cc:2243] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.037132  7261 raft_consensus.cc:2272] T 215896cbd30347de953b41e58793fe69 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.039295  7261 tablet_replica.cc:333] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.040076  7261 raft_consensus.cc:2243] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.040584  7261 raft_consensus.cc:2272] T 0445e72cb4464ff69b4fe5e1e67f061b P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.042543  7261 tablet_replica.cc:333] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.043051  7261 raft_consensus.cc:2243] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.043872  7261 raft_consensus.cc:2272] T 62f989b065674a6b912d5fbd4f911f8f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.046098  7261 tablet_replica.cc:333] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.046579  7261 raft_consensus.cc:2243] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.047010  7261 raft_consensus.cc:2272] T f5b079a944f8482f9dcfbc01251b99ad P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.048861  7261 tablet_replica.cc:333] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.049314  7261 raft_consensus.cc:2243] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.049665  7261 raft_consensus.cc:2272] T d1f4842692fd4f269ece83c3726dc22f P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.051649  7261 tablet_replica.cc:333] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.052104  7261 raft_consensus.cc:2243] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.052922  7261 raft_consensus.cc:2272] T 1bd0a7112fea4d999c0ddebe3a4a74a0 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.054723  7261 tablet_replica.cc:333] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.055179  7261 raft_consensus.cc:2243] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.055615  7261 raft_consensus.cc:2272] T 3947397e0615475ca34744de551446cc P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.057440  7261 tablet_replica.cc:333] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.057986  7261 raft_consensus.cc:2243] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.058377  7261 raft_consensus.cc:2272] T 70fae3d67b794456ad210d7e7ccbda1d P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.060138  7261 tablet_replica.cc:333] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.060581  7261 raft_consensus.cc:2243] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.060963  7261 raft_consensus.cc:2272] T b76c1b0221c64d12960e29e5cb59e771 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.062659  7261 tablet_replica.cc:333] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.063098  7261 raft_consensus.cc:2243] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.063550  7261 raft_consensus.cc:2272] T b2f91ee1828b41d4b41addb4bc0c39a6 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.065506  7261 tablet_replica.cc:333] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.065979  7261 raft_consensus.cc:2243] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.066777  7261 raft_consensus.cc:2272] T f143366d33a942e6a4da9183209575b2 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.068552  7261 tablet_replica.cc:333] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.069012  7261 raft_consensus.cc:2243] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.069425  7261 raft_consensus.cc:2272] T 6e3ee9867f0f4c9983ee1092284810a2 P fc0a5489897d4f6c8dd410cb6daee91b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.071262  7261 tablet_replica.cc:333] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.071729  7261 raft_consensus.cc:2243] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.072517  7261 raft_consensus.cc:2272] T 728ff7f7b916431596bad2058abcff08 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.074471  7261 tablet_replica.cc:333] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.074946  7261 raft_consensus.cc:2243] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.075344  7261 raft_consensus.cc:2272] T 3f3f1c6c0d994184845443c82d412358 P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.077395  7261 tablet_replica.cc:333] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.077858  7261 raft_consensus.cc:2243] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.078297  7261 raft_consensus.cc:2272] T 3ada84c8013e4ff38f38e094b8c7f161 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.080143  7261 tablet_replica.cc:333] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.080585  7261 raft_consensus.cc:2243] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.080991  7261 raft_consensus.cc:2272] T 530182bf3a3f45e99ccc864a7f931043 P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.082860  7261 tablet_replica.cc:333] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.083278  7261 raft_consensus.cc:2243] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.084062  7261 raft_consensus.cc:2272] T ce26cf9001dc430da555ebca2768adca P fc0a5489897d4f6c8dd410cb6daee91b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.085889  7261 tablet_replica.cc:333] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.086342  7261 raft_consensus.cc:2243] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.086776  7261 raft_consensus.cc:2272] T 432cdf291ee349b1a36ebef0910617fa P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.088768  7261 tablet_replica.cc:333] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b: stopping tablet replica
I20260709 12:29:22.089214  7261 raft_consensus.cc:2243] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:22.089608  7261 raft_consensus.cc:2272] T de739c8902184de3b342f8d748c12a0e P fc0a5489897d4f6c8dd410cb6daee91b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.156431  7261 tablet_server.cc:196] TabletServer@127.7.23.68:0 shutdown complete.
I20260709 12:29:22.222858  7261 master.cc:562] Master@127.7.23.126:43005 shutting down...
I20260709 12:29:22.245299  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:22.246019  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:22.246465  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8ac92aaf5a6841b5a599c2d387cd7acd: stopping tablet replica
I20260709 12:29:22.269045  7261 master.cc:584] Master@127.7.23.126:43005 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (28097 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:29:22.347860  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:35493
I20260709 12:29:22.348950  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:22.354194 14310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.354378 14311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.355858 14313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:22.357191  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:22.359867  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:22.360044  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:22.360154  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600162360143 us; error 0 us; skew 500 ppm
I20260709 12:29:22.360603  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:22.362856  7261 webserver.cc:533] Webserver started at http://127.7.23.126:43379/ using document root <none> and password file <none>
I20260709 12:29:22.363284  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:22.363471  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:22.363758  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:22.364916  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "e9f51e07b2c84ce09f498ac27259559d"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.369095  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:29:22.372205 14318 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.372874  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:22.373114  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "e9f51e07b2c84ce09f498ac27259559d"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.373344  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:22.391610  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:22.392813  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:22.429540  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:35493
I20260709 12:29:22.429643 14369 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:35493 every 8 connection(s)
I20260709 12:29:22.433298 14370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.443820 14370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d: Bootstrap starting.
I20260709 12:29:22.448530 14370 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:22.452510 14370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d: No bootstrap required, opened a new log
I20260709 12:29:22.454675 14370 raft_consensus.cc:359] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9f51e07b2c84ce09f498ac27259559d" member_type: VOTER }
I20260709 12:29:22.455125 14370 raft_consensus.cc:385] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:22.455312 14370 raft_consensus.cc:740] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9f51e07b2c84ce09f498ac27259559d, State: Initialized, Role: FOLLOWER
I20260709 12:29:22.455816 14370 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9f51e07b2c84ce09f498ac27259559d" member_type: VOTER }
I20260709 12:29:22.456225 14370 raft_consensus.cc:399] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:22.456405 14370 raft_consensus.cc:493] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:22.456606 14370 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:22.461033 14370 raft_consensus.cc:515] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9f51e07b2c84ce09f498ac27259559d" member_type: VOTER }
I20260709 12:29:22.461469 14370 leader_election.cc:304] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9f51e07b2c84ce09f498ac27259559d; no voters: 
I20260709 12:29:22.462499 14370 leader_election.cc:290] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:22.462790 14373 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:22.464051 14373 raft_consensus.cc:697] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 1 LEADER]: Becoming Leader. State: Replica: e9f51e07b2c84ce09f498ac27259559d, State: Running, Role: LEADER
I20260709 12:29:22.464722 14373 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9f51e07b2c84ce09f498ac27259559d" member_type: VOTER }
I20260709 12:29:22.465283 14370 sys_catalog.cc:565] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:22.470729 14375 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9f51e07b2c84ce09f498ac27259559d. Latest consensus state: current_term: 1 leader_uuid: "e9f51e07b2c84ce09f498ac27259559d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9f51e07b2c84ce09f498ac27259559d" member_type: VOTER } }
I20260709 12:29:22.471342 14375 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:22.471539 14374 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9f51e07b2c84ce09f498ac27259559d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9f51e07b2c84ce09f498ac27259559d" member_type: VOTER } }
I20260709 12:29:22.472237 14374 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:22.472980 14380 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:22.477813 14380 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:22.481832  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:22.486465 14380 catalog_manager.cc:1383] Generated new cluster ID: 6280a7dc725f48f2b1e7c3b03d70eba8
I20260709 12:29:22.486742 14380 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:22.505527 14380 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:22.506793 14380 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:22.524252 14380 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d: Generated new TSK 0
I20260709 12:29:22.524866 14380 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:22.548185  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:22.554070 14391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.555634 14392 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.559172 14394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:22.559295  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:22.560259  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:22.560461  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:22.560606  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600162560590 us; error 0 us; skew 500 ppm
I20260709 12:29:22.561112  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:22.563207  7261 webserver.cc:533] Webserver started at http://127.7.23.65:40785/ using document root <none> and password file <none>
I20260709 12:29:22.563687  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:22.563869  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:22.564107  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:22.565127  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "c235df55461943efb57e4e02fb605fca"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.569547  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:22.572664 14399 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.573334  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:22.573604  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "c235df55461943efb57e4e02fb605fca"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.573879  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:22.586791  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:22.588023  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:22.589447  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:22.591653  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:22.591842  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.592061  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:22.592219  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.630028  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:35391
I20260709 12:29:22.630108 14462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:35391 every 8 connection(s)
I20260709 12:29:22.634855  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:22.641132 14467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.642062 14468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.644595 14470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:22.645426  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:22.646692  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:22.646924  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:22.647084  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600162647066 us; error 0 us; skew 500 ppm
I20260709 12:29:22.647676  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:22.650674  7261 webserver.cc:533] Webserver started at http://127.7.23.66:38295/ using document root <none> and password file <none>
I20260709 12:29:22.651242  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:22.651451  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:22.651460 14463 heartbeater.cc:344] Connected to a master server at 127.7.23.126:35493
I20260709 12:29:22.651858  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:22.651960 14463 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:22.652869 14463 heartbeater.cc:507] Master 127.7.23.126:35493 requested a full tablet report, sending...
I20260709 12:29:22.653494  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.655215 14335 ts_manager.cc:194] Registered new tserver with Master: c235df55461943efb57e4e02fb605fca (127.7.23.65:35391)
I20260709 12:29:22.657706 14335 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34952
I20260709 12:29:22.659161  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:29:22.662493 14475 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.663157  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:22.663453  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.663712  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:22.681507  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:22.682664  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:22.684098  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:22.686172  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:22.686359  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.686576  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:22.686724  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.724030  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:32925
I20260709 12:29:22.724129 14537 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:32925 every 8 connection(s)
I20260709 12:29:22.728677  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:22.735495 14541 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.737362 14542 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:22.740274 14544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:22.740309  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:22.740913 14538 heartbeater.cc:344] Connected to a master server at 127.7.23.126:35493
I20260709 12:29:22.741442 14538 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:22.741753  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:22.742051  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:22.742255  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600162742238 us; error 0 us; skew 500 ppm
I20260709 12:29:22.742337 14538 heartbeater.cc:507] Master 127.7.23.126:35493 requested a full tablet report, sending...
I20260709 12:29:22.743062  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:22.744691 14335 ts_manager.cc:194] Registered new tserver with Master: 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:22.745689  7261 webserver.cc:533] Webserver started at http://127.7.23.67:42345/ using document root <none> and password file <none>
I20260709 12:29:22.746198  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:22.746170 14335 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34958
I20260709 12:29:22.746589  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:22.746869  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:22.748118  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.752370  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:29:22.755388 14549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.756122  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:29:22.756381  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:22.756642  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:22.776445  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:22.777582  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:22.778959  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:22.781127  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:22.781315  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.781533  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:22.781680  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:22.819272  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:40311
I20260709 12:29:22.819378 14611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:40311 every 8 connection(s)
I20260709 12:29:22.832075 14612 heartbeater.cc:344] Connected to a master server at 127.7.23.126:35493
I20260709 12:29:22.832523 14612 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:22.833238 14612 heartbeater.cc:507] Master 127.7.23.126:35493 requested a full tablet report, sending...
I20260709 12:29:22.835079 14335 ts_manager.cc:194] Registered new tserver with Master: a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:22.835759  7261 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013455411s
I20260709 12:29:22.836741 14335 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34966
I20260709 12:29:22.859776 14335 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34974:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:22.862550 14335 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:22.930536 14577 tablet_service.cc:1511] Processing CreateTablet for tablet 2902b62029a14bcb9d067182d34c2ae5 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:22.932144 14577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2902b62029a14bcb9d067182d34c2ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.944478 14576 tablet_service.cc:1511] Processing CreateTablet for tablet 9b114cb083054d1fb2e2a8d36dfc6339 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:22.945979 14576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b114cb083054d1fb2e2a8d36dfc6339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.951946 14575 tablet_service.cc:1511] Processing CreateTablet for tablet f7b45bedaf1045298fe817dd247aa6d2 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:22.953361 14575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b45bedaf1045298fe817dd247aa6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.955910 14428 tablet_service.cc:1511] Processing CreateTablet for tablet 2902b62029a14bcb9d067182d34c2ae5 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:22.957226 14428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2902b62029a14bcb9d067182d34c2ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.958498 14574 tablet_service.cc:1511] Processing CreateTablet for tablet 326c0f91b9de4c019cafbdc28206d5cb (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:22.959208 14427 tablet_service.cc:1511] Processing CreateTablet for tablet 9b114cb083054d1fb2e2a8d36dfc6339 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:22.959925 14574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326c0f91b9de4c019cafbdc28206d5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.960551 14427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b114cb083054d1fb2e2a8d36dfc6339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.961076 14422 tablet_service.cc:1511] Processing CreateTablet for tablet c9a5927af8e74a01bd7f247943cb568d (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:22.962342 14422 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a5927af8e74a01bd7f247943cb568d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.962021 14573 tablet_service.cc:1511] Processing CreateTablet for tablet 2e447ab06e064c39b7a7be9731db230b (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:22.963342 14573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e447ab06e064c39b7a7be9731db230b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.964546 14426 tablet_service.cc:1511] Processing CreateTablet for tablet f7b45bedaf1045298fe817dd247aa6d2 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:22.965833 14426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b45bedaf1045298fe817dd247aa6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.966734 14572 tablet_service.cc:1511] Processing CreateTablet for tablet 54911476bff5419280f7d784e8ee08b7 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:22.968132 14572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54911476bff5419280f7d784e8ee08b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.968547 14425 tablet_service.cc:1511] Processing CreateTablet for tablet 326c0f91b9de4c019cafbdc28206d5cb (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:22.969812 14425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326c0f91b9de4c019cafbdc28206d5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.972242 14424 tablet_service.cc:1511] Processing CreateTablet for tablet 2e447ab06e064c39b7a7be9731db230b (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:22.973511 14424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e447ab06e064c39b7a7be9731db230b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.976548 14423 tablet_service.cc:1511] Processing CreateTablet for tablet 54911476bff5419280f7d784e8ee08b7 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:22.977820 14423 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54911476bff5419280f7d784e8ee08b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:22.986840 14628 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:22.993063 14628 tablet_bootstrap.cc:654] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.004879 14628 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.005386 14628 ts_tablet_manager.cc:1403] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.019s	user 0.003s	sys 0.012s
I20260709 12:29:23.010524 14628 raft_consensus.cc:359] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.011234 14628 raft_consensus.cc:385] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.011574 14628 raft_consensus.cc:740] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.012537 14628 consensus_queue.cc:260] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.014195 14575 tablet_service.cc:1511] Processing CreateTablet for tablet c9a5927af8e74a01bd7f247943cb568d (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:23.025315 14503 tablet_service.cc:1511] Processing CreateTablet for tablet 2902b62029a14bcb9d067182d34c2ae5 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:29:23.027959 14497 tablet_service.cc:1511] Processing CreateTablet for tablet c9a5927af8e74a01bd7f247943cb568d (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:29:23.033354 14498 tablet_service.cc:1511] Processing CreateTablet for tablet 54911476bff5419280f7d784e8ee08b7 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:29:23.027962 14502 tablet_service.cc:1511] Processing CreateTablet for tablet 9b114cb083054d1fb2e2a8d36dfc6339 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:29:23.033486 14501 tablet_service.cc:1511] Processing CreateTablet for tablet f7b45bedaf1045298fe817dd247aa6d2 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:29:23.029057 14499 tablet_service.cc:1511] Processing CreateTablet for tablet 2e447ab06e064c39b7a7be9731db230b (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:29:23.035820 14503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2902b62029a14bcb9d067182d34c2ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.036170 14628 ts_tablet_manager.cc:1434] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.015s
I20260709 12:29:23.036463 14497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a5927af8e74a01bd7f247943cb568d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.036952 14463 heartbeater.cc:499] Master 127.7.23.126:35493 was elected leader, sending a full tablet report...
I20260709 12:29:23.039731 14628 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.034883 14500 tablet_service.cc:1511] Processing CreateTablet for tablet 326c0f91b9de4c019cafbdc28206d5cb (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:29:23.043789 14499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e447ab06e064c39b7a7be9731db230b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.045912 14628 tablet_bootstrap.cc:654] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.046329 14501 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7b45bedaf1045298fe817dd247aa6d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.049898 14498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54911476bff5419280f7d784e8ee08b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.051375 14575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9a5927af8e74a01bd7f247943cb568d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.053385 14500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 326c0f91b9de4c019cafbdc28206d5cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.052083 14627 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.058328 14502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b114cb083054d1fb2e2a8d36dfc6339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.060678 14496 tablet_service.cc:1511] Processing CreateTablet for tablet 34d5bc3f3d47415c91881a3cc1cdb9fd (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:23.062067 14573 tablet_service.cc:1511] Processing CreateTablet for tablet 34d5bc3f3d47415c91881a3cc1cdb9fd (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:23.063539 14573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d5bc3f3d47415c91881a3cc1cdb9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.062026 14496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d5bc3f3d47415c91881a3cc1cdb9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.073817 14495 tablet_service.cc:1511] Processing CreateTablet for tablet e13b6f96c3774b3b8a0557d72c6e4cd9 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:23.075194 14495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13b6f96c3774b3b8a0557d72c6e4cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.088762 14428 tablet_service.cc:1511] Processing CreateTablet for tablet e13b6f96c3774b3b8a0557d72c6e4cd9 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:23.090117 14428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13b6f96c3774b3b8a0557d72c6e4cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.091434 14427 tablet_service.cc:1511] Processing CreateTablet for tablet 34d5bc3f3d47415c91881a3cc1cdb9fd (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:29:23.092710 14427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34d5bc3f3d47415c91881a3cc1cdb9fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.103204 14575 tablet_service.cc:1511] Processing CreateTablet for tablet e13b6f96c3774b3b8a0557d72c6e4cd9 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:29:23.104759 14575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e13b6f96c3774b3b8a0557d72c6e4cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.109066 14627 tablet_bootstrap.cc:654] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.126814 14428 tablet_service.cc:1511] Processing CreateTablet for tablet ad9e3522ad174b5da60922209168ed34 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:23.128194 14428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9e3522ad174b5da60922209168ed34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.128962 14494 tablet_service.cc:1511] Processing CreateTablet for tablet ad9e3522ad174b5da60922209168ed34 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:23.130278 14494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9e3522ad174b5da60922209168ed34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.145700 14632 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.146060 14628 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.146600 14628 ts_tablet_manager.cc:1403] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.043s
I20260709 12:29:23.149757 14576 tablet_service.cc:1511] Processing CreateTablet for tablet ad9e3522ad174b5da60922209168ed34 (DEFAULT_TABLE table=test-workload [id=94de1cb0e5644ebc9aa81d6db8fb5379]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:29:23.151115 14576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad9e3522ad174b5da60922209168ed34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:23.150830 14628 raft_consensus.cc:359] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.151592 14628 raft_consensus.cc:385] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.151891 14628 raft_consensus.cc:740] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.153982 14628 consensus_queue.cc:260] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.156082 14628 ts_tablet_manager.cc:1434] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:29:23.157999 14628 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.159400 14627 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.159947 14627 ts_tablet_manager.cc:1403] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.000s
I20260709 12:29:23.164220 14628 tablet_bootstrap.cc:654] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.166441 14627 raft_consensus.cc:359] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.167169 14627 raft_consensus.cc:385] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.167487 14627 raft_consensus.cc:740] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.168301 14627 consensus_queue.cc:260] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.177358 14627 ts_tablet_manager.cc:1434] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 12:29:23.178083 14612 heartbeater.cc:499] Master 127.7.23.126:35493 was elected leader, sending a full tablet report...
I20260709 12:29:23.182639 14627 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.188627 14627 tablet_bootstrap.cc:654] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.193984 14632 tablet_bootstrap.cc:654] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.198275 14628 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.198737 14627 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.198853 14628 ts_tablet_manager.cc:1403] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.041s	user 0.028s	sys 0.009s
I20260709 12:29:23.199319 14627 ts_tablet_manager.cc:1403] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 12:29:23.202091 14628 raft_consensus.cc:359] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.202507 14627 raft_consensus.cc:359] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.202841 14628 raft_consensus.cc:385] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.203145 14627 raft_consensus.cc:385] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.203198 14628 raft_consensus.cc:740] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.203460 14627 raft_consensus.cc:740] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.203764 14632 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.204255 14632 ts_tablet_manager.cc:1403] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.001s
I20260709 12:29:23.204125 14628 consensus_queue.cc:260] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.204262 14627 consensus_queue.cc:260] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.206358 14628 ts_tablet_manager.cc:1434] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:23.207363 14628 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.207437 14632 raft_consensus.cc:359] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.208173 14632 raft_consensus.cc:385] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.208472 14632 raft_consensus.cc:740] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.208485 14627 ts_tablet_manager.cc:1434] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:29:23.209666 14627 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.209390 14632 consensus_queue.cc:260] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.214205 14628 tablet_bootstrap.cc:654] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.216274 14627 tablet_bootstrap.cc:654] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.223002 14538 heartbeater.cc:499] Master 127.7.23.126:35493 was elected leader, sending a full tablet report...
I20260709 12:29:23.223686 14632 ts_tablet_manager.cc:1434] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.006s
I20260709 12:29:23.224792 14632 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.231503 14632 tablet_bootstrap.cc:654] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.233734 14627 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.234483 14627 ts_tablet_manager.cc:1403] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.005s
I20260709 12:29:23.237527 14627 raft_consensus.cc:359] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.238318 14627 raft_consensus.cc:385] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.238680 14627 raft_consensus.cc:740] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.239701 14627 consensus_queue.cc:260] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.242482 14627 ts_tablet_manager.cc:1434] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:29:23.243397 14628 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.243774 14627 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.243947 14628 ts_tablet_manager.cc:1403] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.020s
I20260709 12:29:23.244468 14632 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.244971 14632 ts_tablet_manager.cc:1403] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.020s	user 0.001s	sys 0.016s
I20260709 12:29:23.246845 14628 raft_consensus.cc:359] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.247603 14628 raft_consensus.cc:385] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.247944 14628 raft_consensus.cc:740] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.247743 14632 raft_consensus.cc:359] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.248551 14632 raft_consensus.cc:385] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.248847 14632 raft_consensus.cc:740] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.248835 14628 consensus_queue.cc:260] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.249764 14632 consensus_queue.cc:260] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.251187 14627 tablet_bootstrap.cc:654] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.252175 14632 ts_tablet_manager.cc:1434] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:29:23.253134 14632 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.258960 14632 tablet_bootstrap.cc:654] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.260382 14635 raft_consensus.cc:493] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.260856 14628 ts_tablet_manager.cc:1434] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:29:23.260977 14635 raft_consensus.cc:515] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.270638 14628 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.278230 14628 tablet_bootstrap.cc:654] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.283228 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
W20260709 12:29:23.285396 14551 leader_election.cc:343] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.290295 14628 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.291002 14628 ts_tablet_manager.cc:1403] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.012s
I20260709 12:29:23.294310 14628 raft_consensus.cc:359] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.285710 14635 leader_election.cc:290] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.295153 14628 raft_consensus.cc:385] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.295684 14628 raft_consensus.cc:740] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.296741 14628 consensus_queue.cc:260] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.303009 14627 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.303601 14627 ts_tablet_manager.cc:1403] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.060s	user 0.026s	sys 0.030s
I20260709 12:29:23.304647 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
W20260709 12:29:23.306365 14550 leader_election.cc:343] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.306818 14550 leader_election.cc:304] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca
I20260709 12:29:23.304942 14628 ts_tablet_manager.cc:1434] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:29:23.306644 14627 raft_consensus.cc:359] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.307617 14627 raft_consensus.cc:385] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.307911 14627 raft_consensus.cc:740] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.308041 14635 raft_consensus.cc:2749] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:23.308779 14627 consensus_queue.cc:260] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.310225 14628 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.310994 14627 ts_tablet_manager.cc:1434] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:29:23.312031 14627 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.315922 14628 tablet_bootstrap.cc:654] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.317507 14632 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.317951 14627 tablet_bootstrap.cc:654] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.318078 14632 ts_tablet_manager.cc:1403] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.065s	user 0.038s	sys 0.020s
I20260709 12:29:23.321563 14632 raft_consensus.cc:359] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.322397 14632 raft_consensus.cc:385] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.322777 14632 raft_consensus.cc:740] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.323601 14632 consensus_queue.cc:260] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.325027 14638 raft_consensus.cc:493] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.325525 14638 raft_consensus.cc:515] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.328166 14638 leader_election.cc:290] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.329936 14632 ts_tablet_manager.cc:1434] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:29:23.330147 14627 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.330785 14627 ts_tablet_manager.cc:1403] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:29:23.331214 14632 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.333614 14627 raft_consensus.cc:359] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.334313 14627 raft_consensus.cc:385] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.334610 14627 raft_consensus.cc:740] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.335494 14627 consensus_queue.cc:260] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.338112 14632 tablet_bootstrap.cc:654] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.338044 14627 ts_tablet_manager.cc:1434] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:29:23.340791 14627 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.346916 14627 tablet_bootstrap.cc:654] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.348579 14635 raft_consensus.cc:493] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.349121 14635 raft_consensus.cc:515] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.351302 14635 leader_election.cc:290] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.353606 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.354393 14438 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 0.
I20260709 12:29:23.355520 14551 leader_election.cc:304] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.356361 14635 raft_consensus.cc:2804] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.356705 14635 raft_consensus.cc:493] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.357903 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
W20260709 12:29:23.359620 14550 leader_election.cc:343] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.357029 14635 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.364080 14627 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.364639 14627 ts_tablet_manager.cc:1403] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260709 12:29:23.367652 14627 raft_consensus.cc:359] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.368297 14627 raft_consensus.cc:385] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.368595 14627 raft_consensus.cc:740] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.368920 14635 raft_consensus.cc:515] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.369565 14627 consensus_queue.cc:260] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.372968 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:23.373615 14438 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.373785 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
W20260709 12:29:23.375444 14550 leader_election.cc:343] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.376104 14635 leader_election.cc:290] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.378957 14627 ts_tablet_manager.cc:1434] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 12:29:23.382624 14438 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:23.383466 14627 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.384038 14551 leader_election.cc:304] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:23.385363 14635 raft_consensus.cc:2804] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.385855 14635 raft_consensus.cc:697] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:23.386857 14635 consensus_queue.cc:237] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.391024 14437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.391912 14627 tablet_bootstrap.cc:654] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.392886 14652 raft_consensus.cc:493] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:23.393216 14477 leader_election.cc:343] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.393384 14652 raft_consensus.cc:515] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.395138 14628 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.395664 14628 ts_tablet_manager.cc:1403] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.086s	user 0.025s	sys 0.000s
I20260709 12:29:23.396421 14437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54911476bff5419280f7d784e8ee08b7" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.397125 14437 raft_consensus.cc:2468] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 0.
I20260709 12:29:23.397648 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54911476bff5419280f7d784e8ee08b7" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.398453 14551 leader_election.cc:304] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.398609 14628 raft_consensus.cc:359] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
W20260709 12:29:23.399844 14550 leader_election.cc:343] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.400206 14652 leader_election.cc:290] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.401932 14632 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.402325 14628 raft_consensus.cc:385] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.404919 14628 raft_consensus.cc:740] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.405146 14632 ts_tablet_manager.cc:1403] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.074s	user 0.029s	sys 0.041s
I20260709 12:29:23.405697 14628 consensus_queue.cc:260] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.406131 14332 catalog_manager.cc:5697] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 0 to 1, leader changed from <none> to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 1 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:23.408468 14632 raft_consensus.cc:359] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.409487 14632 raft_consensus.cc:385] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.409849 14632 raft_consensus.cc:740] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.402451 14654 raft_consensus.cc:2804] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.410727 14654 raft_consensus.cc:493] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.410909 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.411175 14654 raft_consensus.cc:3060] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:23.415982 14477 leader_election.cc:343] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.416443 14477 leader_election.cc:304] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c; no voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca
I20260709 12:29:23.416627 14632 consensus_queue.cc:260] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.417253 14638 raft_consensus.cc:2749] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:23.418303 14628 ts_tablet_manager.cc:1434] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:29:23.419597 14628 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.420588 14632 ts_tablet_manager.cc:1434] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:29:23.421665 14632 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.425338 14654 raft_consensus.cc:515] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.427659 14628 tablet_bootstrap.cc:654] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.428438 14437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54911476bff5419280f7d784e8ee08b7" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:23.429096 14437 raft_consensus.cc:3060] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.429268 14652 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.431107 14652 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.432989 14627 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.433156 14652 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.433625 14627 ts_tablet_manager.cc:1403] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.006s
I20260709 12:29:23.435557 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.436766 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.437122 14632 tablet_bootstrap.cc:654] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.436640 14627 raft_consensus.cc:359] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.437776 14627 raft_consensus.cc:385] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.438113 14627 raft_consensus.cc:740] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.438920 14627 consensus_queue.cc:260] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
W20260709 12:29:23.440408 14551 leader_election.cc:343] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:23.443660 14550 leader_election.cc:343] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.445343 14437 raft_consensus.cc:2468] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:23.446022 14550 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca
I20260709 12:29:23.446587 14654 leader_election.cc:290] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.447767 14635 raft_consensus.cc:2749] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:23.448330 14551 leader_election.cc:304] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.452139 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54911476bff5419280f7d784e8ee08b7" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:23.455873 14627 ts_tablet_manager.cc:1434] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 12:29:23.457032 14627 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.454222 14652 raft_consensus.cc:2804] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.460167 14652 raft_consensus.cc:697] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:23.461153 14652 consensus_queue.cc:237] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
W20260709 12:29:23.462236 14550 leader_election.cc:343] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.463374 14627 tablet_bootstrap.cc:654] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.468803 14628 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.469184 14628 ts_tablet_manager.cc:1403] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.019s
I20260709 12:29:23.470017 14632 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.470510 14632 ts_tablet_manager.cc:1403] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.000s
I20260709 12:29:23.471290 14628 raft_consensus.cc:359] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.472040 14628 raft_consensus.cc:385] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.472316 14628 raft_consensus.cc:740] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.473616 14627 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.473165 14628 consensus_queue.cc:260] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.474109 14627 ts_tablet_manager.cc:1403] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.001s
I20260709 12:29:23.474225 14632 raft_consensus.cc:359] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.475071 14632 raft_consensus.cc:385] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.475368 14632 raft_consensus.cc:740] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.476120 14632 consensus_queue.cc:260] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
W20260709 12:29:23.477394 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:23.478629 14632 ts_tablet_manager.cc:1434] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:23.479687 14632 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.481616 14333 catalog_manager.cc:5697] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 0 to 1, leader changed from <none> to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 1 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:23.482766 14628 ts_tablet_manager.cc:1434] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:29:23.485931 14632 tablet_bootstrap.cc:654] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.487013 14628 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.490512 14638 raft_consensus.cc:493] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.490767 14630 raft_consensus.cc:493] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.491312 14630 raft_consensus.cc:515] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.491705 14638 raft_consensus.cc:515] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.493887 14638 leader_election.cc:290] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.496088 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a5927af8e74a01bd7f247943cb568d" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.496762 14587 raft_consensus.cc:2468] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 0.
I20260709 12:29:23.497720 14628 tablet_bootstrap.cc:654] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.498104 14477 leader_election.cc:304] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
I20260709 12:29:23.498996 14652 raft_consensus.cc:493] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.499219 14630 leader_election.cc:290] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.499552 14638 raft_consensus.cc:2804] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.500000 14638 raft_consensus.cc:493] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.494055 14627 raft_consensus.cc:359] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.500692 14437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a5927af8e74a01bd7f247943cb568d" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.501084 14627 raft_consensus.cc:385] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.501384 14627 raft_consensus.cc:740] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.501341 14437 raft_consensus.cc:2468] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 0.
I20260709 12:29:23.500736 14652 raft_consensus.cc:515] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.500347 14638 raft_consensus.cc:3060] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.507898 14647 raft_consensus.cc:493] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.508520 14647 raft_consensus.cc:515] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.510888 14647 leader_election.cc:290] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.511739 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.513085 14437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.513288 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
W20260709 12:29:23.513514 14550 leader_election.cc:343] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.513731 14437 raft_consensus.cc:2468] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 0.
I20260709 12:29:23.502269 14627 consensus_queue.cc:260] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.514984 14628 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.515170 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.515600 14628 ts_tablet_manager.cc:1403] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.011s
I20260709 12:29:23.515036 14551 leader_election.cc:304] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:23.516781 14635 raft_consensus.cc:2804] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.517131 14635 raft_consensus.cc:493] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.517462 14635 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.517745 14627 ts_tablet_manager.cc:1434] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:29:23.518638 14627 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.518435 14628 raft_consensus.cc:359] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.519104 14628 raft_consensus.cc:385] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.519356 14628 raft_consensus.cc:740] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.520025 14628 consensus_queue.cc:260] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.520431 14652 leader_election.cc:290] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.520392 14638 raft_consensus.cc:515] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.522023 14628 ts_tablet_manager.cc:1434] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:23.522876 14628 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.523090 14638 leader_election.cc:290] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.527655 14632 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.528210 14632 ts_tablet_manager.cc:1403] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.004s
I20260709 12:29:23.530162 14628 tablet_bootstrap.cc:654] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.531184 14632 raft_consensus.cc:359] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.531910 14632 raft_consensus.cc:385] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.532209 14632 raft_consensus.cc:740] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
W20260709 12:29:23.515352 14477 leader_election.cc:343] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.532971 14632 consensus_queue.cc:260] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.534395 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a5927af8e74a01bd7f247943cb568d" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:23.534973 14438 raft_consensus.cc:3060] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.535876 14632 ts_tablet_manager.cc:1434] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:29:23.537142 14632 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.540580 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a5927af8e74a01bd7f247943cb568d" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:23.541109 14587 raft_consensus.cc:3060] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.543717 14632 tablet_bootstrap.cc:654] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.528267 14627 tablet_bootstrap.cc:654] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:23.548111 14477 leader_election.cc:343] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.550074 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a5927af8e74a01bd7f247943cb568d" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.550953 14513 raft_consensus.cc:2393] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c235df55461943efb57e4e02fb605fca in current term 1: Already voted for candidate 41c3fbf8372f485b8e7632d00e34bb3c in this term.
I20260709 12:29:23.552325 14630 raft_consensus.cc:493] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.552812 14630 raft_consensus.cc:515] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.554958 14630 leader_election.cc:290] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.556660 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
W20260709 12:29:23.558019 14400 leader_election.cc:343] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.560346 14587 raft_consensus.cc:2468] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 1.
I20260709 12:29:23.561013 14635 raft_consensus.cc:515] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.548660 14477 leader_election.cc:304] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c; no voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca
I20260709 12:29:23.562888 14438 raft_consensus.cc:2468] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 1.
I20260709 12:29:23.563014 14638 raft_consensus.cc:2749] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:23.563913 14477 leader_election.cc:304] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
I20260709 12:29:23.564668 14638 raft_consensus.cc:2804] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.565119 14638 raft_consensus.cc:697] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:23.565944 14638 consensus_queue.cc:237] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.577404 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:23.581938 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
W20260709 12:29:23.583518 14550 leader_election.cc:343] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.585762 14627 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.586232 14438 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.586295 14627 ts_tablet_manager.cc:1403] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.000s
I20260709 12:29:23.587442 14635 leader_election.cc:290] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.588732 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9a5927af8e74a01bd7f247943cb568d" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.591640 14587 raft_consensus.cc:2393] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c235df55461943efb57e4e02fb605fca in current term 1: Already voted for candidate 41c3fbf8372f485b8e7632d00e34bb3c in this term.
I20260709 12:29:23.589569 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.592465 14628 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.592504 14586 raft_consensus.cc:2468] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.593075 14628 ts_tablet_manager.cc:1403] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.070s	user 0.036s	sys 0.031s
I20260709 12:29:23.592932 14401 leader_election.cc:304] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c235df55461943efb57e4e02fb605fca; no voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e
I20260709 12:29:23.589046 14333 catalog_manager.cc:5697] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 0 to 1, leader changed from <none> to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 1 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.594182 14627 raft_consensus.cc:359] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.594558 14630 raft_consensus.cc:2749] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:23.594971 14627 raft_consensus.cc:385] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.594309 14401 leader_election.cc:304] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:23.595343 14627 raft_consensus.cc:740] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.595738 14628 raft_consensus.cc:359] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.596323 14630 raft_consensus.cc:2804] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.596407 14628 raft_consensus.cc:385] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.596906 14630 raft_consensus.cc:493] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.597010 14628 raft_consensus.cc:740] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.596400 14627 consensus_queue.cc:260] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.597312 14630 raft_consensus.cc:3060] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.597726 14628 consensus_queue.cc:260] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.605396 14630 raft_consensus.cc:515] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.607239 14627 ts_tablet_manager.cc:1434] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:29:23.608289 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:23.608891 14586 raft_consensus.cc:3060] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.610078 14438 raft_consensus.cc:2468] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:23.610311 14627 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e: Bootstrap starting.
I20260709 12:29:23.611264 14551 leader_election.cc:304] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:23.612447 14635 raft_consensus.cc:2804] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.612920 14635 raft_consensus.cc:697] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:23.613723 14635 consensus_queue.cc:237] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.616643 14627 tablet_bootstrap.cc:654] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.621379 14628 ts_tablet_manager.cc:1434] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.019s
I20260709 12:29:23.622213 14586 raft_consensus.cc:2468] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.622575 14628 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:23.623378 14401 leader_election.cc:304] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.592901 14632 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.624351 14671 raft_consensus.cc:2804] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.626248 14630 leader_election.cc:290] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Requested vote from peers a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.624588 14632 ts_tablet_manager.cc:1403] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.088s	user 0.028s	sys 0.021s
I20260709 12:29:23.626493 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
W20260709 12:29:23.628199 14400 leader_election.cc:343] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:23.628741 14628 tablet_bootstrap.cc:654] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.629786 14632 raft_consensus.cc:359] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.634507 14632 raft_consensus.cc:385] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.634814 14632 raft_consensus.cc:740] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.632459 14627 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e: No bootstrap required, opened a new log
I20260709 12:29:23.636009 14627 ts_tablet_manager.cc:1403] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 12:29:23.636291 14671 raft_consensus.cc:697] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Becoming Leader. State: Replica: c235df55461943efb57e4e02fb605fca, State: Running, Role: LEADER
I20260709 12:29:23.637234 14671 consensus_queue.cc:237] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.637588 14333 catalog_manager.cc:5697] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 0 to 1, leader changed from <none> to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 1 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:23.638734 14627 raft_consensus.cc:359] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.639981 14632 consensus_queue.cc:260] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:23.642405 14628 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: No bootstrap required, opened a new log
I20260709 12:29:23.642899 14628 ts_tablet_manager.cc:1403] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 12:29:23.645224 14632 ts_tablet_manager.cc:1434] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:29:23.645591 14628 raft_consensus.cc:359] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.639470 14627 raft_consensus.cc:385] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.646253 14628 raft_consensus.cc:385] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.646510 14627 raft_consensus.cc:740] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.646600 14628 raft_consensus.cc:740] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.647387 14627 consensus_queue.cc:260] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.647610 14628 consensus_queue.cc:260] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.649729 14627 ts_tablet_manager.cc:1434] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:29:23.649809 14674 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.646270 14632 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.650630 14635 raft_consensus.cc:493] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.650303 14674 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.651126 14635 raft_consensus.cc:515] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.653196 14635 leader_election.cc:290] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.654173 14674 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.655179 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.655900 14513 raft_consensus.cc:2468] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 0.
I20260709 12:29:23.656435 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.656872 14628 ts_tablet_manager.cc:1434] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:29:23.657071 14438 raft_consensus.cc:2468] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 0.
I20260709 12:29:23.657115 14550 leader_election.cc:304] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
I20260709 12:29:23.655160 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.659135 14635 raft_consensus.cc:2804] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.659720 14635 raft_consensus.cc:493] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.659791 14586 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.660108 14635 raft_consensus.cc:3060] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.657410 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.661152 14513 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.662448 14400 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.663633 14671 raft_consensus.cc:2804] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.664041 14671 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.664407 14671 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.656481 14632 tablet_bootstrap.cc:654] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.668165 14635 raft_consensus.cc:515] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.670881 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:23.671482 14438 raft_consensus.cc:3060] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.671703 14671 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.673803 14671 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Requested vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.674567 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:23.675021 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:23.675711 14586 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.675036 14332 catalog_manager.cc:5697] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca reported cstate change: term changed from 0 to 1, leader changed from <none> to c235df55461943efb57e4e02fb605fca (127.7.23.65). New cstate: current_term: 1 leader_uuid: "c235df55461943efb57e4e02fb605fca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.679184 14438 raft_consensus.cc:2468] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:23.680440 14635 leader_election.cc:290] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:23.675180 14513 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.681391 14551 leader_election.cc:304] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.683365 14586 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.684176 14635 raft_consensus.cc:2804] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.684854 14635 raft_consensus.cc:697] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:23.685638 14635 consensus_queue.cc:237] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.688563 14401 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.688668 14513 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.689700 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:23.689661 14671 raft_consensus.cc:2804] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.690361 14512 raft_consensus.cc:3060] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.690914 14671 raft_consensus.cc:697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Becoming Leader. State: Replica: c235df55461943efb57e4e02fb605fca, State: Running, Role: LEADER
I20260709 12:29:23.691790 14671 consensus_queue.cc:237] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.695004 14632 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.697055 14632 ts_tablet_manager.cc:1403] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.016s
I20260709 12:29:23.698786 14512 raft_consensus.cc:2468] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:23.699781 14632 raft_consensus.cc:359] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.700485 14632 raft_consensus.cc:385] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.700752 14632 raft_consensus.cc:740] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.700230 14332 catalog_manager.cc:5697] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 0 to 1, leader changed from <none> to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 1 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:23.701392 14632 consensus_queue.cc:260] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.703896 14632 ts_tablet_manager.cc:1434] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:23.704782 14632 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.710000 14632 tablet_bootstrap.cc:654] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.712697 14674 raft_consensus.cc:493] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.713270 14674 raft_consensus.cc:515] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.716588 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.717255 14512 raft_consensus.cc:2468] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.718341 14400 leader_election.cc:304] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.718606 14674 leader_election.cc:290] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.719940 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.720150 14674 raft_consensus.cc:2804] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.720567 14674 raft_consensus.cc:493] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.720933 14674 raft_consensus.cc:3060] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.721735 14632 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.720584 14586 raft_consensus.cc:2468] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.722201 14632 ts_tablet_manager.cc:1403] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.007s
I20260709 12:29:23.723961 14335 catalog_manager.cc:5697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca reported cstate change: term changed from 0 to 1, leader changed from <none> to c235df55461943efb57e4e02fb605fca (127.7.23.65). New cstate: current_term: 1 leader_uuid: "c235df55461943efb57e4e02fb605fca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.724668 14632 raft_consensus.cc:359] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.725220 14632 raft_consensus.cc:385] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.725497 14632 raft_consensus.cc:740] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.726039 14632 consensus_queue.cc:260] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.727836 14632 ts_tablet_manager.cc:1434] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:29:23.728102 14674 raft_consensus.cc:515] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.728801 14632 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c: Bootstrap starting.
I20260709 12:29:23.730086 14674 leader_election.cc:290] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Requested vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.730808 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:23.731366 14512 raft_consensus.cc:3060] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.734439 14632 tablet_bootstrap.cc:654] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:23.738816 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:23.739100 14632 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c: No bootstrap required, opened a new log
I20260709 12:29:23.739024 14512 raft_consensus.cc:2468] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.739560 14586 raft_consensus.cc:3060] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.739806 14632 ts_tablet_manager.cc:1403] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.002s
I20260709 12:29:23.740491 14400 leader_election.cc:304] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.741487 14674 raft_consensus.cc:2804] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.742637 14674 raft_consensus.cc:697] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Becoming Leader. State: Replica: c235df55461943efb57e4e02fb605fca, State: Running, Role: LEADER
I20260709 12:29:23.742527 14632 raft_consensus.cc:359] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.743238 14632 raft_consensus.cc:385] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:23.743561 14632 raft_consensus.cc:740] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Initialized, Role: FOLLOWER
I20260709 12:29:23.743595 14674 consensus_queue.cc:237] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.744352 14632 consensus_queue.cc:260] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.746441 14632 ts_tablet_manager.cc:1434] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:29:23.747175 14586 raft_consensus.cc:2468] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.752898 14335 catalog_manager.cc:5697] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca reported cstate change: term changed from 0 to 1, leader changed from <none> to c235df55461943efb57e4e02fb605fca (127.7.23.65). New cstate: current_term: 1 leader_uuid: "c235df55461943efb57e4e02fb605fca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.917217 14674 raft_consensus.cc:493] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.917711 14674 raft_consensus.cc:515] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.918736 14638 raft_consensus.cc:493] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.919260 14638 raft_consensus.cc:515] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.919615 14674 leader_election.cc:290] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.920392 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.920715 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.920953 14512 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.921316 14638 leader_election.cc:290] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.921375 14586 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.922362 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.922528 14400 leader_election.cc:304] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.922574 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.923357 14674 raft_consensus.cc:2804] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.923476 14438 raft_consensus.cc:2393] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41c3fbf8372f485b8e7632d00e34bb3c in current term 1: Already voted for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in this term.
I20260709 12:29:23.923903 14674 raft_consensus.cc:493] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.924248 14674 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.924583 14477 leader_election.cc:304] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c; no voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca
I20260709 12:29:23.925032 14671 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.925734 14638 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.925521 14671 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.927589 14647 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:23.928087 14647 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.928647 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:23.929237 14512 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.930044 14647 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.930510 14400 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.930977 14635 consensus_queue.cc:1048] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:23.931255 14630 raft_consensus.cc:2804] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.931661 14630 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.931553 14674 raft_consensus.cc:515] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.932081 14630 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.933351 14638 raft_consensus.cc:2749] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:23.933995 14674 leader_election.cc:290] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Requested vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.934159 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.934711 14587 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 0.
I20260709 12:29:23.935833 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:23.936389 14585 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 0.
I20260709 12:29:23.927628 14671 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.937759 14477 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
I20260709 12:29:23.938868 14630 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.940416 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:23.938609 14638 raft_consensus.cc:2804] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:23.941116 14512 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.941244 14638 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:23.943537 14513 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:23.944248 14638 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.949368 14512 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.940361 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:23.942409 14630 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Requested vote from peers 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.940564 14437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:23.943523 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "c235df55461943efb57e4e02fb605fca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:23.950479 14586 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.950506 14400 leader_election.cc:304] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:23.951089 14585 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.951555 14630 raft_consensus.cc:2804] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.952008 14630 raft_consensus.cc:697] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Becoming Leader. State: Replica: c235df55461943efb57e4e02fb605fca, State: Running, Role: LEADER
I20260709 12:29:23.950604 14437 raft_consensus.cc:2393] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41c3fbf8372f485b8e7632d00e34bb3c in current term 1: Already voted for candidate c235df55461943efb57e4e02fb605fca in this term.
I20260709 12:29:23.952788 14630 consensus_queue.cc:237] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.954139 14638 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.956357 14513 raft_consensus.cc:2393] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c235df55461943efb57e4e02fb605fca in current term 1: Already voted for candidate 41c3fbf8372f485b8e7632d00e34bb3c in this term.
I20260709 12:29:23.957134 14512 raft_consensus.cc:3060] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:23.957324 14586 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.961903 14638 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:23.962342 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:23.962419 14436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:23.964813 14436 raft_consensus.cc:2393] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 41c3fbf8372f485b8e7632d00e34bb3c in current term 1: Already voted for candidate c235df55461943efb57e4e02fb605fca in this term.
I20260709 12:29:23.965921 14652 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:23.970794 14647 consensus_queue.cc:1048] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:23.971988 14654 consensus_queue.cc:1048] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:23.974623 14585 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c235df55461943efb57e4e02fb605fca in term 1.
I20260709 12:29:23.978929 14401 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:23.981395 14477 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c; no voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca
I20260709 12:29:23.982498 14635 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:23.982712 14638 raft_consensus.cc:2749] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:23.983119 14630 raft_consensus.cc:2804] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:23.985162 14630 raft_consensus.cc:697] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Becoming Leader. State: Replica: c235df55461943efb57e4e02fb605fca, State: Running, Role: LEADER
I20260709 12:29:23.986129 14630 consensus_queue.cc:237] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:23.990140 14335 catalog_manager.cc:5697] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca reported cstate change: term changed from 0 to 1, leader changed from <none> to c235df55461943efb57e4e02fb605fca (127.7.23.65). New cstate: current_term: 1 leader_uuid: "c235df55461943efb57e4e02fb605fca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:23.998988 14635 consensus_queue.cc:1048] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:24.020246 14647 raft_consensus.cc:493] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.020903 14647 raft_consensus.cc:515] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:24.024871 14647 leader_election.cc:290] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:24.025276 14511 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.027755 14587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:24.030236 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:24.032227 14674 consensus_queue.cc:1048] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.035027 14477 leader_election.cc:304] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c; no voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca
I20260709 12:29:24.049741 14333 catalog_manager.cc:5697] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca reported cstate change: term changed from 0 to 1, leader changed from <none> to c235df55461943efb57e4e02fb605fca (127.7.23.65). New cstate: current_term: 1 leader_uuid: "c235df55461943efb57e4e02fb605fca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:24.050734 14647 raft_consensus.cc:2749] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:24.065495 14694 consensus_queue.cc:1048] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:24.069437 14647 raft_consensus.cc:493] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:24.069893 14647 raft_consensus.cc:515] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:24.071851 14647 leader_election.cc:290] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311), c235df55461943efb57e4e02fb605fca (127.7.23.65:35391)
I20260709 12:29:24.072137 14513 raft_consensus.cc:3060] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:24.073720 14586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:24.075881 14438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c235df55461943efb57e4e02fb605fca" is_pre_election: true
I20260709 12:29:24.077664 14477 leader_election.cc:304] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c; no voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca
I20260709 12:29:24.080323 14698 raft_consensus.cc:2749] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:24.082792 14638 consensus_queue.cc:1048] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:29:24.084389 14674 consensus_queue.cc:1048] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.087237 14674 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:29:24.114418 14694 consensus_queue.cc:1048] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.115638 14630 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:24.117614  7261 ts_manager.cc:295] Set tserver state for c235df55461943efb57e4e02fb605fca to MAINTENANCE_MODE
I20260709 12:29:24.118595  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
W20260709 12:29:24.149144 14551 consensus_peers.cc:597] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:24.167026  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:24.167824  7261 tablet_replica.cc:333] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.168622  7261 raft_consensus.cc:2243] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:24.169374  7261 pending_rounds.cc:70] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Trying to abort 1 pending ops.
I20260709 12:29:24.169654  7261 pending_rounds.cc:77] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626271697989632 op_type: NO_OP noop_request { }
I20260709 12:29:24.170030  7261 raft_consensus.cc:2889] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:24.170356  7261 raft_consensus.cc:2272] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.172650  7261 tablet_replica.cc:333] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.173188  7261 raft_consensus.cc:2243] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:24.173732  7261 pending_rounds.cc:70] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Trying to abort 1 pending ops.
I20260709 12:29:24.173897  7261 pending_rounds.cc:77] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626271559884800 op_type: NO_OP noop_request { }
I20260709 12:29:24.174139  7261 raft_consensus.cc:2889] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:24.174382  7261 raft_consensus.cc:2272] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.176725  7261 tablet_replica.cc:333] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.177289  7261 raft_consensus.cc:2243] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:24.177836  7261 pending_rounds.cc:70] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Trying to abort 1 pending ops.
I20260709 12:29:24.178002  7261 pending_rounds.cc:77] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626270704578560 op_type: NO_OP noop_request { }
I20260709 12:29:24.178261  7261 raft_consensus.cc:2889] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:24.178511  7261 raft_consensus.cc:2272] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.180454  7261 tablet_replica.cc:333] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.180974  7261 raft_consensus.cc:2243] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:24.181336  7261 raft_consensus.cc:2272] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.184973  7261 tablet_replica.cc:333] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.185483  7261 raft_consensus.cc:2243] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:24.186208  7261 raft_consensus.cc:2272] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.188131  7261 tablet_replica.cc:333] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.188642  7261 raft_consensus.cc:2243] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:24.189011  7261 raft_consensus.cc:2272] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.190975  7261 tablet_replica.cc:333] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.191562  7261 raft_consensus.cc:2243] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:24.192297  7261 raft_consensus.cc:2272] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.194235  7261 tablet_replica.cc:333] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.194705  7261 raft_consensus.cc:2243] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:24.195006  7261 raft_consensus.cc:2272] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.196543  7261 tablet_replica.cc:333] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.196954  7261 raft_consensus.cc:2243] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:24.197275  7261 raft_consensus.cc:2272] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.199352  7261 tablet_replica.cc:333] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: stopping tablet replica
I20260709 12:29:24.199829  7261 raft_consensus.cc:2243] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:24.200162  7261 raft_consensus.cc:2272] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:24.229066  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
W20260709 12:29:24.411998 14551 consensus_peers.cc:597] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:24.478368 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:24.483009 14551 consensus_peers.cc:597] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:24.638929 14551 consensus_peers.cc:597] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:24.659086 14477 consensus_peers.cc:597] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:25.479328 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:25.561389 14652 raft_consensus.cc:493] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.561895 14652 raft_consensus.cc:515] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.563577 14652 leader_election.cc:290] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.564596 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:25.565238 14512 raft_consensus.cc:2468] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:25.566255 14550 leader_election.cc:304] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
W20260709 12:29:25.566756 14551 leader_election.cc:336] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.566958 14652 raft_consensus.cc:2804] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:25.567324 14652 raft_consensus.cc:493] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:25.567615 14652 raft_consensus.cc:3060] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.572628 14652 raft_consensus.cc:515] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.574079 14652 leader_election.cc:290] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.574203 14694 raft_consensus.cc:493] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c235df55461943efb57e4e02fb605fca)
I20260709 12:29:25.574807 14694 raft_consensus.cc:515] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:25.575181 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e13b6f96c3774b3b8a0557d72c6e4cd9" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:25.575749 14512 raft_consensus.cc:3060] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.576736 14694 leader_election.cc:290] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.577801 14510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
W20260709 12:29:25.579041 14551 leader_election.cc:336] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
W20260709 12:29:25.581558 14551 leader_election.cc:336] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.581861 14551 leader_election.cc:304] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca
I20260709 12:29:25.581961 14512 raft_consensus.cc:2468] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 2.
I20260709 12:29:25.582432 14694 raft_consensus.cc:2749] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:25.582937 14550 leader_election.cc:304] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: c235df55461943efb57e4e02fb605fca
I20260709 12:29:25.583545 14694 raft_consensus.cc:2804] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.583911 14694 raft_consensus.cc:697] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:25.584661 14694 consensus_queue.cc:237] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.590822 14335 catalog_manager.cc:5697] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 1 to 2, leader changed from c235df55461943efb57e4e02fb605fca (127.7.23.65) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 2 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.593268 14714 raft_consensus.cc:493] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c235df55461943efb57e4e02fb605fca)
I20260709 12:29:25.593739 14714 raft_consensus.cc:515] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:25.595382 14714 leader_election.cc:290] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311), c235df55461943efb57e4e02fb605fca (127.7.23.65:35391)
I20260709 12:29:25.596181 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:25.596822 14585 raft_consensus.cc:2468] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 1.
I20260709 12:29:25.598019 14477 leader_election.cc:304] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
I20260709 12:29:25.598758 14714 raft_consensus.cc:2804] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:25.599059 14714 raft_consensus.cc:493] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c235df55461943efb57e4e02fb605fca)
I20260709 12:29:25.599344 14714 raft_consensus.cc:3060] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:25.600417 14477 leader_election.cc:336] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.605252 14714 raft_consensus.cc:515] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:25.607182 14714 leader_election.cc:290] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Requested vote from peers a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311), c235df55461943efb57e4e02fb605fca (127.7.23.65:35391)
I20260709 12:29:25.607893 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2902b62029a14bcb9d067182d34c2ae5" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:25.608405 14585 raft_consensus.cc:3060] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:25.610670 14477 leader_election.cc:336] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.614033 14585 raft_consensus.cc:2468] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 2.
I20260709 12:29:25.614920 14477 leader_election.cc:304] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: c235df55461943efb57e4e02fb605fca
I20260709 12:29:25.615540 14714 raft_consensus.cc:2804] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.615892 14714 raft_consensus.cc:697] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:25.616477 14714 consensus_queue.cc:237] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:25.617460 14713 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c235df55461943efb57e4e02fb605fca)
I20260709 12:29:25.617869 14713 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.618670 14694 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c235df55461943efb57e4e02fb605fca)
I20260709 12:29:25.619163 14694 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.619858 14713 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:25.621277 14694 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.621836 14652 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.622303 14652 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.622785 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:25.623533 14512 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:25.624521 14652 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.624446 14335 catalog_manager.cc:5697] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 1 to 2, leader changed from c235df55461943efb57e4e02fb605fca (127.7.23.65) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 2 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.625208 14550 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
W20260709 12:29:25.626251 14551 leader_election.cc:336] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.626713 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:25.627312 14652 raft_consensus.cc:2804] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:25.627332 14512 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:25.627642 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" is_pre_election: true
I20260709 12:29:25.628592 14652 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election (detected failure of leader c235df55461943efb57e4e02fb605fca)
I20260709 12:29:25.628738 14550 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
I20260709 12:29:25.629046 14652 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.629617 14694 raft_consensus.cc:2804] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:25.629982 14694 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:25.630311 14694 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:25.630801 14551 leader_election.cc:336] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
W20260709 12:29:25.632210 14477 leader_election.cc:336] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.636927 14652 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.639117 14652 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.639248 14585 raft_consensus.cc:2393] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 41c3fbf8372f485b8e7632d00e34bb3c in current term 2: Already voted for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in this term.
I20260709 12:29:25.640007 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:25.640828 14694 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.641695 14512 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:25.642194 14551 leader_election.cc:336] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.642975 14477 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c; no voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca
I20260709 12:29:25.643059 14694 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.644059 14510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:25.644640 14510 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:25.646090 14551 leader_election.cc:336] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.650532 14510 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 2.
I20260709 12:29:25.651608 14550 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: c235df55461943efb57e4e02fb605fca
I20260709 12:29:25.652240 14694 raft_consensus.cc:2804] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.652494 14512 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 2.
I20260709 12:29:25.652666 14694 raft_consensus.cc:697] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:25.652952 14714 raft_consensus.cc:2749] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:29:25.653481 14694 consensus_queue.cc:237] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.654476 14550 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: c235df55461943efb57e4e02fb605fca
I20260709 12:29:25.655200 14652 raft_consensus.cc:2804] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.655669 14652 raft_consensus.cc:697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:25.656448 14652 consensus_queue.cc:237] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.661442 14335 catalog_manager.cc:5697] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 1 to 2, leader changed from c235df55461943efb57e4e02fb605fca (127.7.23.65) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 2 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:25.672086 14335 catalog_manager.cc:5697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 1 to 2, leader changed from c235df55461943efb57e4e02fb605fca (127.7.23.65) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 2 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:25.883183 14551 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111) [suppressed 131 similar messages]
I20260709 12:29:25.892050 14652 raft_consensus.cc:493] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:25.892536 14652 raft_consensus.cc:515] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.894243 14652 leader_election.cc:290] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.895396 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" is_pre_election: true
I20260709 12:29:25.896077 14512 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 1.
I20260709 12:29:25.897070 14550 leader_election.cc:304] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
W20260709 12:29:25.897562 14551 leader_election.cc:336] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.897686 14652 raft_consensus.cc:2804] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:29:25.898082 14652 raft_consensus.cc:493] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:25.898401 14652 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:25.903292 14652 raft_consensus.cc:515] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.904913 14652 leader_election.cc:290] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:25.905987 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:25.906533 14512 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:29:25.908171 14551 leader_election.cc:336] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111)
I20260709 12:29:25.911619 14512 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 2.
I20260709 12:29:25.912509 14550 leader_election.cc:304] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: c235df55461943efb57e4e02fb605fca
I20260709 12:29:25.913096 14652 raft_consensus.cc:2804] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:25.913460 14652 raft_consensus.cc:697] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:25.914114 14652 consensus_queue.cc:237] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:25.920240 14335 catalog_manager.cc:5697] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 1 to 2, leader changed from c235df55461943efb57e4e02fb605fca (127.7.23.65) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 2 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
W20260709 12:29:25.993006 14551 consensus_peers.cc:597] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:26.002085 14477 consensus_peers.cc:597] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:26.033603 14512 raft_consensus.cc:1275] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:26.035277 14652 consensus_queue.cc:1048] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:26.052507 14551 consensus_peers.cc:597] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:26.134214 14551 consensus_peers.cc:597] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:26.174609 14512 raft_consensus.cc:1275] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:26.176079 14652 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:26.179965 14585 raft_consensus.cc:1275] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:26.181697 14729 consensus_queue.cc:1048] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:26.239856 14512 raft_consensus.cc:1275] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:26.241031 14652 consensus_queue.cc:1048] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:26.322377 14551 consensus_peers.cc:597] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:26.480257 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:26.508002 14512 raft_consensus.cc:1275] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:29:26.509256 14652 consensus_queue.cc:1048] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:29:26.666761 14551 consensus_peers.cc:597] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:26.720310 14551 consensus_peers.cc:597] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:26.831139 14551 consensus_peers.cc:597] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:27.079998 14551 consensus_peers.cc:597] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:27.191335 14477 consensus_peers.cc:597] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:27.481211 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:28.482191 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:29:28.528630 14551 consensus_peers.cc:597] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:28.594411 14551 consensus_peers.cc:597] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:28.641311 14477 consensus_peers.cc:597] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:28.741994 14551 consensus_peers.cc:597] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:28.838959 14551 consensus_peers.cc:597] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:29:28.894345 14551 consensus_peers.cc:597] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:29:29.184226 14551 consensus_peers.cc:597] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:29.247210  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:29.252918 14738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:29.253427 14739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:29.259435 14741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:29.259698  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:29.261875  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:29.262082  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:29.262267  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600169262249 us; error 0 us; skew 500 ppm
I20260709 12:29:29.262768  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:29.264979  7261 webserver.cc:533] Webserver started at http://127.7.23.65:40785/ using document root <none> and password file <none>
I20260709 12:29:29.265446  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:29.265607  7261 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:29:29.269088  7261 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:29:29.272480 14746 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:29.273236  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:29.273535  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "c235df55461943efb57e4e02fb605fca"
format_stamp: "Formatted at 2026-07-09 12:29:22 on dist-test-slave-ps85"
I20260709 12:29:29.273811  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:29.292091  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:29.293112  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:29.294486  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:29.297775 14753 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:29:29.348933  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:29:29.349260  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.002s	sys 0.000s
I20260709 12:29:29.349529  7261 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:29:29.353981 14753 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.367020 14753 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:29.367884 14753 tablet_bootstrap.cc:492] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
W20260709 12:29:29.368376 14551 consensus_peers.cc:597] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:29:29.368464 14753 ts_tablet_manager.cc:1403] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:29:29.370829 14753 raft_consensus.cc:359] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.371330 14753 raft_consensus.cc:740] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.371941 14753 consensus_queue.cc:260] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.374022 14753 ts_tablet_manager.cc:1434] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:29.374711 14753 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.384387 14753 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:29.384999 14753 tablet_bootstrap.cc:492] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.385506 14753 ts_tablet_manager.cc:1403] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:29:29.387302 14753 raft_consensus.cc:359] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.387846 14753 raft_consensus.cc:740] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.387976  7261 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:29:29.388275  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.039s	user 0.039s	sys 0.000s
I20260709 12:29:29.388509 14753 consensus_queue.cc:260] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.390132 14753 ts_tablet_manager.cc:1434] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:29:29.390794 14753 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.403771 14753 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:29.404495 14753 tablet_bootstrap.cc:492] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.405134 14753 ts_tablet_manager.cc:1403] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:29:29.407105 14753 raft_consensus.cc:359] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:29.407680 14753 raft_consensus.cc:740] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.408331 14753 consensus_queue.cc:260] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } } peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } }
I20260709 12:29:29.409948 14753 ts_tablet_manager.cc:1434] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:29.410609 14753 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.421783 14753 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:29.422569 14753 tablet_bootstrap.cc:492] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.423197 14753 ts_tablet_manager.cc:1403] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:29:29.425047 14753 raft_consensus.cc:359] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.425653 14753 raft_consensus.cc:740] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.426260 14753 consensus_queue.cc:260] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.427773 14753 ts_tablet_manager.cc:1434] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:29.428508 14753 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.438750 14753 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:29.439554 14753 tablet_bootstrap.cc:492] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.440053 14753 ts_tablet_manager.cc:1403] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:29:29.442185  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:35391
I20260709 12:29:29.442309 14815 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:35391 every 8 connection(s)
I20260709 12:29:29.442384 14753 raft_consensus.cc:359] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.443429 14753 raft_consensus.cc:740] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.444177 14753 consensus_queue.cc:260] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.446128 14753 ts_tablet_manager.cc:1434] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:29.446906 14753 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
W20260709 12:29:29.452962 14818 tablet.cc:2406] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:29:29.454366  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:29.467162 14753 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:29.468231 14753 tablet_bootstrap.cc:492] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.469038 14753 ts_tablet_manager.cc:1403] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 12:29:29.471736 14753 raft_consensus.cc:359] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.472504 14753 raft_consensus.cc:740] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.473266 14753 consensus_queue.cc:260] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.475037 14753 ts_tablet_manager.cc:1434] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:29:29.475824 14753 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
W20260709 12:29:29.483112 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:29.484529 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:29.485105 14585 raft_consensus.cc:606] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:29.485343 14817 heartbeater.cc:344] Connected to a master server at 127.7.23.126:35493
I20260709 12:29:29.485754 14817 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:29.486604 14817 heartbeater.cc:507] Master 127.7.23.126:35493 requested a full tablet report, sending...
I20260709 12:29:29.488327 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:29.488844 14585 raft_consensus.cc:606] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:29.492022 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:29.492468 14753 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:29.492569 14585 raft_consensus.cc:606] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:29.493255 14753 tablet_bootstrap.cc:492] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.493295 14335 ts_manager.cc:194] Re-registered known tserver with Master: c235df55461943efb57e4e02fb605fca (127.7.23.65:35391)
I20260709 12:29:29.493898 14753 ts_tablet_manager.cc:1403] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 12:29:29.495211 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:29.495812 14585 raft_consensus.cc:606] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:29.496151 14753 raft_consensus.cc:359] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.496805 14753 raft_consensus.cc:740] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.496950  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:29:29.497608  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:29.497502 14753 consensus_queue.cc:260] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.498376  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:29.499572 14753 ts_tablet_manager.cc:1434] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:29:29.500376 14753 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.502646 14335 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53086
I20260709 12:29:29.503194 14790 raft_consensus.cc:3060] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.508607 14790 pending_rounds.cc:85] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Aborting all ops after (but not including) 0
I20260709 12:29:29.508870 14790 pending_rounds.cc:107] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:29.509116 14790 raft_consensus.cc:2889] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:29.511811 14817 heartbeater.cc:499] Master 127.7.23.126:35493 was elected leader, sending a full tablet report...
I20260709 12:29:29.514549 14789 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.518520 14753 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:29.519263 14753 tablet_bootstrap.cc:492] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.519774 14753 ts_tablet_manager.cc:1403] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:29:29.521651 14753 raft_consensus.cc:359] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.522135 14753 raft_consensus.cc:740] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.522825 14753 consensus_queue.cc:260] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.524232 14753 ts_tablet_manager.cc:1434] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:29.524868 14753 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.538307 14753 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:29:29.538976 14753 tablet_bootstrap.cc:492] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.539489 14753 ts_tablet_manager.cc:1403] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:29:29.541604 14753 raft_consensus.cc:359] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.542384 14753 raft_consensus.cc:740] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.543056 14753 consensus_queue.cc:260] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.545025 14753 ts_tablet_manager.cc:1434] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:29.545746 14753 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Bootstrap starting.
I20260709 12:29:29.557685 14753 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:29:29.558535 14753 tablet_bootstrap.cc:492] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Bootstrap complete.
I20260709 12:29:29.559000 14753 ts_tablet_manager.cc:1403] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:29:29.560675 14753 raft_consensus.cc:359] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.561153 14753 raft_consensus.cc:740] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c235df55461943efb57e4e02fb605fca, State: Initialized, Role: FOLLOWER
I20260709 12:29:29.561614 14753 consensus_queue.cc:260] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.562995 14753 ts_tablet_manager.cc:1434] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:29:29.570020 14789 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.575153 14789 pending_rounds.cc:85] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Aborting all ops after (but not including) 0
I20260709 12:29:29.575354 14789 pending_rounds.cc:107] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:29.575592 14789 raft_consensus.cc:2889] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:29.699090 14736 raft_consensus.cc:993] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.699529 14833 raft_consensus.cc:1081] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.700913 14510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:29.701375 14510 raft_consensus.cc:493] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:29.701639 14510 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.706496 14510 raft_consensus.cc:515] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.708273 14510 leader_election.cc:290] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:29.709815 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:29.710446 14585 raft_consensus.cc:3055] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:29.710732 14585 raft_consensus.cc:740] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:29.711575 14585 consensus_queue.cc:260] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.712778 14585 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.718911 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:29.719391 14585 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 2.
I20260709 12:29:29.719595 14789 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.720760 14477 leader_election.cc:304] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, a63b6a32d4a643ac84a3f17cbf0bf17e; no voters: 
I20260709 12:29:29.721536 14735 raft_consensus.cc:2804] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:29.722772 14735 raft_consensus.cc:697] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:29.723565 14735 consensus_queue.cc:237] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.726797 14789 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 2.
I20260709 12:29:29.731499 14334 catalog_manager.cc:5697] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 1 to 2, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 2 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:29.747766 14789 raft_consensus.cc:3060] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.827564 14789 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.832669 14789 pending_rounds.cc:85] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Aborting all ops after (but not including) 0
I20260709 12:29:29.832895 14789 pending_rounds.cc:107] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:29:29.833114 14789 raft_consensus.cc:2889] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:29:29.872749 14736 raft_consensus.cc:993] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.873143 14833 raft_consensus.cc:1081] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.874426 14510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:29.874902 14510 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:29.875197 14510 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:29.880117 14510 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.881577 14510 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 3 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:29.882346 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:29.882632 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:29.882887 14789 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:29.883155 14585 raft_consensus.cc:3055] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:29.883522 14585 raft_consensus.cc:740] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:29.884267 14585 consensus_queue.cc:260] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.885197 14585 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:29.887845 14789 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 3.
I20260709 12:29:29.888815 14477 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:29.889434 14735 raft_consensus.cc:2804] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:29.889788 14735 raft_consensus.cc:697] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:29.889922 14585 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 3.
I20260709 12:29:29.890537 14735 consensus_queue.cc:237] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.896950 14334 catalog_manager.cc:5697] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 2 to 3, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 3 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:29.915133 14736 raft_consensus.cc:993] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.915524 14833 raft_consensus.cc:1081] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.916822 14510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:29.917271 14510 raft_consensus.cc:493] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:29.917544 14510 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:29.922699 14510 raft_consensus.cc:515] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.924259 14510 leader_election.cc:290] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 3 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:29.925069 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:29.925366 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad9e3522ad174b5da60922209168ed34" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:29.925726 14789 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:29.925908 14585 raft_consensus.cc:3055] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:29.926309 14585 raft_consensus.cc:740] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:29.927122 14585 consensus_queue.cc:260] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.928370 14585 raft_consensus.cc:3060] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:29.932694 14789 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 3.
I20260709 12:29:29.933806 14477 leader_election.cc:304] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:29.934468 14736 raft_consensus.cc:993] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.934566 14735 raft_consensus.cc:2804] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:29.935146 14735 raft_consensus.cc:697] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:29.935312 14833 raft_consensus.cc:1081] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:29.936041 14735 consensus_queue.cc:237] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.937219 14585 raft_consensus.cc:2468] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 3.
I20260709 12:29:29.937500 14512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:29.938030 14512 raft_consensus.cc:493] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:29.938361 14512 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.944553 14512 raft_consensus.cc:515] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.944653 14334 catalog_manager.cc:5697] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 2 to 3, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 3 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:29.946003 14512 leader_election.cc:290] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:29.946677 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:29.947060 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:29.947335 14789 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.947654 14585 raft_consensus.cc:3055] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:29.947973 14585 raft_consensus.cc:740] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:29.948668 14585 consensus_queue.cc:260] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.949841 14585 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:29.953670 14789 raft_consensus.cc:2468] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 2.
I20260709 12:29:29.954762 14477 leader_election.cc:304] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:29.955381 14735 raft_consensus.cc:2804] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:29.955483 14585 raft_consensus.cc:2468] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 2.
I20260709 12:29:29.955858 14735 raft_consensus.cc:697] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:29.956684 14735 consensus_queue.cc:237] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:29.962805 14334 catalog_manager.cc:5697] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 1 to 2, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 2 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:30.192891 14789 raft_consensus.cc:1275] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:30.194120 14846 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:30.203068 14585 raft_consensus.cc:1275] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:30.205060 14834 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:30.310173 14789 raft_consensus.cc:1275] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:30.311247 14834 consensus_queue.cc:1048] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:30.319303 14585 raft_consensus.cc:1275] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:30.321512 14851 consensus_queue.cc:1048] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:30.365233 14585 raft_consensus.cc:1275] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:30.366472 14851 consensus_queue.cc:1048] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:30.374578 14789 raft_consensus.cc:1275] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:29:30.377647 14834 consensus_queue.cc:1048] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:30.421025 14789 raft_consensus.cc:1275] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:30.422379 14834 consensus_queue.cc:1048] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:30.431463 14585 raft_consensus.cc:1275] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:30.432801 14834 consensus_queue.cc:1048] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:30.484100 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:30.508570  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:30.524376 14512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
mode: GRACEFUL
new_leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:60110
I20260709 12:29:30.524843 14512 raft_consensus.cc:606] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Received request to transfer leadership to TS a63b6a32d4a643ac84a3f17cbf0bf17e
I20260709 12:29:30.527140 14512 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
mode: GRACEFUL
new_leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:60110
I20260709 12:29:30.527585 14512 raft_consensus.cc:606] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Received request to transfer leadership to TS a63b6a32d4a643ac84a3f17cbf0bf17e
I20260709 12:29:30.528468  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:30.528906  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:30.529452  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:30.644039 14735 raft_consensus.cc:993] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c: : Instructing follower a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:30.644574 14834 raft_consensus.cc:1081] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Signalling peer a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:30.645951 14585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:29:30.646430 14585 raft_consensus.cc:493] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:30.646781 14585 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:30.651981 14585 raft_consensus.cc:515] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:30.653712 14585 leader_election.cc:290] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 3 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:30.654366 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:30.654728 14512 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:30.655055 14789 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:30.655306 14512 raft_consensus.cc:3055] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:30.655650 14512 raft_consensus.cc:740] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:30.656366 14512 consensus_queue.cc:260] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:30.657538 14512 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:30.662102 14789 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 3.
I20260709 12:29:30.663265 14551 leader_election.cc:304] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:30.663805 14512 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 3.
I20260709 12:29:30.663950 14843 raft_consensus.cc:2804] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:30.664499 14843 raft_consensus.cc:697] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:30.665822 14843 consensus_queue.cc:237] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:30.671970 14335 catalog_manager.cc:5697] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 2 to 3, leader changed from 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 3 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:30.912472 14834 raft_consensus.cc:993] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c: : Instructing follower a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:30.912905 14735 raft_consensus.cc:1081] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Signalling peer a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:30.914422 14585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:29:30.914880 14585 raft_consensus.cc:493] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:30.915166 14585 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:30.921335 14585 raft_consensus.cc:515] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:30.922963 14585 leader_election.cc:290] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 4 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:30.923695 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:30.923969 14510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "326c0f91b9de4c019cafbdc28206d5cb" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:30.924384 14789 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:30.924597 14510 raft_consensus.cc:3055] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:30.924942 14510 raft_consensus.cc:740] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:30.925726 14510 consensus_queue.cc:260] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:30.926954 14510 raft_consensus.cc:3060] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:30.931491 14789 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 4.
I20260709 12:29:30.932689 14551 leader_election.cc:304] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:30.933277 14833 raft_consensus.cc:2804] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:30.933544 14510 raft_consensus.cc:2468] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 4.
I20260709 12:29:30.933640 14833 raft_consensus.cc:697] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:30.934432 14833 consensus_queue.cc:237] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:30.940377 14335 catalog_manager.cc:5697] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 3 to 4, leader changed from 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 4 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:31.163277 14789 raft_consensus.cc:1275] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:31.164376 14833 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:31.173375 14510 raft_consensus.cc:1275] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:31.176610 14863 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:31.346760 14510 raft_consensus.cc:1275] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:31.348078 14863 consensus_queue.cc:1048] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:31.354856 14789 raft_consensus.cc:1275] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:29:31.356415 14843 consensus_queue.cc:1048] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:29:31.485038 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:31.535897  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:31.543493 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:31.544015 14585 raft_consensus.cc:606] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:31.546322 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:31.546777 14585 raft_consensus.cc:606] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:31.547732  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:31.548197  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:31.548736  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:31.753510 14833 raft_consensus.cc:993] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:31.754536 14833 raft_consensus.cc:1081] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:31.756505 14510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:31.757150 14510 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:31.757473 14510 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:31.765838 14510 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:31.767786 14510 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 3 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:31.768862 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:31.769032 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:31.769651 14585 raft_consensus.cc:3055] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:31.769652 14789 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:31.769948 14585 raft_consensus.cc:740] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:31.770881 14585 consensus_queue.cc:260] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:31.772128 14585 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:31.776800 14789 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 3.
I20260709 12:29:31.777900 14477 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:31.778756 14735 raft_consensus.cc:2804] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:31.779210 14735 raft_consensus.cc:697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:31.779537 14585 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 3.
I20260709 12:29:31.780604 14735 consensus_queue.cc:237] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:31.790376 14334 catalog_manager.cc:5697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 2 to 3, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 3 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:31.988265 14863 raft_consensus.cc:993] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:31.988730 14833 raft_consensus.cc:1081] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:31.990463 14510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:31.991024 14510 raft_consensus.cc:493] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:31.991320 14510 raft_consensus.cc:3060] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:31.997328 14510 raft_consensus.cc:515] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:31.998916 14510 leader_election.cc:290] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:31.999773 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:32.000058 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e447ab06e064c39b7a7be9731db230b" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:32.000424 14789 raft_consensus.cc:3060] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:32.000586 14585 raft_consensus.cc:3055] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:32.000967 14585 raft_consensus.cc:740] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:32.001916 14585 consensus_queue.cc:260] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.003194 14585 raft_consensus.cc:3060] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:32.007552 14789 raft_consensus.cc:2468] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 2.
I20260709 12:29:32.008816 14477 leader_election.cc:304] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:32.009591 14735 raft_consensus.cc:2804] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:32.009939 14585 raft_consensus.cc:2468] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 2.
I20260709 12:29:32.009963 14735 raft_consensus.cc:697] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:32.011147 14735 consensus_queue.cc:237] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.017398 14334 catalog_manager.cc:5697] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 1 to 2, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 2 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:32.245602 14585 raft_consensus.cc:1275] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:32.246781 14735 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:32.260356 14789 raft_consensus.cc:1275] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:32.262606 14870 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:32.438869 14585 raft_consensus.cc:1275] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:32.440209 14878 consensus_queue.cc:1048] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:32.450860 14789 raft_consensus.cc:1275] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:32.454080 14878 consensus_queue.cc:1048] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:29:32.486078 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:32.555097  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:32.563527 14510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
mode: GRACEFUL
new_leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:60110
I20260709 12:29:32.564090 14510 raft_consensus.cc:606] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Received request to transfer leadership to TS a63b6a32d4a643ac84a3f17cbf0bf17e
I20260709 12:29:32.566486 14510 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
mode: GRACEFUL
new_leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:60110
I20260709 12:29:32.566972 14510 raft_consensus.cc:606] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Received request to transfer leadership to TS a63b6a32d4a643ac84a3f17cbf0bf17e
I20260709 12:29:32.567943  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:32.568370  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:32.568989  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:32.632700 14870 raft_consensus.cc:993] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c: : Instructing follower a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:32.633199 14878 raft_consensus.cc:1081] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Signalling peer a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:32.634480 14585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:29:32.634862 14585 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:32.635098 14585 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.639873 14585 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.641386 14585 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 4 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:32.642063 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:32.642426 14510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:32.642674 14789 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.643049 14510 raft_consensus.cc:3055] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:32.643381 14510 raft_consensus.cc:740] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:32.644186 14510 consensus_queue.cc:260] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.645419 14510 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:32.649230 14789 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 4.
I20260709 12:29:32.650389 14551 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:32.651028 14833 raft_consensus.cc:2804] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:32.651531 14833 raft_consensus.cc:697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:32.652184 14510 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 4.
I20260709 12:29:32.652329 14833 consensus_queue.cc:237] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.658563 14335 catalog_manager.cc:5697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 3 to 4, leader changed from 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 4 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:32.893002 14870 raft_consensus.cc:993] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c: : Instructing follower a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:32.893471 14878 raft_consensus.cc:1081] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Signalling peer a63b6a32d4a643ac84a3f17cbf0bf17e to start an election
I20260709 12:29:32.894971 14585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
 from {username='slave'} at 127.0.0.1:52852
I20260709 12:29:32.895467 14585 raft_consensus.cc:493] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:32.895759 14585 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:32.900408 14585 raft_consensus.cc:515] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.901789 14585 leader_election.cc:290] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 3 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925)
I20260709 12:29:32.902458 14789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:32.902750 14510 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b114cb083054d1fb2e2a8d36dfc6339" candidate_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
I20260709 12:29:32.903133 14789 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:32.903309 14510 raft_consensus.cc:3055] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:32.903779 14510 raft_consensus.cc:740] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:32.904704 14510 consensus_queue.cc:260] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.906075 14510 raft_consensus.cc:3060] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:32.909837 14789 raft_consensus.cc:2468] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 3.
I20260709 12:29:32.910931 14551 leader_election.cc:304] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a63b6a32d4a643ac84a3f17cbf0bf17e, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:32.911769 14833 raft_consensus.cc:2804] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:32.912751 14833 raft_consensus.cc:697] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 LEADER]: Becoming Leader. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:32.913064 14510 raft_consensus.cc:2468] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a63b6a32d4a643ac84a3f17cbf0bf17e in term 3.
I20260709 12:29:32.913666 14833 consensus_queue.cc:237] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:32.920439 14335 catalog_manager.cc:5697] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e reported cstate change: term changed from 2 to 3, leader changed from 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66) to a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67). New cstate: current_term: 3 leader_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:33.038271 14510 raft_consensus.cc:1275] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:33.039541 14833 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:33.047586 14789 raft_consensus.cc:1275] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:33.049187 14833 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:33.399530 14510 raft_consensus.cc:1275] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:33.400697 14833 consensus_queue.cc:1048] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:33.409446 14788 raft_consensus.cc:1275] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Refusing update from remote peer a63b6a32d4a643ac84a3f17cbf0bf17e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:33.410869 14889 consensus_queue.cc:1048] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:29:33.486953 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:33.575106  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:33.582894 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:33.583374 14585 raft_consensus.cc:606] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:33.585742 14585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2"
dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
mode: GRACEFUL
new_leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:52872
I20260709 12:29:33.586196 14585 raft_consensus.cc:606] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 LEADER]: Received request to transfer leadership to TS 41c3fbf8372f485b8e7632d00e34bb3c
I20260709 12:29:33.587126  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:33.587596  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:33.588107  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:33.615869 14833 raft_consensus.cc:993] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:33.616428 14833 raft_consensus.cc:1081] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:33.617930 14510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:33.618381 14510 raft_consensus.cc:493] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:33.618661 14510 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.623469 14510 raft_consensus.cc:515] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:33.624763 14510 leader_election.cc:290] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 4 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:33.625607 14788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:33.625790 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7b45bedaf1045298fe817dd247aa6d2" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:33.626143 14788 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.626288 14585 raft_consensus.cc:3055] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:29:33.626619 14585 raft_consensus.cc:740] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:33.627375 14585 consensus_queue.cc:260] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:33.628350 14585 raft_consensus.cc:3060] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:29:33.631835 14788 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 4.
I20260709 12:29:33.632515 14585 raft_consensus.cc:2468] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 4.
I20260709 12:29:33.632880 14477 leader_election.cc:304] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:33.633543 14895 raft_consensus.cc:2804] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:29:33.634406 14895 raft_consensus.cc:697] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:33.635226 14895 consensus_queue.cc:237] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:33.644210 14335 catalog_manager.cc:5697] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 3 to 4, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 4 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:33.993750 14889 raft_consensus.cc:993] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: : Instructing follower 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:33.994181 14833 raft_consensus.cc:1081] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 LEADER]: Signalling peer 41c3fbf8372f485b8e7632d00e34bb3c to start an election
I20260709 12:29:33.995790 14510 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd"
dest_uuid: "41c3fbf8372f485b8e7632d00e34bb3c"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:29:33.996335 14510 raft_consensus.cc:493] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:33.996662 14510 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:34.001788 14510 raft_consensus.cc:515] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:34.003247 14510 leader_election.cc:290] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 5 election: Requested vote from peers c235df55461943efb57e4e02fb605fca (127.7.23.65:35391), a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67:40311)
I20260709 12:29:34.004232 14585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e"
I20260709 12:29:34.004760 14585 raft_consensus.cc:3055] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:29:34.004866 14788 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34d5bc3f3d47415c91881a3cc1cdb9fd" candidate_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c235df55461943efb57e4e02fb605fca"
I20260709 12:29:34.005108 14585 raft_consensus.cc:740] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a63b6a32d4a643ac84a3f17cbf0bf17e, State: Running, Role: LEADER
I20260709 12:29:34.005522 14788 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:34.005925 14585 consensus_queue.cc:260] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:34.007176 14585 raft_consensus.cc:3060] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:29:34.012367 14788 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 5.
I20260709 12:29:34.013499 14477 leader_election.cc:304] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41c3fbf8372f485b8e7632d00e34bb3c, c235df55461943efb57e4e02fb605fca; no voters: 
I20260709 12:29:34.013543 14585 raft_consensus.cc:2468] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41c3fbf8372f485b8e7632d00e34bb3c in term 5.
I20260709 12:29:34.014142 14895 raft_consensus.cc:2804] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:29:34.014598 14895 raft_consensus.cc:697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 5 LEADER]: Becoming Leader. State: Replica: 41c3fbf8372f485b8e7632d00e34bb3c, State: Running, Role: LEADER
I20260709 12:29:34.015272 14895 consensus_queue.cc:237] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } }
I20260709 12:29:34.020745 14335 catalog_manager.cc:5697] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c reported cstate change: term changed from 4 to 5, leader changed from a63b6a32d4a643ac84a3f17cbf0bf17e (127.7.23.67) to 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66). New cstate: current_term: 5 leader_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "41c3fbf8372f485b8e7632d00e34bb3c" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 32925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:34.039975 14788 raft_consensus.cc:1275] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:34.041247 14895 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:34.052850 14585 raft_consensus.cc:1275] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:29:34.054113 14895 consensus_queue.cc:1048] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:34.414938 14788 raft_consensus.cc:1275] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 5 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:29:34.416203 14907 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c235df55461943efb57e4e02fb605fca" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 35391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:29:34.424376 14585 raft_consensus.cc:1275] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 5 FOLLOWER]: Refusing update from remote peer 41c3fbf8372f485b8e7632d00e34bb3c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:29:34.426623 14898 consensus_queue.cc:1048] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a63b6a32d4a643ac84a3f17cbf0bf17e" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 40311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:29:34.487880 14383 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:29:34.594206  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:34.623991  7261 tablet_server.cc:179] TabletServer@127.7.23.65:35391 shutting down...
W20260709 12:29:34.627048 14477 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 74 similar messages]
W20260709 12:29:34.630498 14477 consensus_peers.cc:597] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.649284  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:34.650067  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.650797  7261 raft_consensus.cc:2243] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.651257  7261 raft_consensus.cc:2272] T f7b45bedaf1045298fe817dd247aa6d2 P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.654732  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.655596  7261 raft_consensus.cc:2243] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.656071  7261 raft_consensus.cc:2272] T c9a5927af8e74a01bd7f247943cb568d P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.658283  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.658841  7261 raft_consensus.cc:2243] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.659211  7261 raft_consensus.cc:2272] T 54911476bff5419280f7d784e8ee08b7 P c235df55461943efb57e4e02fb605fca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.661808  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.662302  7261 raft_consensus.cc:2243] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.662818  7261 raft_consensus.cc:2272] T ad9e3522ad174b5da60922209168ed34 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:34.664294 14477 consensus_peers.cc:597] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.665055  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.665690  7261 raft_consensus.cc:2243] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.666113  7261 raft_consensus.cc:2272] T e13b6f96c3774b3b8a0557d72c6e4cd9 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.668390  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.668917  7261 raft_consensus.cc:2243] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.669379  7261 raft_consensus.cc:2272] T 326c0f91b9de4c019cafbdc28206d5cb P c235df55461943efb57e4e02fb605fca [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.671545  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.672049  7261 raft_consensus.cc:2243] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.672458  7261 raft_consensus.cc:2272] T 9b114cb083054d1fb2e2a8d36dfc6339 P c235df55461943efb57e4e02fb605fca [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.674368  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.674877  7261 raft_consensus.cc:2243] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.675300  7261 raft_consensus.cc:2272] T 2902b62029a14bcb9d067182d34c2ae5 P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.677502  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.677949  7261 raft_consensus.cc:2243] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.678368  7261 raft_consensus.cc:2272] T 34d5bc3f3d47415c91881a3cc1cdb9fd P c235df55461943efb57e4e02fb605fca [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.681304  7261 tablet_replica.cc:333] stopping tablet replica
I20260709 12:29:34.681846  7261 raft_consensus.cc:2243] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.682410  7261 raft_consensus.cc:2272] T 2e447ab06e064c39b7a7be9731db230b P c235df55461943efb57e4e02fb605fca [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:34.684053 14551 consensus_peers.cc:597] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.712630  7261 tablet_server.cc:196] TabletServer@127.7.23.65:35391 shutdown complete.
I20260709 12:29:34.738093  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
W20260709 12:29:34.752995 14477 consensus_peers.cc:597] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:34.756340 14550 consensus_peers.cc:597] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Couldn't send request to peer 41c3fbf8372f485b8e7632d00e34bb3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.763619  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:34.764452  7261 tablet_replica.cc:333] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.765389  7261 raft_consensus.cc:2243] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.766024  7261 raft_consensus.cc:2272] T 326c0f91b9de4c019cafbdc28206d5cb P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:34.766350 14550 consensus_peers.cc:597] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Couldn't send request to peer 41c3fbf8372f485b8e7632d00e34bb3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.768571  7261 tablet_replica.cc:333] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.769181  7261 raft_consensus.cc:2243] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.769586  7261 raft_consensus.cc:2272] T 54911476bff5419280f7d784e8ee08b7 P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.771767  7261 tablet_replica.cc:333] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.772300  7261 raft_consensus.cc:2243] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.772640  7261 raft_consensus.cc:2272] T 9b114cb083054d1fb2e2a8d36dfc6339 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.774556  7261 tablet_replica.cc:333] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.775233  7261 raft_consensus.cc:2243] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.776077  7261 raft_consensus.cc:2272] T 2902b62029a14bcb9d067182d34c2ae5 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.778091  7261 tablet_replica.cc:333] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.778735  7261 raft_consensus.cc:2243] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.779481  7261 raft_consensus.cc:2272] T f7b45bedaf1045298fe817dd247aa6d2 P 41c3fbf8372f485b8e7632d00e34bb3c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.781724  7261 tablet_replica.cc:333] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.782253  7261 raft_consensus.cc:2243] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.782987  7261 raft_consensus.cc:2272] T 34d5bc3f3d47415c91881a3cc1cdb9fd P 41c3fbf8372f485b8e7632d00e34bb3c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.785753  7261 tablet_replica.cc:333] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.786231  7261 raft_consensus.cc:2243] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.787066  7261 raft_consensus.cc:2272] T 2e447ab06e064c39b7a7be9731db230b P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:34.787278 14550 consensus_peers.cc:597] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer 41c3fbf8372f485b8e7632d00e34bb3c (127.7.23.66:32925): Couldn't send request to peer 41c3fbf8372f485b8e7632d00e34bb3c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.788998  7261 tablet_replica.cc:333] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.789570  7261 raft_consensus.cc:2243] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.789992  7261 raft_consensus.cc:2272] T e13b6f96c3774b3b8a0557d72c6e4cd9 P 41c3fbf8372f485b8e7632d00e34bb3c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.791996  7261 tablet_replica.cc:333] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.792443  7261 raft_consensus.cc:2243] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.793284  7261 raft_consensus.cc:2272] T ad9e3522ad174b5da60922209168ed34 P 41c3fbf8372f485b8e7632d00e34bb3c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.795823  7261 tablet_replica.cc:333] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c: stopping tablet replica
I20260709 12:29:34.796281  7261 raft_consensus.cc:2243] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.797072  7261 raft_consensus.cc:2272] T c9a5927af8e74a01bd7f247943cb568d P 41c3fbf8372f485b8e7632d00e34bb3c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.829035  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
W20260709 12:29:34.831055 14551 consensus_peers.cc:597] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e -> Peer c235df55461943efb57e4e02fb605fca (127.7.23.65:35391): Couldn't send request to peer c235df55461943efb57e4e02fb605fca. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:35391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:34.852505  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
I20260709 12:29:34.873484  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:34.874181  7261 tablet_replica.cc:333] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.875180  7261 raft_consensus.cc:2243] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.876498  7261 raft_consensus.cc:2272] T e13b6f96c3774b3b8a0557d72c6e4cd9 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.878827  7261 tablet_replica.cc:333] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.879437  7261 raft_consensus.cc:2243] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.879907  7261 raft_consensus.cc:2272] T ad9e3522ad174b5da60922209168ed34 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.881947  7261 tablet_replica.cc:333] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.882433  7261 raft_consensus.cc:2243] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.882851  7261 raft_consensus.cc:2272] T c9a5927af8e74a01bd7f247943cb568d P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.884929  7261 tablet_replica.cc:333] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.885468  7261 raft_consensus.cc:2243] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.885845  7261 raft_consensus.cc:2272] T 34d5bc3f3d47415c91881a3cc1cdb9fd P a63b6a32d4a643ac84a3f17cbf0bf17e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.888379  7261 tablet_replica.cc:333] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.888893  7261 raft_consensus.cc:2243] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.889283  7261 raft_consensus.cc:2272] T 2e447ab06e064c39b7a7be9731db230b P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.891232  7261 tablet_replica.cc:333] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.891741  7261 raft_consensus.cc:2243] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.892587  7261 raft_consensus.cc:2272] T 54911476bff5419280f7d784e8ee08b7 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.894619  7261 tablet_replica.cc:333] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.895074  7261 raft_consensus.cc:2243] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.895538  7261 raft_consensus.cc:2272] T 2902b62029a14bcb9d067182d34c2ae5 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.897373  7261 tablet_replica.cc:333] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.897804  7261 raft_consensus.cc:2243] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.898541  7261 raft_consensus.cc:2272] T 9b114cb083054d1fb2e2a8d36dfc6339 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.900502  7261 tablet_replica.cc:333] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.900957  7261 raft_consensus.cc:2243] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:34.901333  7261 raft_consensus.cc:2272] T f7b45bedaf1045298fe817dd247aa6d2 P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.903678  7261 tablet_replica.cc:333] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e: stopping tablet replica
I20260709 12:29:34.904150  7261 raft_consensus.cc:2243] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.904937  7261 raft_consensus.cc:2272] T 326c0f91b9de4c019cafbdc28206d5cb P a63b6a32d4a643ac84a3f17cbf0bf17e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.934232  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
I20260709 12:29:34.957242  7261 master.cc:562] Master@127.7.23.126:35493 shutting down...
I20260709 12:29:34.976197  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:34.976745  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:34.977092  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P e9f51e07b2c84ce09f498ac27259559d: stopping tablet replica
I20260709 12:29:34.996891  7261 master.cc:584] Master@127.7.23.126:35493 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12691 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:29:35.039438  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:37005
I20260709 12:29:35.040526  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:35.045987 14919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:35.046016 14918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:35.046906 14921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:35.047459  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:35.048300  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:35.048470  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:35.048578  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600175048567 us; error 0 us; skew 500 ppm
I20260709 12:29:35.049027  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:35.051112  7261 webserver.cc:533] Webserver started at http://127.7.23.126:33363/ using document root <none> and password file <none>
I20260709 12:29:35.051596  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:35.051748  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:35.051961  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:35.053308  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "d63098855f1648d2be92bc8ce8bc845c"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.057343  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:29:35.060545 14926 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.061199  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:29:35.061445  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "d63098855f1648d2be92bc8ce8bc845c"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.061699  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:35.083362  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:35.084614  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:35.121452  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:37005
I20260709 12:29:35.121551 14977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:37005 every 8 connection(s)
I20260709 12:29:35.125151 14978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.136250 14978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c: Bootstrap starting.
I20260709 12:29:35.141124 14978 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.145293 14978 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c: No bootstrap required, opened a new log
I20260709 12:29:35.147460 14978 raft_consensus.cc:359] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d63098855f1648d2be92bc8ce8bc845c" member_type: VOTER }
I20260709 12:29:35.147826 14978 raft_consensus.cc:385] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.148013 14978 raft_consensus.cc:740] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d63098855f1648d2be92bc8ce8bc845c, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.148483 14978 consensus_queue.cc:260] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d63098855f1648d2be92bc8ce8bc845c" member_type: VOTER }
I20260709 12:29:35.148885 14978 raft_consensus.cc:399] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:35.149075 14978 raft_consensus.cc:493] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:35.149273 14978 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:35.154043 14978 raft_consensus.cc:515] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d63098855f1648d2be92bc8ce8bc845c" member_type: VOTER }
I20260709 12:29:35.154515 14978 leader_election.cc:304] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d63098855f1648d2be92bc8ce8bc845c; no voters: 
I20260709 12:29:35.155579 14978 leader_election.cc:290] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:35.155962 14981 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:35.157191 14981 raft_consensus.cc:697] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 1 LEADER]: Becoming Leader. State: Replica: d63098855f1648d2be92bc8ce8bc845c, State: Running, Role: LEADER
I20260709 12:29:35.157879 14981 consensus_queue.cc:237] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d63098855f1648d2be92bc8ce8bc845c" member_type: VOTER }
I20260709 12:29:35.158414 14978 sys_catalog.cc:565] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:35.162477 14982 sys_catalog.cc:455] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d63098855f1648d2be92bc8ce8bc845c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d63098855f1648d2be92bc8ce8bc845c" member_type: VOTER } }
I20260709 12:29:35.162505 14983 sys_catalog.cc:455] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d63098855f1648d2be92bc8ce8bc845c. Latest consensus state: current_term: 1 leader_uuid: "d63098855f1648d2be92bc8ce8bc845c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d63098855f1648d2be92bc8ce8bc845c" member_type: VOTER } }
I20260709 12:29:35.163261 14982 sys_catalog.cc:458] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:35.163322 14983 sys_catalog.cc:458] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:35.166087 14988 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:35.170958 14988 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:35.173878  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:35.179075 14988 catalog_manager.cc:1383] Generated new cluster ID: a9f48c970dbe49f69be3386da179f207
I20260709 12:29:35.179306 14988 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:35.223888 14988 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:35.225135 14988 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:35.244135 14988 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c: Generated new TSK 0
I20260709 12:29:35.244745 14988 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:35.305002  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:35.311058 14999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:35.311618 15000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:35.313124 15002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:35.313755  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:35.314661  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:35.314837  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:35.315011  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600175314991 us; error 0 us; skew 500 ppm
I20260709 12:29:35.315593  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:35.317713  7261 webserver.cc:533] Webserver started at http://127.7.23.65:33663/ using document root <none> and password file <none>
I20260709 12:29:35.318145  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:35.318331  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:35.318578  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:35.319700  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "aa986d67093943dca6eb6346e0ccd863"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.324059  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:29:35.327255 15007 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.327991  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:29:35.328258  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "aa986d67093943dca6eb6346e0ccd863"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.328523  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:35.356035  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:35.357264  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:35.358716  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:35.360985  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:35.361171  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.361392  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:35.361559  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.400328  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:36703
I20260709 12:29:35.400475 15069 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:36703 every 8 connection(s)
I20260709 12:29:35.405149  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:35.412000 15074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:35.414722 15077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:35.415434 15075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:35.416008  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:35.417245 15070 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37005
I20260709 12:29:35.417325  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:35.417620  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:35.417630 15070 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:35.417840  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600175417826 us; error 0 us; skew 500 ppm
I20260709 12:29:35.418457 15070 heartbeater.cc:507] Master 127.7.23.126:37005 requested a full tablet report, sending...
I20260709 12:29:35.418516  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:35.420559 14943 ts_manager.cc:194] Registered new tserver with Master: aa986d67093943dca6eb6346e0ccd863 (127.7.23.65:36703)
I20260709 12:29:35.421198  7261 webserver.cc:533] Webserver started at http://127.7.23.66:38993/ using document root <none> and password file <none>
I20260709 12:29:35.421689  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:35.421865  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:35.422092  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:35.422411 14943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36030
I20260709 12:29:35.423257  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "43bbbc1599c444c8b82fccf8747df97f"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.427913  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:29:35.431119 15082 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.431906  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:29:35.432178  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "43bbbc1599c444c8b82fccf8747df97f"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.432476  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:35.447966  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:35.449132  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:35.450542  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:35.452634  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:35.452834  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.453047  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:35.453193  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.491431  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:45081
I20260709 12:29:35.491549 15144 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:45081 every 8 connection(s)
I20260709 12:29:35.496001  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:35.502838 15148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:35.503384 15149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:35.505708  7261 server_base.cc:1061] running on GCE node
W20260709 12:29:35.506187 15151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:35.508037 15145 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37005
I20260709 12:29:35.508098  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:35.508464  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:35.508503 15145 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:35.508633  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600175508617 us; error 0 us; skew 500 ppm
I20260709 12:29:35.509316  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:35.509371 15145 heartbeater.cc:507] Master 127.7.23.126:37005 requested a full tablet report, sending...
I20260709 12:29:35.511487 14943 ts_manager.cc:194] Registered new tserver with Master: 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081)
I20260709 12:29:35.511842  7261 webserver.cc:533] Webserver started at http://127.7.23.67:43807/ using document root <none> and password file <none>
I20260709 12:29:35.512353  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:35.512533  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:35.512761  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:35.512948 14943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36036
I20260709 12:29:35.514058  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "166f5b43de624c759710ab9035b63c83"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.518432  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:35.521632 15156 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.522341  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:35.522614  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "166f5b43de624c759710ab9035b63c83"
format_stamp: "Formatted at 2026-07-09 12:29:35 on dist-test-slave-ps85"
I20260709 12:29:35.522869  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:35.545969  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:35.547180  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:35.548586  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:35.550742  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:35.550931  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.551151  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:35.551311  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:35.589712  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:43905
I20260709 12:29:35.589826 15218 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:43905 every 8 connection(s)
I20260709 12:29:35.602607 15219 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37005
I20260709 12:29:35.603026 15219 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:35.603803 15219 heartbeater.cc:507] Master 127.7.23.126:37005 requested a full tablet report, sending...
I20260709 12:29:35.605559 14943 ts_manager.cc:194] Registered new tserver with Master: 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905)
I20260709 12:29:35.605659  7261 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013143918s
I20260709 12:29:35.606897 14943 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36048
I20260709 12:29:35.628691 14943 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36062:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:35.630779 14943 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:35.678081 15184 tablet_service.cc:1511] Processing CreateTablet for tablet fc327bf0d9ad436e8fb8cad2730ad25b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=78aac715a9cf4debaf877c15e9cee2d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:35.679536 15184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc327bf0d9ad436e8fb8cad2730ad25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.684391 15183 tablet_service.cc:1511] Processing CreateTablet for tablet d5ef185e5b734630b620dbab698b61da (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=78aac715a9cf4debaf877c15e9cee2d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:35.685818 15183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ef185e5b734630b620dbab698b61da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.687757 15035 tablet_service.cc:1511] Processing CreateTablet for tablet fc327bf0d9ad436e8fb8cad2730ad25b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=78aac715a9cf4debaf877c15e9cee2d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:35.689049 15035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc327bf0d9ad436e8fb8cad2730ad25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.693290 15110 tablet_service.cc:1511] Processing CreateTablet for tablet fc327bf0d9ad436e8fb8cad2730ad25b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=78aac715a9cf4debaf877c15e9cee2d0]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:35.694465 15110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc327bf0d9ad436e8fb8cad2730ad25b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.694943 15109 tablet_service.cc:1511] Processing CreateTablet for tablet d5ef185e5b734630b620dbab698b61da (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=78aac715a9cf4debaf877c15e9cee2d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:35.696213 15109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ef185e5b734630b620dbab698b61da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.706110 15034 tablet_service.cc:1511] Processing CreateTablet for tablet d5ef185e5b734630b620dbab698b61da (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=78aac715a9cf4debaf877c15e9cee2d0]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:35.707444 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5ef185e5b734630b620dbab698b61da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.713147 15234 tablet_bootstrap.cc:492] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83: Bootstrap starting.
I20260709 12:29:35.721123 15234 tablet_bootstrap.cc:654] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.726694 15235 tablet_bootstrap.cc:492] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f: Bootstrap starting.
I20260709 12:29:35.728269 15237 tablet_bootstrap.cc:492] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863: Bootstrap starting.
I20260709 12:29:35.731603 15234 tablet_bootstrap.cc:492] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83: No bootstrap required, opened a new log
I20260709 12:29:35.732072 15234 ts_tablet_manager.cc:1403] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:29:35.734086 15235 tablet_bootstrap.cc:654] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.735159 15234 raft_consensus.cc:359] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.735770 15234 raft_consensus.cc:385] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.735942 15237 tablet_bootstrap.cc:654] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.736007 15234 raft_consensus.cc:740] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166f5b43de624c759710ab9035b63c83, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.736883 15234 consensus_queue.cc:260] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.739840 15235 tablet_bootstrap.cc:492] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f: No bootstrap required, opened a new log
I20260709 12:29:35.740350 15235 ts_tablet_manager.cc:1403] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.005s
I20260709 12:29:35.740492 15219 heartbeater.cc:499] Master 127.7.23.126:37005 was elected leader, sending a full tablet report...
I20260709 12:29:35.740947 15234 ts_tablet_manager.cc:1434] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:35.741950 15234 tablet_bootstrap.cc:492] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83: Bootstrap starting.
I20260709 12:29:35.742717 15235 raft_consensus.cc:359] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.743337 15235 raft_consensus.cc:385] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.743727 15235 raft_consensus.cc:740] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43bbbc1599c444c8b82fccf8747df97f, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.745048 15237 tablet_bootstrap.cc:492] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863: No bootstrap required, opened a new log
I20260709 12:29:35.744612 15235 consensus_queue.cc:260] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.745610 15237 ts_tablet_manager.cc:1403] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 12:29:35.749480 15234 tablet_bootstrap.cc:654] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.750484 15237 raft_consensus.cc:359] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.751264 15237 raft_consensus.cc:385] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.751639 15237 raft_consensus.cc:740] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.752564 15237 consensus_queue.cc:260] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.754736 15145 heartbeater.cc:499] Master 127.7.23.126:37005 was elected leader, sending a full tablet report...
I20260709 12:29:35.755745 15235 ts_tablet_manager.cc:1434] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.013s
I20260709 12:29:35.756799 15235 tablet_bootstrap.cc:492] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f: Bootstrap starting.
I20260709 12:29:35.762923 15235 tablet_bootstrap.cc:654] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.765830 15234 tablet_bootstrap.cc:492] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83: No bootstrap required, opened a new log
I20260709 12:29:35.766469 15234 ts_tablet_manager.cc:1403] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.009s
I20260709 12:29:35.767714 15070 heartbeater.cc:499] Master 127.7.23.126:37005 was elected leader, sending a full tablet report...
I20260709 12:29:35.768342 15237 ts_tablet_manager.cc:1434] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863: Time spent starting tablet: real 0.022s	user 0.014s	sys 0.006s
I20260709 12:29:35.769747 15237 tablet_bootstrap.cc:492] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863: Bootstrap starting.
I20260709 12:29:35.772754 15234 raft_consensus.cc:359] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.773593 15234 raft_consensus.cc:385] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.773934 15234 raft_consensus.cc:740] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166f5b43de624c759710ab9035b63c83, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.774820 15234 consensus_queue.cc:260] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.776710 15237 tablet_bootstrap.cc:654] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.777093 15234 ts_tablet_manager.cc:1434] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:29:35.780835 15239 raft_consensus.cc:493] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.781474 15239 raft_consensus.cc:515] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.782711 15237 tablet_bootstrap.cc:492] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863: No bootstrap required, opened a new log
I20260709 12:29:35.783188 15237 ts_tablet_manager.cc:1403] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.002s
I20260709 12:29:35.786145 15237 raft_consensus.cc:359] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.786873 15237 raft_consensus.cc:385] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.787101 15237 raft_consensus.cc:740] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.787747 15237 consensus_queue.cc:260] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.790082 15237 ts_tablet_manager.cc:1434] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:35.788357 15239 leader_election.cc:290] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa986d67093943dca6eb6346e0ccd863 (127.7.23.65:36703), 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081)
I20260709 12:29:35.796072 15045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef185e5b734630b620dbab698b61da" candidate_uuid: "166f5b43de624c759710ab9035b63c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa986d67093943dca6eb6346e0ccd863" is_pre_election: true
I20260709 12:29:35.796803 15045 raft_consensus.cc:2468] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 166f5b43de624c759710ab9035b63c83 in term 0.
I20260709 12:29:35.798169 15158 leader_election.cc:304] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f5b43de624c759710ab9035b63c83, aa986d67093943dca6eb6346e0ccd863; no voters: 
I20260709 12:29:35.799029 15239 raft_consensus.cc:2804] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:35.799431 15239 raft_consensus.cc:493] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:35.799755 15239 raft_consensus.cc:3060] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:35.803471 15235 tablet_bootstrap.cc:492] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f: No bootstrap required, opened a new log
I20260709 12:29:35.803973 15235 ts_tablet_manager.cc:1403] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.007s
I20260709 12:29:35.806191 15235 raft_consensus.cc:359] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.806844 15235 raft_consensus.cc:385] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.807176 15235 raft_consensus.cc:740] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43bbbc1599c444c8b82fccf8747df97f, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.807950 15235 consensus_queue.cc:260] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.808437 15120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef185e5b734630b620dbab698b61da" candidate_uuid: "166f5b43de624c759710ab9035b63c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43bbbc1599c444c8b82fccf8747df97f" is_pre_election: true
I20260709 12:29:35.808676 15239 raft_consensus.cc:515] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.809250 15120 raft_consensus.cc:2468] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 166f5b43de624c759710ab9035b63c83 in term 0.
I20260709 12:29:35.809787 15235 ts_tablet_manager.cc:1434] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:29:35.811147 15239 leader_election.cc:290] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [CANDIDATE]: Term 1 election: Requested vote from peers aa986d67093943dca6eb6346e0ccd863 (127.7.23.65:36703), 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081)
I20260709 12:29:35.811255 15045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef185e5b734630b620dbab698b61da" candidate_uuid: "166f5b43de624c759710ab9035b63c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa986d67093943dca6eb6346e0ccd863"
I20260709 12:29:35.811949 15045 raft_consensus.cc:3060] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:35.812110 15120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5ef185e5b734630b620dbab698b61da" candidate_uuid: "166f5b43de624c759710ab9035b63c83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43bbbc1599c444c8b82fccf8747df97f"
I20260709 12:29:35.812672 15120 raft_consensus.cc:3060] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:35.818500 15120 raft_consensus.cc:2468] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 166f5b43de624c759710ab9035b63c83 in term 1.
I20260709 12:29:35.818492 15045 raft_consensus.cc:2468] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 166f5b43de624c759710ab9035b63c83 in term 1.
I20260709 12:29:35.819463 15157 leader_election.cc:304] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f5b43de624c759710ab9035b63c83, 43bbbc1599c444c8b82fccf8747df97f; no voters: 
I20260709 12:29:35.820051 15243 raft_consensus.cc:493] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:35.820297 15239 raft_consensus.cc:2804] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:35.820565 15243 raft_consensus.cc:515] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.821686 15239 raft_consensus.cc:697] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 1 LEADER]: Becoming Leader. State: Replica: 166f5b43de624c759710ab9035b63c83, State: Running, Role: LEADER
I20260709 12:29:35.822602 15239 consensus_queue.cc:237] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.823129 15243 leader_election.cc:290] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905), 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081)
I20260709 12:29:35.832556 14941 catalog_manager.cc:5697] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 reported cstate change: term changed from 0 to 1, leader changed from <none> to 166f5b43de624c759710ab9035b63c83 (127.7.23.67). New cstate: current_term: 1 leader_uuid: "166f5b43de624c759710ab9035b63c83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:35.836634 15120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc327bf0d9ad436e8fb8cad2730ad25b" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43bbbc1599c444c8b82fccf8747df97f" is_pre_election: true
I20260709 12:29:35.836712 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc327bf0d9ad436e8fb8cad2730ad25b" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f5b43de624c759710ab9035b63c83" is_pre_election: true
I20260709 12:29:35.837522 15120 raft_consensus.cc:2468] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 0.
I20260709 12:29:35.837558 15194 raft_consensus.cc:2468] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 0.
I20260709 12:29:35.838644 15008 leader_election.cc:304] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43bbbc1599c444c8b82fccf8747df97f, aa986d67093943dca6eb6346e0ccd863; no voters: 
I20260709 12:29:35.839457 15243 raft_consensus.cc:2804] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:35.839886 15243 raft_consensus.cc:493] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:35.840224 15243 raft_consensus.cc:3060] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:35.846105 15243 raft_consensus.cc:515] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.847714 15243 leader_election.cc:290] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 election: Requested vote from peers 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905), 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081)
I20260709 12:29:35.848460 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc327bf0d9ad436e8fb8cad2730ad25b" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f5b43de624c759710ab9035b63c83"
I20260709 12:29:35.848575 15120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc327bf0d9ad436e8fb8cad2730ad25b" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43bbbc1599c444c8b82fccf8747df97f"
I20260709 12:29:35.848989 15194 raft_consensus.cc:3060] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:35.849089 15120 raft_consensus.cc:3060] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:35.854463 15120 raft_consensus.cc:2468] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 1.
I20260709 12:29:35.855095 15194 raft_consensus.cc:2468] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 1.
I20260709 12:29:35.855298 15008 leader_election.cc:304] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43bbbc1599c444c8b82fccf8747df97f, aa986d67093943dca6eb6346e0ccd863; no voters: 
I20260709 12:29:35.856073 15243 raft_consensus.cc:2804] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:35.856863 15243 raft_consensus.cc:697] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 1 LEADER]: Becoming Leader. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Running, Role: LEADER
I20260709 12:29:35.857613 15243 consensus_queue.cc:237] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } }
I20260709 12:29:35.864221 14941 catalog_manager.cc:5697] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa986d67093943dca6eb6346e0ccd863 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "aa986d67093943dca6eb6346e0ccd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:35.913926 14941 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36074:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:35.915817 14941 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:35.937469 15034 tablet_service.cc:1511] Processing CreateTablet for tablet 8d09d70c637142d5992314e4977fd6b0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8fc26af84fad444898d0e82f485b9e89]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:35.938668 15109 tablet_service.cc:1511] Processing CreateTablet for tablet 8d09d70c637142d5992314e4977fd6b0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8fc26af84fad444898d0e82f485b9e89]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:35.940183 15109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d09d70c637142d5992314e4977fd6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.940594 15183 tablet_service.cc:1511] Processing CreateTablet for tablet 8d09d70c637142d5992314e4977fd6b0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8fc26af84fad444898d0e82f485b9e89]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:29:35.941906 15183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d09d70c637142d5992314e4977fd6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.942148 15035 tablet_service.cc:1511] Processing CreateTablet for tablet 465e21a6ce0b468480ffba6033e9fcb8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8fc26af84fad444898d0e82f485b9e89]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:35.938757 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d09d70c637142d5992314e4977fd6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.944484 15110 tablet_service.cc:1511] Processing CreateTablet for tablet 465e21a6ce0b468480ffba6033e9fcb8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8fc26af84fad444898d0e82f485b9e89]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:35.945010 15184 tablet_service.cc:1511] Processing CreateTablet for tablet 465e21a6ce0b468480ffba6033e9fcb8 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=8fc26af84fad444898d0e82f485b9e89]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:29:35.945669 15110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465e21a6ce0b468480ffba6033e9fcb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.946180 15184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465e21a6ce0b468480ffba6033e9fcb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.948167 15035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465e21a6ce0b468480ffba6033e9fcb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:35.957643 15234 tablet_bootstrap.cc:492] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83: Bootstrap starting.
I20260709 12:29:35.960788 15237 tablet_bootstrap.cc:492] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863: Bootstrap starting.
I20260709 12:29:35.966533 15235 tablet_bootstrap.cc:492] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: Bootstrap starting.
I20260709 12:29:35.974007 15235 tablet_bootstrap.cc:654] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.975610 15237 tablet_bootstrap.cc:654] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.975692 15234 tablet_bootstrap.cc:654] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.981572 15237 tablet_bootstrap.cc:492] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863: No bootstrap required, opened a new log
I20260709 12:29:35.981895 15234 tablet_bootstrap.cc:492] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83: No bootstrap required, opened a new log
I20260709 12:29:35.981997 15235 tablet_bootstrap.cc:492] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: No bootstrap required, opened a new log
I20260709 12:29:35.982082 15237 ts_tablet_manager.cc:1403] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.005s
I20260709 12:29:35.982450 15234 ts_tablet_manager.cc:1403] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 12:29:35.982589 15235 ts_tablet_manager.cc:1403] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.008s
I20260709 12:29:35.985194 15235 raft_consensus.cc:359] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.985710 15235 raft_consensus.cc:385] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.985510 15234 raft_consensus.cc:359] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.986056 15235 raft_consensus.cc:740] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43bbbc1599c444c8b82fccf8747df97f, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.986316 15234 raft_consensus.cc:385] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.986687 15234 raft_consensus.cc:740] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166f5b43de624c759710ab9035b63c83, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.986832 15235 consensus_queue.cc:260] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.986997 15237 raft_consensus.cc:359] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.987475 15234 consensus_queue.cc:260] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.988119 15237 raft_consensus.cc:385] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:35.988454 15237 raft_consensus.cc:740] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Initialized, Role: FOLLOWER
I20260709 12:29:35.988965 15235 ts_tablet_manager.cc:1434] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:35.989298 15237 consensus_queue.cc:260] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:35.990020 15235 tablet_bootstrap.cc:492] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f: Bootstrap starting.
I20260709 12:29:35.994741 15237 ts_tablet_manager.cc:1434] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:29:35.997211 15235 tablet_bootstrap.cc:654] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:35.997550 15237 tablet_bootstrap.cc:492] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863: Bootstrap starting.
I20260709 12:29:36.004401 15237 tablet_bootstrap.cc:654] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:36.009389 15234 ts_tablet_manager.cc:1434] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:29:36.009991 15235 tablet_bootstrap.cc:492] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f: No bootstrap required, opened a new log
I20260709 12:29:36.010989 15235 ts_tablet_manager.cc:1403] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.002s
I20260709 12:29:36.011397 15234 tablet_bootstrap.cc:492] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83: Bootstrap starting.
I20260709 12:29:36.012610 15237 tablet_bootstrap.cc:492] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863: No bootstrap required, opened a new log
I20260709 12:29:36.013150 15237 ts_tablet_manager.cc:1403] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:29:36.014073 15235 raft_consensus.cc:359] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.014886 15235 raft_consensus.cc:385] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:36.015213 15235 raft_consensus.cc:740] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43bbbc1599c444c8b82fccf8747df97f, State: Initialized, Role: FOLLOWER
I20260709 12:29:36.016005 15235 consensus_queue.cc:260] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.016185 15237 raft_consensus.cc:359] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.016898 15237 raft_consensus.cc:385] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:36.017241 15237 raft_consensus.cc:740] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Initialized, Role: FOLLOWER
I20260709 12:29:36.018446 15235 ts_tablet_manager.cc:1434] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:29:36.018122 15237 consensus_queue.cc:260] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.019732 15234 tablet_bootstrap.cc:654] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:36.020324 15237 ts_tablet_manager.cc:1434] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:36.026218 15234 tablet_bootstrap.cc:492] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83: No bootstrap required, opened a new log
I20260709 12:29:36.026785 15241 raft_consensus.cc:493] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:36.026808 15234 ts_tablet_manager.cc:1403] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:29:36.027314 15241 raft_consensus.cc:515] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.031208 15241 leader_election.cc:290] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa986d67093943dca6eb6346e0ccd863 (127.7.23.65:36703), 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905)
I20260709 12:29:36.030793 15234 raft_consensus.cc:359] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.032382 15234 raft_consensus.cc:385] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:36.032770 15234 raft_consensus.cc:740] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 166f5b43de624c759710ab9035b63c83, State: Initialized, Role: FOLLOWER
I20260709 12:29:36.034062 15234 consensus_queue.cc:260] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.038914 15234 ts_tablet_manager.cc:1434] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:29:36.045089 15243 raft_consensus.cc:493] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:36.045646 15243 raft_consensus.cc:515] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.047668 15243 leader_election.cc:290] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081), 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905)
I20260709 12:29:36.049978 15120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d09d70c637142d5992314e4977fd6b0" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43bbbc1599c444c8b82fccf8747df97f" is_pre_election: true
I20260709 12:29:36.050630 15120 raft_consensus.cc:2468] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 0.
I20260709 12:29:36.051527 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d09d70c637142d5992314e4977fd6b0" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f5b43de624c759710ab9035b63c83" is_pre_election: true
I20260709 12:29:36.052217 15194 raft_consensus.cc:2468] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 0.
I20260709 12:29:36.053751 15008 leader_election.cc:304] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43bbbc1599c444c8b82fccf8747df97f, aa986d67093943dca6eb6346e0ccd863; no voters: 
I20260709 12:29:36.054374 15243 raft_consensus.cc:2804] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:36.054402 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "43bbbc1599c444c8b82fccf8747df97f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f5b43de624c759710ab9035b63c83" is_pre_election: true
I20260709 12:29:36.054864 15243 raft_consensus.cc:493] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:36.055101 15194 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43bbbc1599c444c8b82fccf8747df97f in term 0.
I20260709 12:29:36.055285 15243 raft_consensus.cc:3060] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:36.055555 15045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "43bbbc1599c444c8b82fccf8747df97f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa986d67093943dca6eb6346e0ccd863" is_pre_election: true
I20260709 12:29:36.056063 15083 leader_election.cc:304] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f5b43de624c759710ab9035b63c83, 43bbbc1599c444c8b82fccf8747df97f; no voters: 
I20260709 12:29:36.056193 15045 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43bbbc1599c444c8b82fccf8747df97f in term 0.
I20260709 12:29:36.056754 15241 raft_consensus.cc:2804] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:36.057092 15241 raft_consensus.cc:493] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:36.057435 15241 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:36.061560 15243 raft_consensus.cc:515] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.063149 15241 raft_consensus.cc:515] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.063148 15243 leader_election.cc:290] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 election: Requested vote from peers 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081), 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905)
I20260709 12:29:36.064049 15120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d09d70c637142d5992314e4977fd6b0" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "43bbbc1599c444c8b82fccf8747df97f"
I20260709 12:29:36.064365 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d09d70c637142d5992314e4977fd6b0" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f5b43de624c759710ab9035b63c83"
I20260709 12:29:36.064677 15120 raft_consensus.cc:3060] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:36.064954 15194 raft_consensus.cc:3060] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:36.065610 15241 leader_election.cc:290] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [CANDIDATE]: Term 1 election: Requested vote from peers aa986d67093943dca6eb6346e0ccd863 (127.7.23.65:36703), 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905)
I20260709 12:29:36.066301 15045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "43bbbc1599c444c8b82fccf8747df97f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa986d67093943dca6eb6346e0ccd863"
I20260709 12:29:36.066608 15193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "43bbbc1599c444c8b82fccf8747df97f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "166f5b43de624c759710ab9035b63c83"
I20260709 12:29:36.067111 15193 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:36.071642 15045 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:36.072038 15194 raft_consensus.cc:2468] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 1.
I20260709 12:29:36.072094 15120 raft_consensus.cc:2468] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 1.
I20260709 12:29:36.072427 15193 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43bbbc1599c444c8b82fccf8747df97f in term 1.
I20260709 12:29:36.073410 15008 leader_election.cc:304] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43bbbc1599c444c8b82fccf8747df97f, aa986d67093943dca6eb6346e0ccd863; no voters: 
I20260709 12:29:36.073607 15083 leader_election.cc:304] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f5b43de624c759710ab9035b63c83, 43bbbc1599c444c8b82fccf8747df97f; no voters: 
I20260709 12:29:36.074385 15241 raft_consensus.cc:2804] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:36.074790 15243 raft_consensus.cc:2804] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:36.075217 15243 raft_consensus.cc:697] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 1 LEADER]: Becoming Leader. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Running, Role: LEADER
I20260709 12:29:36.076053 15243 consensus_queue.cc:237] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.078588 15045 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43bbbc1599c444c8b82fccf8747df97f in term 1.
I20260709 12:29:36.081133 15241 raft_consensus.cc:697] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 LEADER]: Becoming Leader. State: Replica: 43bbbc1599c444c8b82fccf8747df97f, State: Running, Role: LEADER
I20260709 12:29:36.082036 15241 consensus_queue.cc:237] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.084003 14942 catalog_manager.cc:5697] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa986d67093943dca6eb6346e0ccd863 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "aa986d67093943dca6eb6346e0ccd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:36.089792 14941 catalog_manager.cc:5697] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f reported cstate change: term changed from 0 to 1, leader changed from <none> to 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66). New cstate: current_term: 1 leader_uuid: "43bbbc1599c444c8b82fccf8747df97f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:36.127679 15120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8"
dest_uuid: "43bbbc1599c444c8b82fccf8747df97f"
mode: GRACEFUL
new_leader_uuid: "aa986d67093943dca6eb6346e0ccd863"
 from {username='slave'} at 127.0.0.1:48068
I20260709 12:29:36.128198 15120 raft_consensus.cc:606] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 LEADER]: Received request to transfer leadership to TS aa986d67093943dca6eb6346e0ccd863
I20260709 12:29:36.258133 15243 consensus_queue.cc:1048] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:36.270813 15250 consensus_queue.cc:1048] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:36.276670 15239 consensus_queue.cc:1048] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:36.295017 15247 consensus_queue.cc:1048] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:36.471230 15243 consensus_queue.cc:1048] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:36.481657 15278 consensus_queue.cc:1048] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:36.546142 15241 consensus_queue.cc:1048] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [LEADER]: Connected to new peer: Peer: permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:36.557407 15241 consensus_queue.cc:1048] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:36.570842 15265 raft_consensus.cc:993] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: : Instructing follower aa986d67093943dca6eb6346e0ccd863 to start an election
I20260709 12:29:36.571247 15281 raft_consensus.cc:1081] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 LEADER]: Signalling peer aa986d67093943dca6eb6346e0ccd863 to start an election
I20260709 12:29:36.572772 15045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8"
dest_uuid: "aa986d67093943dca6eb6346e0ccd863"
 from {username='slave'} at 127.0.0.1:59318
I20260709 12:29:36.573328 15045 raft_consensus.cc:493] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:36.573762 15045 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:36.578666 15045 raft_consensus.cc:515] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.580246 15045 leader_election.cc:290] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 2 election: Requested vote from peers 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66:45081), 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905)
I20260709 12:29:36.581125 15120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "43bbbc1599c444c8b82fccf8747df97f"
I20260709 12:29:36.581334 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "aa986d67093943dca6eb6346e0ccd863" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "166f5b43de624c759710ab9035b63c83"
I20260709 12:29:36.581755 15120 raft_consensus.cc:3055] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:36.581972 15194 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:36.582190 15120 raft_consensus.cc:740] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 43bbbc1599c444c8b82fccf8747df97f, State: Running, Role: LEADER
I20260709 12:29:36.583102 15120 consensus_queue.cc:260] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.584403 15120 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:36.587198 15194 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 2.
I20260709 12:29:36.588198 15008 leader_election.cc:304] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f5b43de624c759710ab9035b63c83, aa986d67093943dca6eb6346e0ccd863; no voters: 
I20260709 12:29:36.588842 15278 raft_consensus.cc:2804] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:36.589306 15278 raft_consensus.cc:697] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 LEADER]: Becoming Leader. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Running, Role: LEADER
I20260709 12:29:36.589427 15120 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa986d67093943dca6eb6346e0ccd863 in term 2.
I20260709 12:29:36.590143 15278 consensus_queue.cc:237] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:36.595803 14940 catalog_manager.cc:5697] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 reported cstate change: term changed from 1 to 2, leader changed from 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66) to aa986d67093943dca6eb6346e0ccd863 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "aa986d67093943dca6eb6346e0ccd863" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:36.850622  7261 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:29:36.852519  7261 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:29:36.852988  7261 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:29:36.864157 15045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8"
dest_uuid: "aa986d67093943dca6eb6346e0ccd863"
mode: GRACEFUL
new_leader_uuid: "43bbbc1599c444c8b82fccf8747df97f"
 from {username='slave'} at 127.0.0.1:59324
I20260709 12:29:36.864617 15045 raft_consensus.cc:606] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 LEADER]: Received request to transfer leadership to TS 43bbbc1599c444c8b82fccf8747df97f
I20260709 12:29:36.865723  7261 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:29:37.023257 15194 raft_consensus.cc:1275] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 2 FOLLOWER]: Refusing update from remote peer aa986d67093943dca6eb6346e0ccd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:37.024510 15278 consensus_queue.cc:1048] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:37.031776 15120 raft_consensus.cc:1275] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 2 FOLLOWER]: Refusing update from remote peer aa986d67093943dca6eb6346e0ccd863: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:37.033604 15243 consensus_queue.cc:1048] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [LEADER]: Connected to new peer: Peer: permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:37.039222 15250 raft_consensus.cc:993] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863: : Instructing follower 43bbbc1599c444c8b82fccf8747df97f to start an election
I20260709 12:29:37.039709 15250 raft_consensus.cc:1081] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 LEADER]: Signalling peer 43bbbc1599c444c8b82fccf8747df97f to start an election
I20260709 12:29:37.041109 15120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8"
dest_uuid: "43bbbc1599c444c8b82fccf8747df97f"
 from {username='slave'} at 127.0.0.1:48066
I20260709 12:29:37.041661 15120 raft_consensus.cc:493] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:37.042039 15120 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:37.047442 15120 raft_consensus.cc:515] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:37.049691 15120 leader_election.cc:290] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [CANDIDATE]: Term 3 election: Requested vote from peers aa986d67093943dca6eb6346e0ccd863 (127.7.23.65:36703), 166f5b43de624c759710ab9035b63c83 (127.7.23.67:43905)
I20260709 12:29:37.049916 15045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "43bbbc1599c444c8b82fccf8747df97f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa986d67093943dca6eb6346e0ccd863"
I20260709 12:29:37.050631 15045 raft_consensus.cc:3055] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:37.050315 15194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465e21a6ce0b468480ffba6033e9fcb8" candidate_uuid: "43bbbc1599c444c8b82fccf8747df97f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "166f5b43de624c759710ab9035b63c83"
I20260709 12:29:37.051113 15045 raft_consensus.cc:740] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa986d67093943dca6eb6346e0ccd863, State: Running, Role: LEADER
I20260709 12:29:37.051330 15194 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:37.052055 15045 consensus_queue.cc:260] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:37.053329 15045 raft_consensus.cc:3060] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:37.058533 15194 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43bbbc1599c444c8b82fccf8747df97f in term 3.
I20260709 12:29:37.059913 15083 leader_election.cc:304] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 166f5b43de624c759710ab9035b63c83, 43bbbc1599c444c8b82fccf8747df97f; no voters: 
I20260709 12:29:37.060295 15045 raft_consensus.cc:2468] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43bbbc1599c444c8b82fccf8747df97f in term 3.
I20260709 12:29:37.060729 15281 raft_consensus.cc:2804] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:37.061241 15281 raft_consensus.cc:697] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 3 LEADER]: Becoming Leader. State: Replica: 43bbbc1599c444c8b82fccf8747df97f, State: Running, Role: LEADER
I20260709 12:29:37.062021 15281 consensus_queue.cc:237] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } }
I20260709 12:29:37.068475 14940 catalog_manager.cc:5697] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f reported cstate change: term changed from 2 to 3, leader changed from aa986d67093943dca6eb6346e0ccd863 (127.7.23.65) to 43bbbc1599c444c8b82fccf8747df97f (127.7.23.66). New cstate: current_term: 3 leader_uuid: "43bbbc1599c444c8b82fccf8747df97f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa986d67093943dca6eb6346e0ccd863" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 36703 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43bbbc1599c444c8b82fccf8747df97f" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 45081 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "166f5b43de624c759710ab9035b63c83" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 43905 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:37.206429  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
I20260709 12:29:37.225406  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:37.226102  7261 tablet_replica.cc:333] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863: stopping tablet replica
I20260709 12:29:37.226694  7261 raft_consensus.cc:2243] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.227219  7261 raft_consensus.cc:2272] T 465e21a6ce0b468480ffba6033e9fcb8 P aa986d67093943dca6eb6346e0ccd863 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.229831  7261 tablet_replica.cc:333] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863: stopping tablet replica
I20260709 12:29:37.230592  7261 raft_consensus.cc:2243] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:29:37.230609 15158 consensus_peers.cc:597] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 -> Peer aa986d67093943dca6eb6346e0ccd863 (127.7.23.65:36703): Couldn't send request to peer aa986d67093943dca6eb6346e0ccd863. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:37.231400  7261 raft_consensus.cc:2272] T 8d09d70c637142d5992314e4977fd6b0 P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.233497  7261 tablet_replica.cc:333] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863: stopping tablet replica
I20260709 12:29:37.234041  7261 raft_consensus.cc:2243] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.234790  7261 raft_consensus.cc:2272] T fc327bf0d9ad436e8fb8cad2730ad25b P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.236841  7261 tablet_replica.cc:333] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863: stopping tablet replica
I20260709 12:29:37.237303  7261 raft_consensus.cc:2243] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.237682  7261 raft_consensus.cc:2272] T d5ef185e5b734630b620dbab698b61da P aa986d67093943dca6eb6346e0ccd863 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.251754  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
I20260709 12:29:37.263550  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
I20260709 12:29:37.278716  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:37.279282  7261 tablet_replica.cc:333] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f: stopping tablet replica
I20260709 12:29:37.279826  7261 raft_consensus.cc:2243] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.280222  7261 raft_consensus.cc:2272] T 8d09d70c637142d5992314e4977fd6b0 P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.282419  7261 tablet_replica.cc:333] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: stopping tablet replica
I20260709 12:29:37.282903  7261 raft_consensus.cc:2243] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.283538  7261 pending_rounds.cc:70] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: Trying to abort 1 pending ops.
I20260709 12:29:37.283694  7261 pending_rounds.cc:77] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305626325255131136 op_type: NO_OP noop_request { }
I20260709 12:29:37.283969  7261 raft_consensus.cc:2889] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:29:37.284219  7261 raft_consensus.cc:2272] T 465e21a6ce0b468480ffba6033e9fcb8 P 43bbbc1599c444c8b82fccf8747df97f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.286432  7261 tablet_replica.cc:333] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f: stopping tablet replica
I20260709 12:29:37.286928  7261 raft_consensus.cc:2243] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.287315  7261 raft_consensus.cc:2272] T fc327bf0d9ad436e8fb8cad2730ad25b P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.289069  7261 tablet_replica.cc:333] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f: stopping tablet replica
I20260709 12:29:37.289494  7261 raft_consensus.cc:2243] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.289851  7261 raft_consensus.cc:2272] T d5ef185e5b734630b620dbab698b61da P 43bbbc1599c444c8b82fccf8747df97f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.311347  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
I20260709 12:29:37.322638  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
I20260709 12:29:37.337337  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:37.337971  7261 tablet_replica.cc:333] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83: stopping tablet replica
I20260709 12:29:37.338577  7261 raft_consensus.cc:2243] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.339015  7261 raft_consensus.cc:2272] T 465e21a6ce0b468480ffba6033e9fcb8 P 166f5b43de624c759710ab9035b63c83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.341280  7261 tablet_replica.cc:333] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83: stopping tablet replica
I20260709 12:29:37.341784  7261 raft_consensus.cc:2243] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.342178  7261 raft_consensus.cc:2272] T 8d09d70c637142d5992314e4977fd6b0 P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.344473  7261 tablet_replica.cc:333] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83: stopping tablet replica
I20260709 12:29:37.344935  7261 raft_consensus.cc:2243] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:37.345299  7261 raft_consensus.cc:2272] T fc327bf0d9ad436e8fb8cad2730ad25b P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.346931  7261 tablet_replica.cc:333] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83: stopping tablet replica
I20260709 12:29:37.347366  7261 raft_consensus.cc:2243] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.348107  7261 raft_consensus.cc:2272] T d5ef185e5b734630b620dbab698b61da P 166f5b43de624c759710ab9035b63c83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.368588  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
I20260709 12:29:37.380169  7261 master.cc:562] Master@127.7.23.126:37005 shutting down...
I20260709 12:29:37.393291  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:37.393793  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:37.394057  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P d63098855f1648d2be92bc8ce8bc845c: stopping tablet replica
I20260709 12:29:37.411434  7261 master.cc:584] Master@127.7.23.126:37005 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2397 ms)
[----------] 6 tests from LeaderRebalancerTest (283317 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:29:37.436985  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:40029
I20260709 12:29:37.437983  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:37.442890 15291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.443123 15290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.444193 15293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.444458  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:37.445281  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:37.445487  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:37.445622  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600177445606 us; error 0 us; skew 500 ppm
I20260709 12:29:37.446133  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:37.448196  7261 webserver.cc:533] Webserver started at http://127.7.23.126:33235/ using document root <none> and password file <none>
I20260709 12:29:37.448623  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:37.448791  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:37.449038  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:37.450052  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "95d3e4cc06fd4f50b87426d1e49f4807"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.454200  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:37.457245 15298 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.457890  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:29:37.458159  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "95d3e4cc06fd4f50b87426d1e49f4807"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.458423  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.473598  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.474594  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.508018  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:40029
I20260709 12:29:37.508118 15349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:40029 every 8 connection(s)
I20260709 12:29:37.511700 15350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.522825 15350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807: Bootstrap starting.
I20260709 12:29:37.527124 15350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:37.530880 15350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807: No bootstrap required, opened a new log
I20260709 12:29:37.532882 15350 raft_consensus.cc:359] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" member_type: VOTER }
I20260709 12:29:37.533248 15350 raft_consensus.cc:385] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:37.533419 15350 raft_consensus.cc:740] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95d3e4cc06fd4f50b87426d1e49f4807, State: Initialized, Role: FOLLOWER
I20260709 12:29:37.533900 15350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" member_type: VOTER }
I20260709 12:29:37.534302 15350 raft_consensus.cc:399] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:37.534492 15350 raft_consensus.cc:493] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:37.534689 15350 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:37.539165 15350 raft_consensus.cc:515] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" member_type: VOTER }
I20260709 12:29:37.539629 15350 leader_election.cc:304] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95d3e4cc06fd4f50b87426d1e49f4807; no voters: 
I20260709 12:29:37.540647 15350 leader_election.cc:290] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:37.540933 15353 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:37.542193 15353 raft_consensus.cc:697] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 1 LEADER]: Becoming Leader. State: Replica: 95d3e4cc06fd4f50b87426d1e49f4807, State: Running, Role: LEADER
I20260709 12:29:37.542827 15353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" member_type: VOTER }
I20260709 12:29:37.543255 15350 sys_catalog.cc:565] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:37.545486 15354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" member_type: VOTER } }
I20260709 12:29:37.545526 15355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95d3e4cc06fd4f50b87426d1e49f4807. Latest consensus state: current_term: 1 leader_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95d3e4cc06fd4f50b87426d1e49f4807" member_type: VOTER } }
I20260709 12:29:37.546182 15354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:37.546303 15355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:37.549043 15358 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:37.553622 15358 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:37.558120  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:37.561868 15358 catalog_manager.cc:1383] Generated new cluster ID: 493ba402d59348bf896542ef4323e58e
I20260709 12:29:37.562136 15358 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:37.583842 15358 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:37.585208 15358 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:37.603310 15358 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807: Generated new TSK 0
I20260709 12:29:37.603947 15358 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:37.625161  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:37.630861 15371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.631867 15372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.634490  7261 server_base.cc:1061] running on GCE node
W20260709 12:29:37.635699 15374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.637616  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:37.637816  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:37.637941  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600177637928 us; error 0 us; skew 500 ppm
I20260709 12:29:37.638458  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:37.640600  7261 webserver.cc:533] Webserver started at http://127.7.23.65:38271/ using document root <none> and password file <none>
I20260709 12:29:37.641028  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:37.641178  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:37.641382  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:37.642375  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "d7e060117e744a7b9bdf0d57d44e0515"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.646600  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:37.649751 15379 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.650466  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:37.650739  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "d7e060117e744a7b9bdf0d57d44e0515"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.651005  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.665432  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.666540  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.667886  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:37.670037  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:37.670218  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.670465  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:37.670620  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.706614  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:45341
I20260709 12:29:37.706768 15441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:45341 every 8 connection(s)
I20260709 12:29:37.711349  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:37.718490 15446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.721431 15447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.723284  7261 server_base.cc:1061] running on GCE node
W20260709 12:29:37.723946 15449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.724617 15442 heartbeater.cc:344] Connected to a master server at 127.7.23.126:40029
I20260709 12:29:37.725095 15442 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:37.725270  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:37.725581  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:37.725776  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600177725756 us; error 0 us; skew 500 ppm
I20260709 12:29:37.726020 15442 heartbeater.cc:507] Master 127.7.23.126:40029 requested a full tablet report, sending...
I20260709 12:29:37.726567  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:37.728509 15315 ts_manager.cc:194] Registered new tserver with Master: d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341)
I20260709 12:29:37.729431  7261 webserver.cc:533] Webserver started at http://127.7.23.66:45391/ using document root <none> and password file <none>
I20260709 12:29:37.729943  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:37.730113  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:37.730360  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:37.730361 15315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34788
I20260709 12:29:37.731822  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "c6310cdf9ace453397b99a4a62539dee"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.735985  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:29:37.738979 15454 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.739711  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:29:37.739975  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "c6310cdf9ace453397b99a4a62539dee"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.740243  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.754757  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.755846  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.757220  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:37.759377  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:37.759603  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.759820  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:37.760010  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.795562  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:42959
I20260709 12:29:37.795670 15516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:42959 every 8 connection(s)
I20260709 12:29:37.800081  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:37.806407 15520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.807428 15521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:37.809373 15523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:37.809800  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:37.811101  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:37.811297  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:37.811529  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600177811511 us; error 0 us; skew 500 ppm
I20260709 12:29:37.812088 15517 heartbeater.cc:344] Connected to a master server at 127.7.23.126:40029
I20260709 12:29:37.812146  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:37.812686 15517 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:37.813660 15517 heartbeater.cc:507] Master 127.7.23.126:40029 requested a full tablet report, sending...
I20260709 12:29:37.815099  7261 webserver.cc:533] Webserver started at http://127.7.23.67:44225/ using document root <none> and password file <none>
I20260709 12:29:37.815690  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:37.815861  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:37.815845 15315 ts_manager.cc:194] Registered new tserver with Master: c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:37.816332  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:37.817423  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "0bd3802eadb547e7836afff55866543c"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.817466 15315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34802
I20260709 12:29:37.821997  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:37.825270 15528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.826056  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:29:37.826328  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "0bd3802eadb547e7836afff55866543c"
format_stamp: "Formatted at 2026-07-09 12:29:37 on dist-test-slave-ps85"
I20260709 12:29:37.826593  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:37.836930  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:37.837967  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:37.839531  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:37.841864  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:37.842064  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.842286  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:37.842425  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:37.878931  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:44305
I20260709 12:29:37.879022 15590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:44305 every 8 connection(s)
I20260709 12:29:37.891283 15591 heartbeater.cc:344] Connected to a master server at 127.7.23.126:40029
I20260709 12:29:37.891753 15591 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:37.892397 15591 heartbeater.cc:507] Master 127.7.23.126:40029 requested a full tablet report, sending...
I20260709 12:29:37.894176 15315 ts_manager.cc:194] Registered new tserver with Master: 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:37.895202  7261 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013256747s
I20260709 12:29:37.895653 15315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34818
I20260709 12:29:37.918568 15315 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34828:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:37.921012 15315 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:37.994336 15407 tablet_service.cc:1511] Processing CreateTablet for tablet a7e7c9a5dd144e1eaf2d91ad050183b2 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:37.995734 15407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e7c9a5dd144e1eaf2d91ad050183b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:37.997788 15556 tablet_service.cc:1511] Processing CreateTablet for tablet a7e7c9a5dd144e1eaf2d91ad050183b2 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:37.999168 15556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e7c9a5dd144e1eaf2d91ad050183b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.000444 15555 tablet_service.cc:1511] Processing CreateTablet for tablet a250d82d44f4434e9637048652513344 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:38.002581 15554 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddcf9951827478a8bc51ec367f63d8b (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:38.004722 15406 tablet_service.cc:1511] Processing CreateTablet for tablet a250d82d44f4434e9637048652513344 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:38.005719 15552 tablet_service.cc:1511] Processing CreateTablet for tablet 72835d3d5e534023b9a249e58945fa10 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:38.006764 15405 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddcf9951827478a8bc51ec367f63d8b (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:38.008343 15551 tablet_service.cc:1511] Processing CreateTablet for tablet f284b6ceea344b45978e915931b91dde (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:38.008699 15404 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70bcce05244c868552ef137e24212e (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:38.010690 15403 tablet_service.cc:1511] Processing CreateTablet for tablet 72835d3d5e534023b9a249e58945fa10 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:38.005820 15406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a250d82d44f4434e9637048652513344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.011866 15550 tablet_service.cc:1511] Processing CreateTablet for tablet a67715e06a8841a68e714e8adefb28f6 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:38.013998 15549 tablet_service.cc:1511] Processing CreateTablet for tablet 24d229db978a479aa1d08ea2cac32472 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:38.014233 15548 tablet_service.cc:1511] Processing CreateTablet for tablet 542ae07572714719aed2f722a6e04917 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:38.015602 15404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70bcce05244c868552ef137e24212e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.012004 15552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72835d3d5e534023b9a249e58945fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.019938 15403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72835d3d5e534023b9a249e58945fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.020152 15548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542ae07572714719aed2f722a6e04917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.004743 15553 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70bcce05244c868552ef137e24212e (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:38.021559 15553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70bcce05244c868552ef137e24212e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.020680 15405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddcf9951827478a8bc51ec367f63d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.022222 15554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddcf9951827478a8bc51ec367f63d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.028854 15551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f284b6ceea344b45978e915931b91dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.030506 15555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a250d82d44f4434e9637048652513344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.031461 15549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24d229db978a479aa1d08ea2cac32472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.035712 15550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67715e06a8841a68e714e8adefb28f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.062896 15402 tablet_service.cc:1511] Processing CreateTablet for tablet f284b6ceea344b45978e915931b91dde (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:38.064167 15402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f284b6ceea344b45978e915931b91dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.071710 15606 tablet_bootstrap.cc:492] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.072923 15401 tablet_service.cc:1511] Processing CreateTablet for tablet a67715e06a8841a68e714e8adefb28f6 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:38.074314 15401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67715e06a8841a68e714e8adefb28f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.077476 15606 tablet_bootstrap.cc:654] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.084640 15400 tablet_service.cc:1511] Processing CreateTablet for tablet 542ae07572714719aed2f722a6e04917 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:38.084959 15482 tablet_service.cc:1511] Processing CreateTablet for tablet a7e7c9a5dd144e1eaf2d91ad050183b2 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:38.086104 15400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542ae07572714719aed2f722a6e04917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.087754 15481 tablet_service.cc:1511] Processing CreateTablet for tablet a250d82d44f4434e9637048652513344 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:38.090593 15480 tablet_service.cc:1511] Processing CreateTablet for tablet 3ddcf9951827478a8bc51ec367f63d8b (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:38.086129 15482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7e7c9a5dd144e1eaf2d91ad050183b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.092200 15481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a250d82d44f4434e9637048652513344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.094628 15480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ddcf9951827478a8bc51ec367f63d8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.102288 15404 tablet_service.cc:1511] Processing CreateTablet for tablet 24d229db978a479aa1d08ea2cac32472 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:38.125177 15475 tablet_service.cc:1511] Processing CreateTablet for tablet 24d229db978a479aa1d08ea2cac32472 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:38.126778 15475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24d229db978a479aa1d08ea2cac32472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.127807 15479 tablet_service.cc:1511] Processing CreateTablet for tablet 3f70bcce05244c868552ef137e24212e (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:38.128856 15478 tablet_service.cc:1511] Processing CreateTablet for tablet 72835d3d5e534023b9a249e58945fa10 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:38.129022 15474 tablet_service.cc:1511] Processing CreateTablet for tablet 542ae07572714719aed2f722a6e04917 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:38.130786 15476 tablet_service.cc:1511] Processing CreateTablet for tablet a67715e06a8841a68e714e8adefb28f6 (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:38.132583 15477 tablet_service.cc:1511] Processing CreateTablet for tablet f284b6ceea344b45978e915931b91dde (DEFAULT_TABLE table=test-workload [id=21bf65de443e4f3db6aa60cca4c4f90e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:38.135916 15404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24d229db978a479aa1d08ea2cac32472. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.132660 15479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f70bcce05244c868552ef137e24212e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.147730 15477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f284b6ceea344b45978e915931b91dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.150141 15476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67715e06a8841a68e714e8adefb28f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.150763 15478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72835d3d5e534023b9a249e58945fa10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.155761 15474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 542ae07572714719aed2f722a6e04917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:38.182459 15609 tablet_bootstrap.cc:492] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.198324 15606 tablet_bootstrap.cc:492] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.198908 15606 ts_tablet_manager.cc:1403] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.127s	user 0.027s	sys 0.029s
I20260709 12:29:38.200474 15609 tablet_bootstrap.cc:654] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.200685 15607 tablet_bootstrap.cc:492] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.201957 15606 raft_consensus.cc:359] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.202698 15606 raft_consensus.cc:385] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.202989 15606 raft_consensus.cc:740] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.203941 15606 consensus_queue.cc:260] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.206538 15591 heartbeater.cc:499] Master 127.7.23.126:40029 was elected leader, sending a full tablet report...
I20260709 12:29:38.207594 15607 tablet_bootstrap.cc:654] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.208753 15606 ts_tablet_manager.cc:1434] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:29:38.209805 15606 tablet_bootstrap.cc:492] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.213825 15609 tablet_bootstrap.cc:492] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.214371 15609 ts_tablet_manager.cc:1403] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:29:38.217759 15609 raft_consensus.cc:359] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.218521 15609 raft_consensus.cc:385] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.218813 15609 raft_consensus.cc:740] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.219587 15609 consensus_queue.cc:260] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.220638 15606 tablet_bootstrap.cc:654] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.225584 15609 ts_tablet_manager.cc:1434] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.008s
I20260709 12:29:38.225862 15607 tablet_bootstrap.cc:492] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.226327 15607 ts_tablet_manager.cc:1403] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.014s
I20260709 12:29:38.226349 15517 heartbeater.cc:499] Master 127.7.23.126:40029 was elected leader, sending a full tablet report...
I20260709 12:29:38.226646 15609 tablet_bootstrap.cc:492] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.233122 15609 tablet_bootstrap.cc:654] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.233076 15607 raft_consensus.cc:359] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.233848 15607 raft_consensus.cc:385] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.234176 15607 raft_consensus.cc:740] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.235034 15607 consensus_queue.cc:260] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.237986 15442 heartbeater.cc:499] Master 127.7.23.126:40029 was elected leader, sending a full tablet report...
I20260709 12:29:38.239199 15607 ts_tablet_manager.cc:1434] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:38.240334 15607 tablet_bootstrap.cc:492] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.246711 15607 tablet_bootstrap.cc:654] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.251667 15609 tablet_bootstrap.cc:492] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.252156 15609 ts_tablet_manager.cc:1403] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.012s
I20260709 12:29:38.252866 15607 tablet_bootstrap.cc:492] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.253455 15607 ts_tablet_manager.cc:1403] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 12:29:38.253832 15606 tablet_bootstrap.cc:492] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.254385 15606 ts_tablet_manager.cc:1403] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.004s
I20260709 12:29:38.254942 15609 raft_consensus.cc:359] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.255738 15609 raft_consensus.cc:385] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.256021 15609 raft_consensus.cc:740] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.256633 15607 raft_consensus.cc:359] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.256850 15609 consensus_queue.cc:260] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.257452 15607 raft_consensus.cc:385] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.257239 15606 raft_consensus.cc:359] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.257959 15607 raft_consensus.cc:740] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.258266 15606 raft_consensus.cc:385] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.258653 15606 raft_consensus.cc:740] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.259107 15609 ts_tablet_manager.cc:1434] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:38.258882 15607 consensus_queue.cc:260] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.260246 15609 tablet_bootstrap.cc:492] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.259649 15606 consensus_queue.cc:260] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.261070 15611 raft_consensus.cc:493] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.261605 15607 ts_tablet_manager.cc:1434] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:29:38.261504 15611 raft_consensus.cc:515] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.262706 15607 tablet_bootstrap.cc:492] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.266741 15609 tablet_bootstrap.cc:654] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.268497 15607 tablet_bootstrap.cc:654] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.279207 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.280824 15611 leader_election.cc:290] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
W20260709 12:29:38.281126 15529 leader_election.cc:343] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.286222 15606 ts_tablet_manager.cc:1434] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:29:38.287351 15606 tablet_bootstrap.cc:492] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.295960 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
W20260709 12:29:38.297806 15529 leader_election.cc:343] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.298336 15529 leader_election.cc:304] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bd3802eadb547e7836afff55866543c; no voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:38.299517 15611 raft_consensus.cc:2749] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.303445 15606 tablet_bootstrap.cc:654] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.308827 15607 tablet_bootstrap.cc:492] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.309201 15607 ts_tablet_manager.cc:1403] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.028s
I20260709 12:29:38.309300 15606 tablet_bootstrap.cc:492] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.309415 15609 tablet_bootstrap.cc:492] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.309906 15606 ts_tablet_manager.cc:1403] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:29:38.310041 15609 ts_tablet_manager.cc:1403] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.050s	user 0.030s	sys 0.018s
I20260709 12:29:38.311359 15607 raft_consensus.cc:359] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.311954 15607 raft_consensus.cc:385] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.312142 15607 raft_consensus.cc:740] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.312736 15607 consensus_queue.cc:260] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.313022 15606 raft_consensus.cc:359] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.313284 15609 raft_consensus.cc:359] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.313794 15606 raft_consensus.cc:385] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.314168 15609 raft_consensus.cc:385] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.314168 15606 raft_consensus.cc:740] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.314678 15607 ts_tablet_manager.cc:1434] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:29:38.314711 15609 raft_consensus.cc:740] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.315161 15606 consensus_queue.cc:260] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.315877 15607 tablet_bootstrap.cc:492] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.316140 15609 consensus_queue.cc:260] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.317379 15606 ts_tablet_manager.cc:1434] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:38.318413 15606 tablet_bootstrap.cc:492] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.322232 15607 tablet_bootstrap.cc:654] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.324216 15606 tablet_bootstrap.cc:654] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.318418 15609 ts_tablet_manager.cc:1434] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:38.327171 15616 raft_consensus.cc:493] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.327505 15609 tablet_bootstrap.cc:492] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.327718 15616 raft_consensus.cc:515] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.334139 15609 tablet_bootstrap.cc:654] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.339938 15616 leader_election.cc:290] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.346674 15606 tablet_bootstrap.cc:492] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.347366 15606 ts_tablet_manager.cc:1403] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.008s
I20260709 12:29:38.350641 15606 raft_consensus.cc:359] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.351442 15606 raft_consensus.cc:385] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.351748 15606 raft_consensus.cc:740] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.353797 15606 consensus_queue.cc:260] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.355113 15607 tablet_bootstrap.cc:492] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.355688 15607 ts_tablet_manager.cc:1403] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.025s
I20260709 12:29:38.356410 15606 ts_tablet_manager.cc:1434] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:29:38.357439 15606 tablet_bootstrap.cc:492] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.358441 15607 raft_consensus.cc:359] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.359153 15607 raft_consensus.cc:385] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.359468 15607 raft_consensus.cc:740] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.360260 15607 consensus_queue.cc:260] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.362498 15607 ts_tablet_manager.cc:1434] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:29:38.364094 15606 tablet_bootstrap.cc:654] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.377516 15607 tablet_bootstrap.cc:492] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.379383 15609 tablet_bootstrap.cc:492] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.379959 15609 ts_tablet_manager.cc:1403] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.027s
I20260709 12:29:38.382943 15609 raft_consensus.cc:359] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.384501 15609 raft_consensus.cc:385] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.384780 15609 raft_consensus.cc:740] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.385633 15609 consensus_queue.cc:260] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.386831 15611 raft_consensus.cc:493] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.387005 15607 tablet_bootstrap.cc:654] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.387511 15611 raft_consensus.cc:515] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.389569 15611 leader_election.cc:290] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:38.391702 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:38.392767 15613 raft_consensus.cc:493] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.393245 15613 raft_consensus.cc:515] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.394623 15609 ts_tablet_manager.cc:1434] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
W20260709 12:29:38.396045 15529 leader_election.cc:343] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.397078 15613 leader_election.cc:290] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.403712 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.404484 15417 raft_consensus.cc:2468] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:38.405987 15529 leader_election.cc:304] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:38.407233 15611 raft_consensus.cc:2804] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.407630 15611 raft_consensus.cc:493] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.407965 15611 raft_consensus.cc:3060] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.408877 15609 tablet_bootstrap.cc:492] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.413015 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.413985 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
W20260709 12:29:38.416603 15380 leader_election.cc:343] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.418512 15611 raft_consensus.cc:515] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.419836 15566 raft_consensus.cc:2393] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7e060117e744a7b9bdf0d57d44e0515 in current term 1: Already voted for candidate 0bd3802eadb547e7836afff55866543c in this term.
I20260709 12:29:38.422652 15609 tablet_bootstrap.cc:654] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.422812 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.423177 15382 leader_election.cc:304] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7e060117e744a7b9bdf0d57d44e0515; no voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:38.424250 15616 raft_consensus.cc:3060] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:38.426545 15455 leader_election.cc:343] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.427032 15607 tablet_bootstrap.cc:492] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.427615 15607 ts_tablet_manager.cc:1403] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.050s	user 0.029s	sys 0.019s
I20260709 12:29:38.430924 15606 tablet_bootstrap.cc:492] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.430624 15607 raft_consensus.cc:359] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.431488 15607 raft_consensus.cc:385] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.431788 15607 raft_consensus.cc:740] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.432235 15616 raft_consensus.cc:2749] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.432809 15607 consensus_queue.cc:260] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.434154 15611 leader_election.cc:290] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:38.435109 15607 ts_tablet_manager.cc:1434] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:29:38.435254 15609 tablet_bootstrap.cc:492] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.435176 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:38.436158 15609 ts_tablet_manager.cc:1403] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.012s
I20260709 12:29:38.437153 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:38.431656 15606 ts_tablet_manager.cc:1403] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.019s
I20260709 12:29:38.440734 15609 raft_consensus.cc:359] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.440956 15606 raft_consensus.cc:359] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.441589 15609 raft_consensus.cc:385] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.442019 15609 raft_consensus.cc:740] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
W20260709 12:29:38.442317 15529 leader_election.cc:343] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.442970 15609 consensus_queue.cc:260] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.446165 15417 raft_consensus.cc:2468] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:38.447386 15529 leader_election.cc:304] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:38.447744 15616 raft_consensus.cc:493] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.448278 15616 raft_consensus.cc:515] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.448724 15611 raft_consensus.cc:2804] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.449486 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.441802 15606 raft_consensus.cc:385] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.450095 15606 raft_consensus.cc:740] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.447343 15609 ts_tablet_manager.cc:1434] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
W20260709 12:29:38.451087 15457 leader_election.cc:343] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:38.451694 15457 leader_election.cc:304] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee; no voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:38.452001 15609 tablet_bootstrap.cc:492] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.452436 15607 tablet_bootstrap.cc:492] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.452796 15613 raft_consensus.cc:2749] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.450994 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70bcce05244c868552ef137e24212e" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:38.453732 15492 raft_consensus.cc:2468] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.454331 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70bcce05244c868552ef137e24212e" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.454819 15380 leader_election.cc:304] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.455746 15616 leader_election.cc:290] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.456265 15616 raft_consensus.cc:2804] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.456121 15606 consensus_queue.cc:260] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.456660 15616 raft_consensus.cc:493] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.457049 15616 raft_consensus.cc:3060] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.457109 15566 raft_consensus.cc:2468] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.460990 15609 tablet_bootstrap.cc:654] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.468545 15607 tablet_bootstrap.cc:654] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.475272 15611 raft_consensus.cc:697] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:38.475535 15606 ts_tablet_manager.cc:1434] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.006s
I20260709 12:29:38.476303 15611 consensus_queue.cc:237] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.476512 15616 raft_consensus.cc:515] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.477058 15606 tablet_bootstrap.cc:492] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.478130 15609 tablet_bootstrap.cc:492] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.478688 15609 ts_tablet_manager.cc:1403] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.004s
I20260709 12:29:38.479487 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70bcce05244c868552ef137e24212e" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:38.479753 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f70bcce05244c868552ef137e24212e" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:38.480082 15492 raft_consensus.cc:3060] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.480387 15566 raft_consensus.cc:3060] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.482613 15609 raft_consensus.cc:359] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.483424 15609 raft_consensus.cc:385] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.483759 15609 raft_consensus.cc:740] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.484902 15606 tablet_bootstrap.cc:654] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.484625 15609 consensus_queue.cc:260] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.486994 15609 ts_tablet_manager.cc:1434] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:29:38.488044 15609 tablet_bootstrap.cc:492] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.488819 15607 tablet_bootstrap.cc:492] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.489396 15607 ts_tablet_manager.cc:1403] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.037s	user 0.004s	sys 0.008s
I20260709 12:29:38.492897 15566 raft_consensus.cc:2468] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.494458 15382 leader_election.cc:304] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.495487 15616 leader_election.cc:290] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.495721 15609 tablet_bootstrap.cc:654] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.496485 15616 raft_consensus.cc:2804] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.497092 15616 raft_consensus.cc:697] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:38.497905 15616 consensus_queue.cc:237] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.500778 15607 raft_consensus.cc:359] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.501623 15492 raft_consensus.cc:2468] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.501567 15607 raft_consensus.cc:385] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.504072 15607 raft_consensus.cc:740] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.504990 15607 consensus_queue.cc:260] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.507387 15607 ts_tablet_manager.cc:1434] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 12:29:38.508396 15609 tablet_bootstrap.cc:492] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.509078 15609 ts_tablet_manager.cc:1403] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:29:38.511307 15606 tablet_bootstrap.cc:492] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.511889 15606 ts_tablet_manager.cc:1403] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.011s
I20260709 12:29:38.512588 15609 raft_consensus.cc:359] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.514114 15609 raft_consensus.cc:385] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.514459 15609 raft_consensus.cc:740] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.514971 15606 raft_consensus.cc:359] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.515750 15606 raft_consensus.cc:385] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.508455 15607 tablet_bootstrap.cc:492] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.516108 15606 raft_consensus.cc:740] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.517012 15606 consensus_queue.cc:260] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.515329 15609 consensus_queue.cc:260] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.518482 15314 catalog_manager.cc:5697] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:38.519593 15609 ts_tablet_manager.cc:1434] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:29:38.520587 15609 tablet_bootstrap.cc:492] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.523837 15607 tablet_bootstrap.cc:654] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.525923 15609 tablet_bootstrap.cc:654] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.529474 15606 ts_tablet_manager.cc:1434] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:29:38.529686 15607 tablet_bootstrap.cc:492] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.530280 15607 ts_tablet_manager.cc:1403] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.022s	user 0.002s	sys 0.007s
I20260709 12:29:38.531777 15606 tablet_bootstrap.cc:492] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.533001 15609 tablet_bootstrap.cc:492] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.533543 15609 ts_tablet_manager.cc:1403] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:29:38.533398 15607 raft_consensus.cc:359] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.534147 15607 raft_consensus.cc:385] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.534446 15607 raft_consensus.cc:740] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.535280 15607 consensus_queue.cc:260] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.536015 15315 catalog_manager.cc:5697] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 1 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:38.536554 15609 raft_consensus.cc:359] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.537381 15609 raft_consensus.cc:385] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.537699 15609 raft_consensus.cc:740] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.537887 15607 ts_tablet_manager.cc:1434] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:38.538486 15606 tablet_bootstrap.cc:654] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.539048 15607 tablet_bootstrap.cc:492] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.538676 15609 consensus_queue.cc:260] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.540923 15609 ts_tablet_manager.cc:1434] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:38.541828 15609 tablet_bootstrap.cc:492] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:38.545794 15607 tablet_bootstrap.cc:654] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.547933 15609 tablet_bootstrap.cc:654] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.557386 15607 tablet_bootstrap.cc:492] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.557914 15607 ts_tablet_manager.cc:1403] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:29:38.560679 15607 raft_consensus.cc:359] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.561394 15607 raft_consensus.cc:385] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.561667 15607 raft_consensus.cc:740] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.563243 15607 consensus_queue.cc:260] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.564388 15613 raft_consensus.cc:493] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.564983 15613 raft_consensus.cc:515] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.569625 15607 ts_tablet_manager.cc:1434] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
W20260709 12:29:38.570345 15363 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:38.570713 15607 tablet_bootstrap.cc:492] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:38.572258 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.572989 15566 raft_consensus.cc:2468] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:38.577337 15607 tablet_bootstrap.cc:654] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.577729 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.578500 15417 raft_consensus.cc:2468] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:38.580189 15457 leader_election.cc:304] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:38.581848 15609 tablet_bootstrap.cc:492] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:38.582139 15651 raft_consensus.cc:2804] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.582508 15609 ts_tablet_manager.cc:1403] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.021s
I20260709 12:29:38.582571 15651 raft_consensus.cc:493] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.583581 15651 raft_consensus.cc:3060] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.585824 15609 raft_consensus.cc:359] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.586623 15609 raft_consensus.cc:385] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.586941 15609 raft_consensus.cc:740] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.587741 15609 consensus_queue.cc:260] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.567164 15613 leader_election.cc:290] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305), d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341)
I20260709 12:29:38.591379 15607 tablet_bootstrap.cc:492] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:38.591832 15607 ts_tablet_manager.cc:1403] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.006s
I20260709 12:29:38.594244 15607 raft_consensus.cc:359] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.594831 15607 raft_consensus.cc:385] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.595086 15607 raft_consensus.cc:740] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.595685 15607 consensus_queue.cc:260] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.597913 15607 ts_tablet_manager.cc:1434] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:29:38.598006 15609 ts_tablet_manager.cc:1434] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:29:38.598731 15651 raft_consensus.cc:515] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.601176 15606 tablet_bootstrap.cc:492] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.601691 15606 ts_tablet_manager.cc:1403] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.032s
I20260709 12:29:38.603084 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:38.603691 15566 raft_consensus.cc:3060] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.604430 15606 raft_consensus.cc:359] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.604996 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:38.605158 15606 raft_consensus.cc:385] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.605546 15606 raft_consensus.cc:740] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.605682 15417 raft_consensus.cc:3060] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.606449 15606 consensus_queue.cc:260] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.610553 15566 raft_consensus.cc:2468] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:38.611697 15457 leader_election.cc:304] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:38.612630 15652 raft_consensus.cc:2804] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.612964 15417 raft_consensus.cc:2468] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:38.613134 15652 raft_consensus.cc:697] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:38.613317 15606 ts_tablet_manager.cc:1434] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.005s
I20260709 12:29:38.614363 15606 tablet_bootstrap.cc:492] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.614056 15652 consensus_queue.cc:237] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:38.614398 15651 leader_election.cc:290] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Requested vote from peers 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305), d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341)
I20260709 12:29:38.621191 15606 tablet_bootstrap.cc:654] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.624819 15314 catalog_manager.cc:5697] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 0 to 1, leader changed from <none> to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 1 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:38.627756 15606 tablet_bootstrap.cc:492] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.628217 15606 ts_tablet_manager.cc:1403] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 12:29:38.630384 15606 raft_consensus.cc:359] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.630988 15606 raft_consensus.cc:385] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.631250 15606 raft_consensus.cc:740] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.631909 15606 consensus_queue.cc:260] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.633397 15616 raft_consensus.cc:493] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.633644 15606 ts_tablet_manager.cc:1434] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:38.633916 15616 raft_consensus.cc:515] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.634443 15606 tablet_bootstrap.cc:492] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:38.635982 15616 leader_election.cc:290] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.637878 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:38.638543 15492 raft_consensus.cc:2468] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.639676 15380 leader_election.cc:304] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.639912 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.640358 15606 tablet_bootstrap.cc:654] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:38.640544 15616 raft_consensus.cc:2804] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.640506 15566 raft_consensus.cc:2468] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.641085 15616 raft_consensus.cc:493] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.641469 15616 raft_consensus.cc:3060] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.645452 15606 tablet_bootstrap.cc:492] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:38.645910 15606 ts_tablet_manager.cc:1403] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:29:38.647053 15616 raft_consensus.cc:515] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.648669 15606 raft_consensus.cc:359] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.649019 15616 leader_election.cc:290] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.649335 15606 raft_consensus.cc:385] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:38.649629 15606 raft_consensus.cc:740] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:38.649981 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:38.650386 15566 raft_consensus.cc:3060] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.650316 15606 consensus_queue.cc:260] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.652419 15606 ts_tablet_manager.cc:1434] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:29:38.649608 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:38.656069 15566 raft_consensus.cc:2468] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.656569 15492 raft_consensus.cc:3060] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.657049 15382 leader_election.cc:304] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.657663 15616 raft_consensus.cc:2804] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.658025 15616 raft_consensus.cc:697] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:38.658723 15616 consensus_queue.cc:237] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.661787 15492 raft_consensus.cc:2468] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.662240 15611 raft_consensus.cc:493] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.662731 15611 raft_consensus.cc:515] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.664719 15611 leader_election.cc:290] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:38.666111 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.666741 15417 raft_consensus.cc:2468] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:38.666519 15314 catalog_manager.cc:5697] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:38.665750 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:38.667780 15492 raft_consensus.cc:2468] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:38.668044 15529 leader_election.cc:304] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.668897 15611 raft_consensus.cc:2804] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.669231 15611 raft_consensus.cc:493] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.669559 15611 raft_consensus.cc:3060] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.675448 15611 raft_consensus.cc:515] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.676853 15611 leader_election.cc:290] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:38.677597 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:38.677745 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:38.678081 15417 raft_consensus.cc:3060] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.678239 15492 raft_consensus.cc:3060] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.682703 15492 raft_consensus.cc:2468] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:38.682646 15417 raft_consensus.cc:2468] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:38.683806 15529 leader_election.cc:304] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:38.684379 15611 raft_consensus.cc:2804] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.684741 15611 raft_consensus.cc:697] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:38.685318 15611 consensus_queue.cc:237] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.690676 15616 raft_consensus.cc:493] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.691162 15616 raft_consensus.cc:515] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.692663 15616 leader_election.cc:290] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.693348 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:38.693694 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.694029 15492 raft_consensus.cc:2468] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.692634 15314 catalog_manager.cc:5697] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 1 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:38.694344 15566 raft_consensus.cc:2468] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.695052 15380 leader_election.cc:304] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.695785 15616 raft_consensus.cc:2804] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.696110 15616 raft_consensus.cc:493] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.696346 15616 raft_consensus.cc:3060] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.701403 15616 raft_consensus.cc:515] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.703626 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:38.703385 15616 leader_election.cc:290] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.704077 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:38.704255 15492 raft_consensus.cc:3060] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.704589 15566 raft_consensus.cc:3060] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.709239 15566 raft_consensus.cc:2468] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.709339 15492 raft_consensus.cc:2468] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.710124 15382 leader_election.cc:304] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.710732 15616 raft_consensus.cc:2804] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.711143 15616 raft_consensus.cc:697] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:38.711831 15616 consensus_queue.cc:237] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.714979 15652 raft_consensus.cc:493] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.715569 15652 raft_consensus.cc:515] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.717526 15652 leader_election.cc:290] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.718192 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.718572 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.718729 15417 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:38.719228 15566 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:38.719692 15455 leader_election.cc:304] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.720434 15652 raft_consensus.cc:2804] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.719784 15314 catalog_manager.cc:5697] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:38.720803 15652 raft_consensus.cc:493] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.721119 15652 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.726814 15652 raft_consensus.cc:515] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.728507 15652 leader_election.cc:290] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.729089 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:38.729480 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:38.729701 15417 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.730068 15566 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.730829 15611 raft_consensus.cc:493] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.731305 15611 raft_consensus.cc:515] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.733037 15611 leader_election.cc:290] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:38.734205 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:38.734869 15492 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:38.734818 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.735838 15416 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:38.736765 15566 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:38.736852 15529 leader_election.cc:304] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:38.736765 15417 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:38.737911 15611 raft_consensus.cc:2804] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.738297 15611 raft_consensus.cc:493] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.738633 15611 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.738526 15455 leader_election.cc:304] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.739383 15652 raft_consensus.cc:2804] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.739797 15652 raft_consensus.cc:697] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:38.740860 15652 consensus_queue.cc:237] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.744095 15611 raft_consensus.cc:515] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.746206 15611 leader_election.cc:290] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:38.746860 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:38.747507 15417 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.747136 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:38.748807 15492 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.748986 15314 catalog_manager.cc:5697] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 0 to 1, leader changed from <none> to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 1 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:38.754278 15492 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:38.754539 15417 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:38.755434 15529 leader_election.cc:304] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:38.756093 15611 raft_consensus.cc:2804] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.756567 15611 raft_consensus.cc:697] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:38.757349 15611 consensus_queue.cc:237] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.764642 15314 catalog_manager.cc:5697] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 1 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:38.841157 15652 raft_consensus.cc:493] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.841720 15652 raft_consensus.cc:515] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.843374 15652 leader_election.cc:290] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.844187 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:38.844424 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.844900 15417 raft_consensus.cc:2393] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6310cdf9ace453397b99a4a62539dee in current term 1: Already voted for candidate 0bd3802eadb547e7836afff55866543c in this term.
I20260709 12:29:38.845808 15455 leader_election.cc:304] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee; no voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:38.846413 15652 raft_consensus.cc:3060] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.851182 15652 raft_consensus.cc:2749] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:38.851991 15616 raft_consensus.cc:493] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:38.852433 15616 raft_consensus.cc:515] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.854318 15616 leader_election.cc:290] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.854979 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:38.855268 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:38.855554 15492 raft_consensus.cc:2468] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.855860 15566 raft_consensus.cc:2468] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:38.856513 15380 leader_election.cc:304] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.857175 15616 raft_consensus.cc:2804] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:38.857455 15616 raft_consensus.cc:493] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:38.857703 15616 raft_consensus.cc:3060] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.862399 15616 raft_consensus.cc:515] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.863926 15616 leader_election.cc:290] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:38.864602 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:38.864964 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:38.865121 15492 raft_consensus.cc:3060] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.865463 15566 raft_consensus.cc:3060] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:38.869797 15492 raft_consensus.cc:2468] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.870138 15566 raft_consensus.cc:2468] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:38.870817 15380 leader_election.cc:304] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:38.871614 15616 raft_consensus.cc:2804] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:38.872040 15616 raft_consensus.cc:697] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:38.872666 15616 consensus_queue.cc:237] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:38.879760 15314 catalog_manager.cc:5697] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:38.918000 15616 consensus_queue.cc:1048] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:38.929699 15616 consensus_queue.cc:1048] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.017318 15611 consensus_queue.cc:1048] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.028770 15611 consensus_queue.cc:1048] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.078481 15652 consensus_queue.cc:1048] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.082350 15616 consensus_queue.cc:1048] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.089536 15652 consensus_queue.cc:1048] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.100621 15616 consensus_queue.cc:1048] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.127027 15492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
mode: GRACEFUL
new_leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:39080
I20260709 12:29:39.127549 15492 raft_consensus.cc:606] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Received request to transfer leadership to TS d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:39.132481 15492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a250d82d44f4434e9637048652513344"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
mode: GRACEFUL
new_leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:39080
I20260709 12:29:39.132948 15492 raft_consensus.cc:606] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Received request to transfer leadership to TS d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:39.145539 15566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
mode: GRACEFUL
new_leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:52680
I20260709 12:29:39.146029 15566 raft_consensus.cc:606] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Received request to transfer leadership to TS d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:39.160566 15417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
mode: GRACEFUL
new_leader_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:57954
I20260709 12:29:39.161072 15417 raft_consensus.cc:606] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Received request to transfer leadership to TS c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:39.165766 15566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f284b6ceea344b45978e915931b91dde"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
mode: GRACEFUL
new_leader_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:52680
I20260709 12:29:39.166244 15566 raft_consensus.cc:606] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Received request to transfer leadership to TS c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:39.170917 15566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
mode: GRACEFUL
new_leader_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:52680
I20260709 12:29:39.171360 15566 raft_consensus.cc:606] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Received request to transfer leadership to TS c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:39.175824 15417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
mode: GRACEFUL
new_leader_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:57954
I20260709 12:29:39.176287 15417 raft_consensus.cc:606] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Received request to transfer leadership to TS c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:39.180509 15417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "542ae07572714719aed2f722a6e04917"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
mode: GRACEFUL
new_leader_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:57954
I20260709 12:29:39.180939 15417 raft_consensus.cc:606] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Received request to transfer leadership to TS 0bd3802eadb547e7836afff55866543c
I20260709 12:29:39.202232 15634 consensus_queue.cc:1048] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.203703 15616 consensus_queue.cc:1048] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.211113 15664 raft_consensus.cc:993] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515: : Instructing follower 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:39.211596 15664 raft_consensus.cc:1081] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Signalling peer 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:39.213647 15565 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "542ae07572714719aed2f722a6e04917"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:29:39.214198 15565 raft_consensus.cc:493] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.214560 15565 raft_consensus.cc:3060] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.216042 15664 consensus_queue.cc:1048] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.216917 15611 consensus_queue.cc:1048] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.222113 15565 raft_consensus.cc:515] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.223601 15566 raft_consensus.cc:1240] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Rejecting Update request from peer d7e060117e744a7b9bdf0d57d44e0515 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:39.226562 15611 raft_consensus.cc:993] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c: : Instructing follower c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.227078 15611 raft_consensus.cc:1081] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Signalling peer c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.227856 15664 consensus_queue.cc:1059] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.228675 15664 raft_consensus.cc:3055] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.228965 15664 raft_consensus.cc:740] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:39.229773 15664 consensus_queue.cc:260] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.230700 15664 raft_consensus.cc:3060] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.226605 15565 leader_election.cc:290] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:39.231961 15490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f284b6ceea344b45978e915931b91dde"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:39062
I20260709 12:29:39.232609 15490 raft_consensus.cc:493] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.232551 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:39.233120 15490 raft_consensus.cc:3060] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.234699 15492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "542ae07572714719aed2f722a6e04917" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:39.238857 15652 consensus_queue.cc:1048] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.240607 15490 raft_consensus.cc:515] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.243336 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:39.243942 15416 raft_consensus.cc:3060] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.247262 15417 raft_consensus.cc:2468] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 2.
I20260709 12:29:39.249766 15529 leader_election.cc:304] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:39.250660 15669 raft_consensus.cc:2804] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.251101 15669 raft_consensus.cc:697] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 2 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:39.252131 15416 raft_consensus.cc:2468] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.251850 15669 consensus_queue.cc:237] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.254817 15634 consensus_queue.cc:1048] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.256999 15490 leader_election.cc:290] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:39.257352 15455 leader_election.cc:304] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:39.258347 15652 raft_consensus.cc:2804] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.258297 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f284b6ceea344b45978e915931b91dde" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:39.258980 15652 raft_consensus.cc:697] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:39.259079 15566 raft_consensus.cc:3055] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.259521 15566 raft_consensus.cc:740] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:39.260499 15566 consensus_queue.cc:260] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.261754 15566 raft_consensus.cc:3060] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.264227 15652 consensus_queue.cc:237] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.265233 15313 catalog_manager.cc:5697] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 1 to 2, leader changed from d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65) to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 2 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:39.272444 15315 catalog_manager.cc:5697] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 1 to 2, leader changed from 0bd3802eadb547e7836afff55866543c (127.7.23.67) to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.275046 15651 consensus_queue.cc:1048] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.283357 15566 raft_consensus.cc:2468] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.285156 15611 consensus_queue.cc:1048] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.286345 15664 consensus_queue.cc:1048] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.294663 15652 raft_consensus.cc:993] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee: : Instructing follower d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:39.295091 15652 raft_consensus.cc:1081] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Signalling peer d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:39.295723 15664 consensus_queue.cc:1048] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:39.296885 15416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a250d82d44f4434e9637048652513344"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:57952
I20260709 12:29:39.297474 15416 raft_consensus.cc:493] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.297832 15416 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.306972 15616 raft_consensus.cc:993] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515: : Instructing follower c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.307886 15616 raft_consensus.cc:1081] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Signalling peer c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.310539 15492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:39076
I20260709 12:29:39.311018 15492 raft_consensus.cc:493] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.311321 15492 raft_consensus.cc:3060] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.314244 15416 raft_consensus.cc:515] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.316589 15416 leader_election.cc:290] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:39.318249 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:39.318897 15566 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.319510 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:39.320181 15489 raft_consensus.cc:3055] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.320475 15489 raft_consensus.cc:740] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:39.321264 15489 consensus_queue.cc:260] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.322603 15489 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.328397 15566 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:39.331251 15489 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:39.331513 15382 leader_election.cc:304] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:39.331693 15492 raft_consensus.cc:515] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.333072 15664 raft_consensus.cc:2804] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.333335 15491 raft_consensus.cc:1240] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Rejecting Update request from peer d7e060117e744a7b9bdf0d57d44e0515 for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:39.333575 15664 raft_consensus.cc:697] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:39.334498 15664 consensus_queue.cc:237] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.336490 15632 consensus_queue.cc:1059] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:39.337212 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:39.337299 15492 leader_election.cc:290] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:39.337467 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d229db978a479aa1d08ea2cac32472" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:39.338546 15566 raft_consensus.cc:3060] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.337496 15632 raft_consensus.cc:3055] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.339073 15632 raft_consensus.cc:740] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:39.339874 15632 consensus_queue.cc:260] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.341125 15632 raft_consensus.cc:3060] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.345904 15566 raft_consensus.cc:2468] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.347012 15457 leader_election.cc:304] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:39.348531 15652 raft_consensus.cc:2804] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.349035 15611 raft_consensus.cc:993] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c: : Instructing follower c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.349001 15652 raft_consensus.cc:697] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:39.349601 15669 raft_consensus.cc:1081] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Signalling peer c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.350085 15652 consensus_queue.cc:237] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.353506 15312 catalog_manager.cc:5697] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 1 to 2, leader changed from c6310cdf9ace453397b99a4a62539dee (127.7.23.66) to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.354933 15489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:39062
I20260709 12:29:39.355518 15489 raft_consensus.cc:493] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.355873 15489 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.357939 15416 raft_consensus.cc:2468] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.361308 15489 raft_consensus.cc:515] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.363261 15489 leader_election.cc:290] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:39.364356 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:39.364691 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:39.364984 15566 raft_consensus.cc:3055] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.365213 15416 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.365387 15566 raft_consensus.cc:740] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:39.366282 15566 consensus_queue.cc:260] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.367306 15566 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.369156 15312 catalog_manager.cc:5697] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 1 to 2, leader changed from d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65) to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.371809 15416 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.372046 15566 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.373096 15457 leader_election.cc:304] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:39.373741 15652 raft_consensus.cc:2804] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.374231 15652 raft_consensus.cc:697] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:39.374902 15652 consensus_queue.cc:237] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.381903 15312 catalog_manager.cc:5697] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 1 to 2, leader changed from 0bd3802eadb547e7836afff55866543c (127.7.23.67) to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.554572 15611 raft_consensus.cc:993] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c: : Instructing follower d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:39.554963 15669 raft_consensus.cc:1081] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Signalling peer d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:39.556304 15416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:57942
I20260709 12:29:39.556777 15416 raft_consensus.cc:493] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.557129 15416 raft_consensus.cc:3060] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.559325 15651 raft_consensus.cc:993] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee: : Instructing follower d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:39.559876 15651 raft_consensus.cc:1081] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Signalling peer d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:39.561393 15417 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:57952
I20260709 12:29:39.561949 15417 raft_consensus.cc:493] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.562323 15417 raft_consensus.cc:3060] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.563685 15416 raft_consensus.cc:515] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.565397 15416 leader_election.cc:290] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:39.566085 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:39.566708 15489 raft_consensus.cc:3060] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.568948 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ddcf9951827478a8bc51ec367f63d8b" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:39.568888 15417 raft_consensus.cc:515] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:39.569562 15566 raft_consensus.cc:3055] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.569897 15566 raft_consensus.cc:740] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:39.571189 15417 leader_election.cc:290] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Requested vote from peers 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:39.572105 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:39.572594 15565 raft_consensus.cc:3060] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.573173 15489 raft_consensus.cc:2468] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:39.575860 15380 leader_election.cc:304] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:39.576217 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7e7c9a5dd144e1eaf2d91ad050183b2" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:39.576702 15632 raft_consensus.cc:2804] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.576805 15489 raft_consensus.cc:3055] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.577247 15632 raft_consensus.cc:697] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:39.570593 15566 consensus_queue.cc:260] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.577809 15565 raft_consensus.cc:2468] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:39.578459 15566 raft_consensus.cc:3060] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.578123 15632 consensus_queue.cc:237] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.579144 15382 leader_election.cc:304] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:39.577257 15489 raft_consensus.cc:740] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:39.579963 15616 raft_consensus.cc:2804] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.580439 15616 raft_consensus.cc:697] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:39.580823 15489 consensus_queue.cc:260] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:39.581223 15616 consensus_queue.cc:237] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } }
I20260709 12:29:39.582237 15489 raft_consensus.cc:3060] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.587553 15312 catalog_manager.cc:5697] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 1 to 2, leader changed from 0bd3802eadb547e7836afff55866543c (127.7.23.67) to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.589200 15489 raft_consensus.cc:2468] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:39.592195 15566 raft_consensus.cc:2468] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:39.600164 15312 catalog_manager.cc:5697] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 1 to 2, leader changed from c6310cdf9ace453397b99a4a62539dee (127.7.23.66) to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.652931 15417 raft_consensus.cc:1275] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.654116 15652 consensus_queue.cc:1048] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.663348 15566 raft_consensus.cc:1275] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.665194 15689 consensus_queue.cc:1048] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:39.713930 15417 raft_consensus.cc:1275] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.715337 15669 consensus_queue.cc:1048] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.716420 15664 raft_consensus.cc:993] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515: : Instructing follower c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.716912 15616 raft_consensus.cc:1081] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Signalling peer c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:39.718605 15489 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:39076
I20260709 12:29:39.719148 15489 raft_consensus.cc:493] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:39.719554 15489 raft_consensus.cc:3060] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.723207 15490 raft_consensus.cc:3060] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.726768 15489 raft_consensus.cc:515] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.730667 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:39.730841 15489 leader_election.cc:290] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:39.731241 15416 raft_consensus.cc:3055] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:39.731598 15416 raft_consensus.cc:740] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:39.732379 15416 consensus_queue.cc:260] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.732980 15490 raft_consensus.cc:1275] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.733642 15416 raft_consensus.cc:3060] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.734789 15566 raft_consensus.cc:1275] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.736555 15634 consensus_queue.cc:1048] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.737560 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "72835d3d5e534023b9a249e58945fa10" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:39.738168 15566 raft_consensus.cc:3060] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:39.738008 15616 consensus_queue.cc:1048] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.740878 15416 raft_consensus.cc:2468] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.746132 15566 raft_consensus.cc:2468] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:39.746758 15455 leader_election.cc:304] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:39.747771 15689 raft_consensus.cc:2804] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:39.748258 15689 raft_consensus.cc:697] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:39.749069 15689 consensus_queue.cc:237] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:39.749508 15416 raft_consensus.cc:1275] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.750991 15613 consensus_queue.cc:1048] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.755398 15490 raft_consensus.cc:1275] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.756870 15616 consensus_queue.cc:1048] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.758848 15313 catalog_manager.cc:5697] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 1 to 2, leader changed from d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65) to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:39.763167 15566 raft_consensus.cc:1275] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.764618 15613 consensus_queue.cc:1048] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:29:39.857790 15416 raft_consensus.cc:1275] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.859032 15613 consensus_queue.cc:1048] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.866772 15566 raft_consensus.cc:1275] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.868553 15652 consensus_queue.cc:1048] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.975350 15490 raft_consensus.cc:1275] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.976565 15616 consensus_queue.cc:1048] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.978518 15566 raft_consensus.cc:1275] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.980002 15616 consensus_queue.cc:1048] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.984208 15565 raft_consensus.cc:1275] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.986910 15632 consensus_queue.cc:1048] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:39.992137 15490 raft_consensus.cc:1275] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:39.993522 15616 consensus_queue.cc:1048] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:40.131349 15566 raft_consensus.cc:1275] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:40.132503 15652 consensus_queue.cc:1048] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:40.140411 15416 raft_consensus.cc:1275] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:40.142350 15651 consensus_queue.cc:1048] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:42.211539 15313 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34836:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:42.214722 15313 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:42.266171 15401 tablet_service.cc:1511] Processing CreateTablet for tablet f5279a7d0ab0462d93b6dee96809b738 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:42.268086 15401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5279a7d0ab0462d93b6dee96809b738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.269776 15549 tablet_service.cc:1511] Processing CreateTablet for tablet f5279a7d0ab0462d93b6dee96809b738 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:42.267719 15481 tablet_service.cc:1511] Processing CreateTablet for tablet f5279a7d0ab0462d93b6dee96809b738 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:42.271848 15482 tablet_service.cc:1511] Processing CreateTablet for tablet 7595b00bc4e74320afdcecb624f4a639 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:42.272492 15481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5279a7d0ab0462d93b6dee96809b738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.273315 15482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7595b00bc4e74320afdcecb624f4a639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.271337 15549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5279a7d0ab0462d93b6dee96809b738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.274039 15404 tablet_service.cc:1511] Processing CreateTablet for tablet 7595b00bc4e74320afdcecb624f4a639 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:42.275439 15404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7595b00bc4e74320afdcecb624f4a639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.282944 15407 tablet_service.cc:1511] Processing CreateTablet for tablet e5671682d39e47caad2d6adf8b3bb8db (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:42.284471 15407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5671682d39e47caad2d6adf8b3bb8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.285418 15551 tablet_service.cc:1511] Processing CreateTablet for tablet 7595b00bc4e74320afdcecb624f4a639 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:42.286839 15551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7595b00bc4e74320afdcecb624f4a639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.289587 15474 tablet_service.cc:1511] Processing CreateTablet for tablet e5671682d39e47caad2d6adf8b3bb8db (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:42.291028 15474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5671682d39e47caad2d6adf8b3bb8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.301138 15550 tablet_service.cc:1511] Processing CreateTablet for tablet e5671682d39e47caad2d6adf8b3bb8db (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:42.302615 15550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5671682d39e47caad2d6adf8b3bb8db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.321978 15404 tablet_service.cc:1511] Processing CreateTablet for tablet a6ca69999a1e4f6ebafb68dc538a9bf4 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:42.323594 15404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ca69999a1e4f6ebafb68dc538a9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.323767 15474 tablet_service.cc:1511] Processing CreateTablet for tablet a6ca69999a1e4f6ebafb68dc538a9bf4 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:42.325033 15474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ca69999a1e4f6ebafb68dc538a9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.322425 15709 tablet_bootstrap.cc:492] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.333623 15406 tablet_service.cc:1511] Processing CreateTablet for tablet a231c2ac83644d198ade3545003bedbc (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:42.335062 15406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a231c2ac83644d198ade3545003bedbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.336020 15552 tablet_service.cc:1511] Processing CreateTablet for tablet a6ca69999a1e4f6ebafb68dc538a9bf4 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:42.337630 15552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ca69999a1e4f6ebafb68dc538a9bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.341225 15402 tablet_service.cc:1511] Processing CreateTablet for tablet 26b914f4a599465ba279e49020319e43 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:42.342567 15402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b914f4a599465ba279e49020319e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.349362 15553 tablet_service.cc:1511] Processing CreateTablet for tablet a231c2ac83644d198ade3545003bedbc (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:42.350737 15553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a231c2ac83644d198ade3545003bedbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.353868 15708 tablet_bootstrap.cc:492] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.353647 15482 tablet_service.cc:1511] Processing CreateTablet for tablet a231c2ac83644d198ade3545003bedbc (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:42.354983 15482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a231c2ac83644d198ade3545003bedbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.359321 15710 tablet_bootstrap.cc:492] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.363286 15401 tablet_service.cc:1511] Processing CreateTablet for tablet 76842d4b90e14bb085c47646177513f4 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:42.364641 15401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76842d4b90e14bb085c47646177513f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.366024 15551 tablet_service.cc:1511] Processing CreateTablet for tablet 26b914f4a599465ba279e49020319e43 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:42.370343 15480 tablet_service.cc:1511] Processing CreateTablet for tablet 76842d4b90e14bb085c47646177513f4 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:42.381106 15708 tablet_bootstrap.cc:654] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.381508 15551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b914f4a599465ba279e49020319e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.381577 15480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76842d4b90e14bb085c47646177513f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.385406 15475 tablet_service.cc:1511] Processing CreateTablet for tablet 219f58d7a2774e1b9edfdda4d155077e (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:42.386752 15475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219f58d7a2774e1b9edfdda4d155077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.387089 15710 tablet_bootstrap.cc:654] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.371922 15481 tablet_service.cc:1511] Processing CreateTablet for tablet 26b914f4a599465ba279e49020319e43 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:42.371826 15550 tablet_service.cc:1511] Processing CreateTablet for tablet 76842d4b90e14bb085c47646177513f4 (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:42.373188 15403 tablet_service.cc:1511] Processing CreateTablet for tablet 219f58d7a2774e1b9edfdda4d155077e (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:42.393090 15403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219f58d7a2774e1b9edfdda4d155077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.397821 15708 tablet_bootstrap.cc:492] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.399063 15552 tablet_service.cc:1511] Processing CreateTablet for tablet 219f58d7a2774e1b9edfdda4d155077e (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:42.400112 15550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76842d4b90e14bb085c47646177513f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.400970 15552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 219f58d7a2774e1b9edfdda4d155077e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.404488 15481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b914f4a599465ba279e49020319e43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.400045 15708 ts_tablet_manager.cc:1403] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.000s
I20260709 12:29:42.407240 15404 tablet_service.cc:1511] Processing CreateTablet for tablet f31dc3dc5b624fba9bf43327b0f2cd1d (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:42.408610 15404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31dc3dc5b624fba9bf43327b0f2cd1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.412272 15708 raft_consensus.cc:359] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.414707 15708 raft_consensus.cc:385] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.415535 15708 raft_consensus.cc:740] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.417227 15709 tablet_bootstrap.cc:654] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.417269 15708 consensus_queue.cc:260] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.424614 15710 tablet_bootstrap.cc:492] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.425174 15710 ts_tablet_manager.cc:1403] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.000s
I20260709 12:29:42.428534 15474 tablet_service.cc:1511] Processing CreateTablet for tablet f31dc3dc5b624fba9bf43327b0f2cd1d (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:42.429978 15708 ts_tablet_manager.cc:1434] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:29:42.441574 15709 tablet_bootstrap.cc:492] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.442198 15709 ts_tablet_manager.cc:1403] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.120s	user 0.016s	sys 0.000s
I20260709 12:29:42.446954 15709 raft_consensus.cc:359] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.447893 15709 raft_consensus.cc:385] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.448232 15709 raft_consensus.cc:740] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.449365 15708 tablet_bootstrap.cc:492] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.449090 15709 consensus_queue.cc:260] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.429890 15474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31dc3dc5b624fba9bf43327b0f2cd1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.430748 15710 raft_consensus.cc:359] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.434437 15553 tablet_service.cc:1511] Processing CreateTablet for tablet f31dc3dc5b624fba9bf43327b0f2cd1d (DEFAULT_TABLE table=soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:42.453258 15710 raft_consensus.cc:385] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.453573 15710 raft_consensus.cc:740] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.453900 15553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f31dc3dc5b624fba9bf43327b0f2cd1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:42.454720 15710 consensus_queue.cc:260] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.460568 15694 raft_consensus.cc:493] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.461030 15694 raft_consensus.cc:515] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.462637 15709 ts_tablet_manager.cc:1434] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:29:42.463786 15709 tablet_bootstrap.cc:492] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.466585 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.467373 15416 raft_consensus.cc:2468] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:42.469415 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:42.471956 15709 tablet_bootstrap.cc:654] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:42.473234 15529 leader_election.cc:343] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.474007 15529 leader_election.cc:304] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:42.463253 15694 leader_election.cc:290] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:42.475803 15694 raft_consensus.cc:2804] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.476136 15694 raft_consensus.cc:493] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.476480 15694 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.485216 15709 tablet_bootstrap.cc:492] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.484483 15694 raft_consensus.cc:515] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.485809 15709 ts_tablet_manager.cc:1403] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:29:42.489025 15709 raft_consensus.cc:359] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.489677 15709 raft_consensus.cc:385] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.489955 15709 raft_consensus.cc:740] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.490811 15709 consensus_queue.cc:260] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.493923 15709 ts_tablet_manager.cc:1434] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:42.494861 15709 tablet_bootstrap.cc:492] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.494961 15708 tablet_bootstrap.cc:654] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.498773 15710 ts_tablet_manager.cc:1434] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.073s	user 0.020s	sys 0.015s
I20260709 12:29:42.499967 15710 tablet_bootstrap.cc:492] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.506769 15710 tablet_bootstrap.cc:654] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.507597 15709 tablet_bootstrap.cc:654] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.512884 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:42.513556 15416 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.521809 15416 raft_consensus.cc:2468] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:42.523941 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:42.523430 15709 tablet_bootstrap.cc:492] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.525138 15709 ts_tablet_manager.cc:1403] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
I20260709 12:29:42.525503 15529 leader_election.cc:304] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:42.526562 15714 raft_consensus.cc:2804] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.527058 15714 raft_consensus.cc:697] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:42.527944 15714 consensus_queue.cc:237] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.523831 15694 leader_election.cc:290] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:42.528266 15709 raft_consensus.cc:359] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.529969 15709 raft_consensus.cc:385] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.530268 15709 raft_consensus.cc:740] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.531009 15709 consensus_queue.cc:260] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
W20260709 12:29:42.533152 15529 leader_election.cc:343] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.533968 15709 ts_tablet_manager.cc:1434] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:29:42.535216 15709 tablet_bootstrap.cc:492] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.535754 15708 tablet_bootstrap.cc:492] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.536330 15708 ts_tablet_manager.cc:1403] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.087s	user 0.023s	sys 0.019s
I20260709 12:29:42.539460 15708 raft_consensus.cc:359] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.540208 15708 raft_consensus.cc:385] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.540519 15708 raft_consensus.cc:740] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.541272 15708 consensus_queue.cc:260] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.542114 15709 tablet_bootstrap.cc:654] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.543726 15708 ts_tablet_manager.cc:1434] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:42.544773 15708 tablet_bootstrap.cc:492] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.546272 15710 tablet_bootstrap.cc:492] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.546793 15710 ts_tablet_manager.cc:1403] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.026s
I20260709 12:29:42.549837 15710 raft_consensus.cc:359] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.550474 15710 raft_consensus.cc:385] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.550755 15710 raft_consensus.cc:740] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.551798 15708 tablet_bootstrap.cc:654] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.551524 15710 consensus_queue.cc:260] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.553895 15710 ts_tablet_manager.cc:1434] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:42.554792 15710 tablet_bootstrap.cc:492] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.561287 15710 tablet_bootstrap.cc:654] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.573590 15710 tablet_bootstrap.cc:492] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.574280 15710 ts_tablet_manager.cc:1403] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:29:42.577584 15710 raft_consensus.cc:359] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.578567 15710 raft_consensus.cc:385] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.578938 15710 raft_consensus.cc:740] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.579965 15710 consensus_queue.cc:260] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.583060 15710 ts_tablet_manager.cc:1434] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:42.584301 15710 tablet_bootstrap.cc:492] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.586627 15709 tablet_bootstrap.cc:492] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.587234 15709 ts_tablet_manager.cc:1403] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.052s	user 0.028s	sys 0.012s
I20260709 12:29:42.587729 15708 tablet_bootstrap.cc:492] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.588327 15708 ts_tablet_manager.cc:1403] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.016s
I20260709 12:29:42.588671 15312 catalog_manager.cc:5697] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 1 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:42.590409 15709 raft_consensus.cc:359] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.590917 15710 tablet_bootstrap.cc:654] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.591195 15709 raft_consensus.cc:385] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.591605 15709 raft_consensus.cc:740] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.591373 15708 raft_consensus.cc:359] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.592272 15708 raft_consensus.cc:385] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.592629 15708 raft_consensus.cc:740] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.592582 15709 consensus_queue.cc:260] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.593770 15708 consensus_queue.cc:260] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.596194 15709 ts_tablet_manager.cc:1434] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:42.597302 15709 tablet_bootstrap.cc:492] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.596230 15708 ts_tablet_manager.cc:1434] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:42.599958 15708 tablet_bootstrap.cc:492] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.603655 15710 tablet_bootstrap.cc:492] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.603842 15709 tablet_bootstrap.cc:654] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.604190 15710 ts_tablet_manager.cc:1403] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:29:42.607295 15710 raft_consensus.cc:359] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.608006 15710 raft_consensus.cc:385] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.608283 15710 raft_consensus.cc:740] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.608996 15710 consensus_queue.cc:260] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.611198 15710 ts_tablet_manager.cc:1434] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:29:42.615980 15709 tablet_bootstrap.cc:492] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.620242 15708 tablet_bootstrap.cc:654] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.620618 15709 ts_tablet_manager.cc:1403] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.004s
W20260709 12:29:42.618196 15363 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:42.620252 15710 tablet_bootstrap.cc:492] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.623870 15709 raft_consensus.cc:359] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.624670 15709 raft_consensus.cc:385] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.624965 15709 raft_consensus.cc:740] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.625769 15709 consensus_queue.cc:260] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.628225 15709 ts_tablet_manager.cc:1434] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:29:42.629360 15709 tablet_bootstrap.cc:492] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.630154 15710 tablet_bootstrap.cc:654] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.633056 15695 raft_consensus.cc:493] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.633631 15695 raft_consensus.cc:515] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.637751 15709 tablet_bootstrap.cc:654] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.638152 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.639727 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.640307 15695 leader_election.cc:290] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
W20260709 12:29:42.641166 15457 leader_election.cc:343] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:42.642506 15455 leader_election.cc:343] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.643003 15708 tablet_bootstrap.cc:492] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.642910 15455 leader_election.cc:304] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee; no voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:42.643586 15708 ts_tablet_manager.cc:1403] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.002s
I20260709 12:29:42.643750 15695 raft_consensus.cc:2749] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.646396 15710 tablet_bootstrap.cc:492] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.646747 15709 tablet_bootstrap.cc:492] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.646816 15710 ts_tablet_manager.cc:1403] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.002s
I20260709 12:29:42.647435 15709 ts_tablet_manager.cc:1403] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:29:42.646831 15708 raft_consensus.cc:359] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.648013 15708 raft_consensus.cc:385] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.648372 15708 raft_consensus.cc:740] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.649207 15708 consensus_queue.cc:260] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.650267 15710 raft_consensus.cc:359] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.650560 15709 raft_consensus.cc:359] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.650976 15710 raft_consensus.cc:385] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.651297 15709 raft_consensus.cc:385] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.651366 15710 raft_consensus.cc:740] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.651713 15709 raft_consensus.cc:740] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.652283 15710 consensus_queue.cc:260] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.652910 15708 ts_tablet_manager.cc:1434] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:29:42.654166 15708 tablet_bootstrap.cc:492] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.654844 15710 ts_tablet_manager.cc:1434] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:29:42.655906 15710 tablet_bootstrap.cc:492] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.652786 15709 consensus_queue.cc:260] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.658172 15616 raft_consensus.cc:493] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.658663 15709 ts_tablet_manager.cc:1434] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:29:42.678421 15709 tablet_bootstrap.cc:492] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.682876 15708 tablet_bootstrap.cc:654] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.684001 15710 tablet_bootstrap.cc:654] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.687310 15709 tablet_bootstrap.cc:654] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.678257 15616 raft_consensus.cc:515] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.700263 15616 leader_election.cc:290] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.700492 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ca69999a1e4f6ebafb68dc538a9bf4" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.701114 15566 raft_consensus.cc:2468] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:42.701455 15710 tablet_bootstrap.cc:492] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.702046 15710 ts_tablet_manager.cc:1403] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.002s
I20260709 12:29:42.702436 15382 leader_election.cc:304] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:42.705610 15710 raft_consensus.cc:359] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.706532 15710 raft_consensus.cc:385] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.706840 15710 raft_consensus.cc:740] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.707326 15709 tablet_bootstrap.cc:492] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.707828 15709 ts_tablet_manager.cc:1403] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.048s	user 0.025s	sys 0.008s
I20260709 12:29:42.707636 15710 consensus_queue.cc:260] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.709208 15730 raft_consensus.cc:2804] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.709614 15730 raft_consensus.cc:493] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.709951 15730 raft_consensus.cc:3060] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.710172 15710 ts_tablet_manager.cc:1434] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:29:42.713385 15710 tablet_bootstrap.cc:492] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.714253 15709 raft_consensus.cc:359] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.715024 15709 raft_consensus.cc:385] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.715304 15709 raft_consensus.cc:740] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.716092 15709 consensus_queue.cc:260] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.717842 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ca69999a1e4f6ebafb68dc538a9bf4" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:42.718357 15709 ts_tablet_manager.cc:1434] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:29:42.718523 15490 raft_consensus.cc:2468] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:42.720402 15710 tablet_bootstrap.cc:654] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.721211 15709 tablet_bootstrap.cc:492] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.727721 15709 tablet_bootstrap.cc:654] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.731112 15708 tablet_bootstrap.cc:492] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.731524 15710 tablet_bootstrap.cc:492] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.731635 15708 ts_tablet_manager.cc:1403] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.078s	user 0.016s	sys 0.006s
I20260709 12:29:42.732198 15710 ts_tablet_manager.cc:1403] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:29:42.732640 15709 tablet_bootstrap.cc:492] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.733037 15709 ts_tablet_manager.cc:1403] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:29:42.734907 15708 raft_consensus.cc:359] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.735046 15710 raft_consensus.cc:359] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.735044 15709 raft_consensus.cc:359] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.735739 15708 raft_consensus.cc:385] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.735847 15710 raft_consensus.cc:385] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.736191 15709 raft_consensus.cc:385] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.736284 15708 raft_consensus.cc:740] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.736393 15710 raft_consensus.cc:740] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.736595 15709 raft_consensus.cc:740] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.737200 15708 consensus_queue.cc:260] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.737360 15730 raft_consensus.cc:515] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.737620 15709 consensus_queue.cc:260] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.737640 15710 consensus_queue.cc:260] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.740653 15710 ts_tablet_manager.cc:1434] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:42.740787 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ca69999a1e4f6ebafb68dc538a9bf4" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:42.741429 15566 raft_consensus.cc:3060] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.741912 15710 tablet_bootstrap.cc:492] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.744410 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ca69999a1e4f6ebafb68dc538a9bf4" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:42.745045 15490 raft_consensus.cc:3060] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.750129 15566 raft_consensus.cc:2468] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:42.751603 15382 leader_election.cc:304] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:42.752463 15730 leader_election.cc:290] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.753018 15730 raft_consensus.cc:2804] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.753731 15730 raft_consensus.cc:697] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:42.754590 15730 consensus_queue.cc:237] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.755122 15709 ts_tablet_manager.cc:1434] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:29:42.755164 15710 tablet_bootstrap.cc:654] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.756362 15709 tablet_bootstrap.cc:492] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee: Bootstrap starting.
I20260709 12:29:42.754503 15708 ts_tablet_manager.cc:1434] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:29:42.759356 15708 tablet_bootstrap.cc:492] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.762517 15709 tablet_bootstrap.cc:654] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.766161 15708 tablet_bootstrap.cc:654] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.768941 15490 raft_consensus.cc:2468] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:42.775439 15710 tablet_bootstrap.cc:492] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.775990 15710 ts_tablet_manager.cc:1403] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.008s
I20260709 12:29:42.777168 15695 raft_consensus.cc:493] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.777755 15695 raft_consensus.cc:515] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.778998 15710 raft_consensus.cc:359] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.779749 15710 raft_consensus.cc:385] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.779979 15695 leader_election.cc:290] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.780063 15710 raft_consensus.cc:740] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.780966 15710 consensus_queue.cc:260] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.782332 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.782994 15566 raft_consensus.cc:2468] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:42.784308 15695 raft_consensus.cc:493] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.784245 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.785025 15416 raft_consensus.cc:2468] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:42.784909 15695 raft_consensus.cc:515] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.785338 15315 catalog_manager.cc:5697] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.786114 15457 leader_election.cc:304] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:42.788015 15695 leader_election.cc:290] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.788507 15695 raft_consensus.cc:2804] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.788851 15695 raft_consensus.cc:493] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.788977 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.791121 15710 ts_tablet_manager.cc:1434] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:29:42.792294 15710 tablet_bootstrap.cc:492] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c: Bootstrap starting.
I20260709 12:29:42.789220 15695 raft_consensus.cc:3060] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.794103 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.799157 15741 raft_consensus.cc:493] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.795699 15730 raft_consensus.cc:493] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.799674 15416 raft_consensus.cc:2393] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6310cdf9ace453397b99a4a62539dee in current term 1: Already voted for candidate 0bd3802eadb547e7836afff55866543c in this term.
I20260709 12:29:42.800058 15730 raft_consensus.cc:515] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.799696 15741 raft_consensus.cc:515] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.802220 15730 leader_election.cc:290] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.797045 15709 tablet_bootstrap.cc:492] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee: No bootstrap required, opened a new log
I20260709 12:29:42.803038 15709 ts_tablet_manager.cc:1403] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.026s
I20260709 12:29:42.802919 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:42.803236 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.803612 15490 raft_consensus.cc:2468] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:42.803884 15566 raft_consensus.cc:2468] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:42.798012 15742 raft_consensus.cc:493] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.804476 15742 raft_consensus.cc:515] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.804852 15380 leader_election.cc:304] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:42.804061 15710 tablet_bootstrap.cc:654] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.805930 15709 raft_consensus.cc:359] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.806604 15709 raft_consensus.cc:385] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.806721 15742 leader_election.cc:290] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.807308 15742 raft_consensus.cc:493] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.807840 15730 raft_consensus.cc:2804] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.808782 15730 raft_consensus.cc:493] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.809576 15730 raft_consensus.cc:3060] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.808948 15741 leader_election.cc:290] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.797647 15708 tablet_bootstrap.cc:492] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.811813 15708 ts_tablet_manager.cc:1403] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 12:29:42.806852 15709 raft_consensus.cc:740] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.807722 15742 raft_consensus.cc:515] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.814990 15708 raft_consensus.cc:359] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.815853 15708 raft_consensus.cc:385] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.815719 15695 raft_consensus.cc:515] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.816263 15708 raft_consensus.cc:740] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.817085 15742 leader_election.cc:290] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.816141 15709 consensus_queue.cc:260] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.817807 15708 consensus_queue.cc:260] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.817735 15695 leader_election.cc:290] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.819846 15710 tablet_bootstrap.cc:492] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c: No bootstrap required, opened a new log
I20260709 12:29:42.820418 15710 ts_tablet_manager.cc:1403] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.003s
I20260709 12:29:42.821676 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b914f4a599465ba279e49020319e43" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.822254 15566 raft_consensus.cc:2468] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:42.823385 15714 raft_consensus.cc:493] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:42.823678 15710 raft_consensus.cc:359] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.823858 15714 raft_consensus.cc:515] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.824462 15710 raft_consensus.cc:385] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.824791 15710 raft_consensus.cc:740] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.825685 15710 consensus_queue.cc:260] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.826051 15714 leader_election.cc:290] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:42.827952 15710 ts_tablet_manager.cc:1434] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:29:42.827741 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.828500 15416 raft_consensus.cc:2468] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:42.828692 15566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.829288 15566 raft_consensus.cc:2468] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:42.829492 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76842d4b90e14bb085c47646177513f4" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:42.829800 15529 leader_election.cc:304] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:42.830160 15565 raft_consensus.cc:2468] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:42.830567 15714 raft_consensus.cc:2804] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.830957 15714 raft_consensus.cc:493] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.831290 15714 raft_consensus.cc:3060] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.832104 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:42.832679 15565 raft_consensus.cc:3060] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.839572 15714 raft_consensus.cc:515] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.840291 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:42.841012 15490 raft_consensus.cc:2468] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:42.842044 15714 leader_election.cc:290] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:42.842707 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:42.843506 15416 raft_consensus.cc:3060] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.845479 15565 raft_consensus.cc:2468] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:42.820302 15709 ts_tablet_manager.cc:1434] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:29:42.849400 15730 raft_consensus.cc:515] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.851586 15416 raft_consensus.cc:2468] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:42.842675 15457 leader_election.cc:304] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:42.852885 15529 leader_election.cc:304] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:42.853685 15743 raft_consensus.cc:2804] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.853770 15714 raft_consensus.cc:2804] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.854171 15743 raft_consensus.cc:493] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.854529 15743 raft_consensus.cc:3060] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.855019 15714 raft_consensus.cc:697] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:42.856010 15730 leader_election.cc:290] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.855924 15714 consensus_queue.cc:237] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.857533 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:42.858053 15490 raft_consensus.cc:3060] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.858573 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:42.859127 15565 raft_consensus.cc:3060] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.862536 15743 raft_consensus.cc:515] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.853703 15457 leader_election.cc:304] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:42.864504 15457 leader_election.cc:304] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:42.865513 15457 leader_election.cc:304] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:42.866195 15742 raft_consensus.cc:2804] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:42.866580 15742 raft_consensus.cc:493] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:42.866900 15742 raft_consensus.cc:3060] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.871896 15744 raft_consensus.cc:2804] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.873608 15490 raft_consensus.cc:2468] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:42.874191 15695 raft_consensus.cc:2764] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:29:42.876950 15565 raft_consensus.cc:2468] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:42.876995 15380 leader_election.cc:304] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:42.878032 15744 raft_consensus.cc:697] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:42.878929 15744 consensus_queue.cc:237] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.878976 15734 raft_consensus.cc:2804] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.880424 15734 raft_consensus.cc:697] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:42.881183 15734 consensus_queue.cc:237] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.885270 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:42.885973 15489 raft_consensus.cc:3060] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.887837 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b914f4a599465ba279e49020319e43" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.888609 15416 raft_consensus.cc:2468] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 0.
I20260709 12:29:42.877516 15742 raft_consensus.cc:515] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.891206 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.892840 15743 leader_election.cc:290] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.893760 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b914f4a599465ba279e49020319e43" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:42.894347 15565 raft_consensus.cc:3060] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.897481 15489 raft_consensus.cc:2468] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:42.897589 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76842d4b90e14bb085c47646177513f4" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:42.900071 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:42.900677 15416 raft_consensus.cc:3060] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.901259 15565 raft_consensus.cc:2468] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:42.851701 15708 ts_tablet_manager.cc:1434] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:29:42.902846 15708 tablet_bootstrap.cc:492] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.903349 15457 leader_election.cc:304] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:42.909667 15455 leader_election.cc:304] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee; no voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:42.910908 15744 raft_consensus.cc:2804] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.911496 15741 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.911885 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76842d4b90e14bb085c47646177513f4" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:42.912827 15565 raft_consensus.cc:3060] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.915746 15742 leader_election.cc:290] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:42.918128 15314 catalog_manager.cc:5697] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 0 to 1, leader changed from <none> to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 1 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.918885 15741 raft_consensus.cc:2749] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:42.919549 15744 raft_consensus.cc:697] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
W20260709 12:29:42.920035 15455 leader_election.cc:343] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.920419 15744 consensus_queue.cc:237] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.923429 15708 tablet_bootstrap.cc:654] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.929950 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b914f4a599465ba279e49020319e43" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:42.931615 15417 raft_consensus.cc:3060] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:42.931260 15415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76842d4b90e14bb085c47646177513f4" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:42.936933 15314 catalog_manager.cc:5697] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.940232 15417 raft_consensus.cc:2468] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:42.928570 15416 raft_consensus.cc:2468] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
W20260709 12:29:42.943881 15455 leader_election.cc:343] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:42.949393 15315 catalog_manager.cc:5697] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 0 to 1, leader changed from <none> to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 1 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.950459 15708 tablet_bootstrap.cc:492] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.951040 15708 ts_tablet_manager.cc:1403] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.003s
I20260709 12:29:42.951683 15312 catalog_manager.cc:5697] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 1 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:42.954223 15708 raft_consensus.cc:359] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.954959 15708 raft_consensus.cc:385] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.955228 15708 raft_consensus.cc:740] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.952457 15565 raft_consensus.cc:2468] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 1.
I20260709 12:29:42.955981 15708 consensus_queue.cc:260] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.956405 15457 leader_election.cc:304] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:42.957536 15744 raft_consensus.cc:2804] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:42.957980 15744 raft_consensus.cc:697] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:42.958575 15708 ts_tablet_manager.cc:1434] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:42.958781 15744 consensus_queue.cc:237] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.959631 15708 tablet_bootstrap.cc:492] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.966745 15708 tablet_bootstrap.cc:654] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.971323 15708 tablet_bootstrap.cc:492] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:42.971752 15708 ts_tablet_manager.cc:1403] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.004s
I20260709 12:29:42.971692 15314 catalog_manager.cc:5697] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 0 to 1, leader changed from <none> to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 1 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:42.975272 15708 raft_consensus.cc:359] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.975903 15708 raft_consensus.cc:385] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:42.977095 15708 raft_consensus.cc:740] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:42.976609 15714 consensus_queue.cc:1048] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:42.977891 15708 consensus_queue.cc:260] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:42.982529 15708 ts_tablet_manager.cc:1434] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:29:42.983234 15708 tablet_bootstrap.cc:492] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: Bootstrap starting.
I20260709 12:29:42.989784 15708 tablet_bootstrap.cc:654] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:42.999619 15714 consensus_queue.cc:1048] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.000759 15708 tablet_bootstrap.cc:492] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: No bootstrap required, opened a new log
I20260709 12:29:43.001272 15708 ts_tablet_manager.cc:1403] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:29:43.003945 15708 raft_consensus.cc:359] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.004597 15708 raft_consensus.cc:385] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:43.004868 15708 raft_consensus.cc:740] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Initialized, Role: FOLLOWER
I20260709 12:29:43.005515 15708 consensus_queue.cc:260] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.007566 15708 ts_tablet_manager.cc:1434] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:29:43.057276 15714 raft_consensus.cc:493] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.057798 15714 raft_consensus.cc:515] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.059422 15714 leader_election.cc:290] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:43.060195 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515" is_pre_election: true
I20260709 12:29:43.060467 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:43.060778 15417 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:43.061040 15489 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 0.
I20260709 12:29:43.061710 15529 leader_election.cc:304] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:43.062278 15714 raft_consensus.cc:2804] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.062572 15714 raft_consensus.cc:493] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.062809 15714 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.067867 15714 raft_consensus.cc:515] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.069271 15714 leader_election.cc:290] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:43.069918 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:43.070160 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:43.070425 15417 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.070691 15489 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.075198 15417 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:43.075273 15489 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 1.
I20260709 12:29:43.076594 15529 leader_election.cc:304] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:43.077210 15714 raft_consensus.cc:2804] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.077596 15714 raft_consensus.cc:697] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:43.078601 15714 consensus_queue.cc:237] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.085269 15314 catalog_manager.cc:5697] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 1 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:43.154655 15734 consensus_queue.cc:1048] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.166862 15730 raft_consensus.cc:493] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.165493 15734 consensus_queue.cc:1048] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:43.167361 15730 raft_consensus.cc:515] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.169498 15730 leader_election.cc:290] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.170202 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76842d4b90e14bb085c47646177513f4" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:43.171028 15564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76842d4b90e14bb085c47646177513f4" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:43.171924 15564 raft_consensus.cc:2393] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7e060117e744a7b9bdf0d57d44e0515 in current term 1: Already voted for candidate c6310cdf9ace453397b99a4a62539dee in this term.
I20260709 12:29:43.172895 15382 leader_election.cc:304] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7e060117e744a7b9bdf0d57d44e0515; no voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:43.173736 15730 raft_consensus.cc:3060] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.180297 15730 raft_consensus.cc:2749] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:43.211228 15730 raft_consensus.cc:493] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:43.211676 15730 raft_consensus.cc:515] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.213352 15730 leader_election.cc:290] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.214145 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee" is_pre_election: true
I20260709 12:29:43.214385 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c" is_pre_election: true
I20260709 12:29:43.214861 15489 raft_consensus.cc:2468] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:43.214963 15565 raft_consensus.cc:2468] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 0.
I20260709 12:29:43.215924 15380 leader_election.cc:304] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:43.216667 15730 raft_consensus.cc:2804] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:43.216945 15730 raft_consensus.cc:493] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:43.217190 15730 raft_consensus.cc:3060] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.221951 15730 raft_consensus.cc:515] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.223390 15730 leader_election.cc:290] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.224015 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:43.224310 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:43.224509 15489 raft_consensus.cc:3060] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.224805 15565 raft_consensus.cc:3060] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:43.229440 15489 raft_consensus.cc:2468] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:43.229604 15565 raft_consensus.cc:2468] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 1.
I20260709 12:29:43.230443 15380 leader_election.cc:304] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:43.231088 15730 raft_consensus.cc:2804] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:43.231573 15730 raft_consensus.cc:697] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:43.232338 15730 consensus_queue.cc:237] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.239346 15312 catalog_manager.cc:5697] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.282852 15730 consensus_queue.cc:1048] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.283631 15744 consensus_queue.cc:1048] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.289892 15730 consensus_queue.cc:1048] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.297554 15744 consensus_queue.cc:1048] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.366948 15741 consensus_queue.cc:1048] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.367264 15744 consensus_queue.cc:1048] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.379928 15695 consensus_queue.cc:1048] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.385694 15695 consensus_queue.cc:1048] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:43.406013 15714 consensus_queue.cc:1048] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.417066 15694 consensus_queue.cc:1048] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.419998 15565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
mode: GRACEFUL
new_leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:52680
I20260709 12:29:43.420697 15565 raft_consensus.cc:606] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Received request to transfer leadership to TS d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:43.426558 15489 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
mode: GRACEFUL
new_leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:39080
I20260709 12:29:43.427076 15489 raft_consensus.cc:606] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Received request to transfer leadership to TS d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:43.432641 15565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
mode: GRACEFUL
new_leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:52680
I20260709 12:29:43.433250 15565 raft_consensus.cc:606] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Received request to transfer leadership to TS d7e060117e744a7b9bdf0d57d44e0515
I20260709 12:29:43.437038 15715 raft_consensus.cc:993] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: : Instructing follower d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:43.437469 15714 raft_consensus.cc:1081] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Signalling peer d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:43.439036 15416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:57942
I20260709 12:29:43.439508 15416 raft_consensus.cc:493] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:43.439832 15416 raft_consensus.cc:3060] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.445246 15417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
mode: GRACEFUL
new_leader_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:57954
I20260709 12:29:43.445444 15416 raft_consensus.cc:515] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.445786 15417 raft_consensus.cc:606] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Received request to transfer leadership to TS c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:43.447762 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:43.447862 15416 leader_election.cc:290] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.448382 15489 raft_consensus.cc:3060] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.448534 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5671682d39e47caad2d6adf8b3bb8db" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:43.450768 15565 raft_consensus.cc:3055] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:43.451072 15565 raft_consensus.cc:740] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:43.451844 15565 consensus_queue.cc:260] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.453092 15565 raft_consensus.cc:3060] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.454910 15489 raft_consensus.cc:2468] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:43.455826 15380 leader_election.cc:304] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:43.456595 15730 raft_consensus.cc:2804] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:43.457063 15730 raft_consensus.cc:697] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:43.457831 15730 consensus_queue.cc:237] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.459017 15565 raft_consensus.cc:2468] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:43.461277 15565 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
mode: GRACEFUL
new_leader_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:52680
I20260709 12:29:43.461706 15565 raft_consensus.cc:606] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Received request to transfer leadership to TS c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:43.465029 15314 catalog_manager.cc:5697] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 1 to 2, leader changed from 0bd3802eadb547e7836afff55866543c (127.7.23.67) to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.466133 15416 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
mode: GRACEFUL
new_leader_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:57954
I20260709 12:29:43.466691 15416 raft_consensus.cc:606] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Received request to transfer leadership to TS 0bd3802eadb547e7836afff55866543c
I20260709 12:29:43.504384 15714 raft_consensus.cc:993] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: : Instructing follower d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:43.504814 15715 raft_consensus.cc:1081] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Signalling peer d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:43.506125 15416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:57942
I20260709 12:29:43.506567 15416 raft_consensus.cc:493] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:43.506806 15416 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.511919 15416 raft_consensus.cc:515] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.513496 15416 leader_election.cc:290] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.514168 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:43.514777 15489 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.514827 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:43.515461 15565 raft_consensus.cc:3055] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:43.515728 15565 raft_consensus.cc:740] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:43.516350 15565 consensus_queue.cc:260] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.517230 15565 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.521241 15489 raft_consensus.cc:2468] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:43.522872 15380 leader_election.cc:304] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:43.523433 15565 raft_consensus.cc:2468] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:43.523515 15730 raft_consensus.cc:2804] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:43.524009 15730 raft_consensus.cc:697] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:43.524710 15730 consensus_queue.cc:237] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.530567 15314 catalog_manager.cc:5697] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 1 to 2, leader changed from 0bd3802eadb547e7836afff55866543c (127.7.23.67) to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.618978 15715 consensus_queue.cc:1048] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.631081 15715 consensus_queue.cc:1048] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.638506 15715 raft_consensus.cc:993] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: : Instructing follower c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:43.638947 15715 raft_consensus.cc:1081] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Signalling peer c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:43.640717 15490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:39062
I20260709 12:29:43.641270 15490 raft_consensus.cc:493] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:43.641664 15490 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.647639 15490 raft_consensus.cc:515] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.649255 15490 leader_election.cc:290] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.650312 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:43.650868 15565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:43.650880 15416 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.651579 15565 raft_consensus.cc:3055] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:43.651887 15565 raft_consensus.cc:740] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:43.652654 15565 consensus_queue.cc:260] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.653710 15565 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.658888 15416 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:43.660132 15455 leader_election.cc:304] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6310cdf9ace453397b99a4a62539dee, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:43.660524 15565 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:43.660946 15695 raft_consensus.cc:2804] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:43.661402 15695 raft_consensus.cc:697] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:43.662156 15695 consensus_queue.cc:237] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.668277 15312 catalog_manager.cc:5697] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 1 to 2, leader changed from 0bd3802eadb547e7836afff55866543c (127.7.23.67) to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.677788 15730 consensus_queue.cc:1048] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.684195 15734 raft_consensus.cc:993] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: : Instructing follower 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:43.684653 15616 raft_consensus.cc:1081] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Signalling peer 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:43.687745 15564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:29:43.688295 15564 raft_consensus.cc:493] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:43.688658 15564 raft_consensus.cc:3060] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.696071 15730 consensus_queue.cc:1048] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:43.696156 15564 raft_consensus.cc:515] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.698777 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:43.699338 15416 raft_consensus.cc:3055] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:43.699474 15564 leader_election.cc:290] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:43.699751 15416 raft_consensus.cc:740] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:43.700834 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f31dc3dc5b624fba9bf43327b0f2cd1d" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:43.701215 15416 consensus_queue.cc:260] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.702435 15416 raft_consensus.cc:3060] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.708470 15416 raft_consensus.cc:2468] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 2.
I20260709 12:29:43.709368 15529 leader_election.cc:304] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: c6310cdf9ace453397b99a4a62539dee
I20260709 12:29:43.710115 15694 raft_consensus.cc:2804] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:43.710532 15694 raft_consensus.cc:697] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 2 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:43.711210 15694 consensus_queue.cc:237] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.717041 15314 catalog_manager.cc:5697] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 1 to 2, leader changed from d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65) to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 2 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:43.730203 15744 raft_consensus.cc:993] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: : Instructing follower d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:43.730631 15741 raft_consensus.cc:1081] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Signalling peer d7e060117e744a7b9bdf0d57d44e0515 to start an election
I20260709 12:29:43.732054 15416 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
 from {username='slave'} at 127.0.0.1:57952
I20260709 12:29:43.732489 15416 raft_consensus.cc:493] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:43.732733 15416 raft_consensus.cc:3060] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.737363 15416 raft_consensus.cc:515] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.738770 15416 leader_election.cc:290] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Requested vote from peers c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.739537 15490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:43.739805 15564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7595b00bc4e74320afdcecb624f4a639" candidate_uuid: "d7e060117e744a7b9bdf0d57d44e0515" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:43.740214 15490 raft_consensus.cc:3055] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:43.740417 15564 raft_consensus.cc:3060] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.740577 15490 raft_consensus.cc:740] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:43.741557 15490 consensus_queue.cc:260] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.742800 15490 raft_consensus.cc:3060] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.745865 15564 raft_consensus.cc:2468] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:43.746953 15382 leader_election.cc:304] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:43.747632 15730 raft_consensus.cc:2804] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:43.747864 15490 raft_consensus.cc:2468] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7e060117e744a7b9bdf0d57d44e0515 in term 2.
I20260709 12:29:43.748112 15730 raft_consensus.cc:697] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Leader. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:43.748997 15730 consensus_queue.cc:237] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.755262 15314 catalog_manager.cc:5697] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 reported cstate change: term changed from 1 to 2, leader changed from c6310cdf9ace453397b99a4a62539dee (127.7.23.66) to d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "d7e060117e744a7b9bdf0d57d44e0515" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:43.837215 15490 raft_consensus.cc:1275] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:43.838389 15730 consensus_queue.cc:1048] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:43.840626 15564 raft_consensus.cc:1275] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:43.841998 15730 consensus_queue.cc:1048] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:43.908363 15730 raft_consensus.cc:993] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: : Instructing follower c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:43.908761 15734 raft_consensus.cc:1081] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Signalling peer c6310cdf9ace453397b99a4a62539dee to start an election
I20260709 12:29:43.910121 15490 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
 from {username='slave'} at 127.0.0.1:39076
I20260709 12:29:43.910576 15490 raft_consensus.cc:493] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:43.910861 15490 raft_consensus.cc:3060] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.916622 15490 raft_consensus.cc:515] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.918113 15490 leader_election.cc:290] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), 0bd3802eadb547e7836afff55866543c (127.7.23.67:44305)
I20260709 12:29:43.918892 15416 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:43.919093 15564 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a231c2ac83644d198ade3545003bedbc" candidate_uuid: "c6310cdf9ace453397b99a4a62539dee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bd3802eadb547e7836afff55866543c"
I20260709 12:29:43.919461 15416 raft_consensus.cc:3055] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:43.919641 15564 raft_consensus.cc:3060] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.919759 15416 raft_consensus.cc:740] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:43.920463 15416 consensus_queue.cc:260] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.921312 15416 raft_consensus.cc:3060] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:43.924559 15564 raft_consensus.cc:2468] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:43.925581 15457 leader_election.cc:304] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:43.925782 15416 raft_consensus.cc:2468] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6310cdf9ace453397b99a4a62539dee in term 2.
I20260709 12:29:43.926357 15741 raft_consensus.cc:2804] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:43.926764 15741 raft_consensus.cc:697] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Leader. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:43.927470 15741 consensus_queue.cc:237] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:43.933348 15314 catalog_manager.cc:5697] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee reported cstate change: term changed from 1 to 2, leader changed from d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65) to c6310cdf9ace453397b99a4a62539dee (127.7.23.66). New cstate: current_term: 2 leader_uuid: "c6310cdf9ace453397b99a4a62539dee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:44.063772 15490 raft_consensus.cc:1275] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.064910 15734 consensus_queue.cc:1048] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.074529 15564 raft_consensus.cc:1275] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.075985 15734 consensus_queue.cc:1048] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.107730 15416 raft_consensus.cc:1275] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.108647 15564 raft_consensus.cc:1275] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.108875 15741 consensus_queue.cc:1048] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.110069 15744 consensus_queue.cc:1048] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.210382 15564 raft_consensus.cc:1275] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.211619 15734 consensus_queue.cc:1048] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.218974 15490 raft_consensus.cc:1275] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer d7e060117e744a7b9bdf0d57d44e0515: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.220391 15734 consensus_queue.cc:1048] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.286104 15490 raft_consensus.cc:3060] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:44.291085 15490 raft_consensus.cc:1275] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.292179 15694 consensus_queue.cc:1048] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.300631 15416 raft_consensus.cc:1275] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.303203 15694 consensus_queue.cc:1048] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.380193 15564 raft_consensus.cc:1275] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.381682 15741 consensus_queue.cc:1048] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:44.392516 15416 raft_consensus.cc:1275] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Refusing update from remote peer c6310cdf9ace453397b99a4a62539dee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:44.393721 15744 consensus_queue.cc:1048] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:46.470005 15312 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34836:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:29:46.489946 15312 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34836:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:29:46.535740  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:29:46.678588 15815 log.cc:927] Time spent T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:29:46.787209 15490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
mode: GRACEFUL
new_leader_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:57192
I20260709 12:29:46.787889 15490 raft_consensus.cc:606] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Received request to transfer leadership to TS 0bd3802eadb547e7836afff55866543c
I20260709 12:29:46.794863 15842 tablet.cc:1724] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.859689 15853 tablet.cc:1724] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.858090 15843 tablet.cc:1724] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.861788 15850 tablet.cc:1724] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.890916 15852 tablet.cc:1724] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.863129 15849 tablet.cc:1724] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:46.911437 15455 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:45341, user_credentials={real_user=slave}} blocked reactor thread for 109734us
I20260709 12:29:46.930652 15857 tablet.cc:1724] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.945362 15842 tablet.cc:1724] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:46.956362 15518 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:219f58d7a2774e1b9edfdda4d155077e)
I20260709 12:29:46.956362 15857 tablet.cc:1724] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:46.964485 15518 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:219f58d7a2774e1b9edfdda4d155077e)
W20260709 12:29:46.965307 15518 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:219f58d7a2774e1b9edfdda4d155077e)
I20260709 12:29:46.980845 15843 tablet.cc:1724] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.972488 15850 tablet.cc:1724] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.991775 15863 tablet.cc:1724] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.994223 15864 tablet.cc:1724] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.989782 15859 tablet.cc:1724] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.994503 15853 tablet.cc:1724] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:46.997344 15417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
mode: GRACEFUL
new_leader_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:29:47.000607 15417 raft_consensus.cc:606] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Received request to transfer leadership to TS 0bd3802eadb547e7836afff55866543c
I20260709 12:29:46.979220 15862 tablet.cc:1724] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.004786  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:29:47.005481  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:47.002501 15849 tablet.cc:1724] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.020484 15417 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a250d82d44f4434e9637048652513344"
dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
mode: GRACEFUL
new_leader_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:60034
I20260709 12:29:47.021579 15417 raft_consensus.cc:606] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Received request to transfer leadership to TS 0bd3802eadb547e7836afff55866543c
W20260709 12:29:47.028980 15457 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.67:44305, user_credentials={real_user=slave}} blocked reactor thread for 167984us
I20260709 12:29:47.024092 15860 tablet.cc:1724] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.030601 15857 tablet.cc:1724] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.033915 15490 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6"
dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
mode: GRACEFUL
new_leader_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:57192
I20260709 12:29:47.034591 15490 raft_consensus.cc:606] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Received request to transfer leadership to TS 0bd3802eadb547e7836afff55866543c
I20260709 12:29:47.038471  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:47.039175  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:47.044173 15865 raft_consensus.cc:993] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: : Instructing follower 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.044664 15865 raft_consensus.cc:1081] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Signalling peer 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.055895 15864 tablet.cc:1724] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.054262 15850 tablet.cc:1724] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.057607 15859 tablet.cc:1724] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.064363 15560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:52670
I20260709 12:29:47.065448 15560 raft_consensus.cc:493] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:47.065855 15560 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.077514 15850 tablet.cc:1724] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.079941 15864 tablet.cc:1724] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.084010 15845 raft_consensus.cc:993] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee: : Instructing follower 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.083774 15862 tablet.cc:1724] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.087648 15816 raft_consensus.cc:1081] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Signalling peer 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.088227 15863 tablet.cc:1724] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.101358 15563 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:52670
I20260709 12:29:47.101994 15563 raft_consensus.cc:493] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:47.102355 15563 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.108165 15563 raft_consensus.cc:515] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.109285 15560 raft_consensus.cc:515] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.110955 15417 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:47.111582 15417 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.111974 15563 leader_election.cc:290] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:47.112385 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a67715e06a8841a68e714e8adefb28f6" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:47.112957 15489 raft_consensus.cc:3055] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:47.113236 15489 raft_consensus.cc:740] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:47.113958 15489 consensus_queue.cc:260] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.115096 15489 raft_consensus.cc:3060] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.118204 15417 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.119630 15529 leader_election.cc:304] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:47.119431 15560 leader_election.cc:290] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:47.129384 15489 raft_consensus.cc:2468] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.130378 15834 raft_consensus.cc:2804] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:47.130901 15834 raft_consensus.cc:697] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:47.131732 15834 consensus_queue.cc:237] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.127928 15415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:47.137275 15415 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.145008 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "219f58d7a2774e1b9edfdda4d155077e" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:47.145603 15489 raft_consensus.cc:3055] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:47.145848 15489 raft_consensus.cc:740] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6310cdf9ace453397b99a4a62539dee, State: Running, Role: LEADER
I20260709 12:29:47.146482 15489 consensus_queue.cc:260] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.146718 15415 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.148514 15489 raft_consensus.cc:3060] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.148465 15529 leader_election.cc:304] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:47.150144 15825 raft_consensus.cc:2804] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:47.150588 15825 raft_consensus.cc:697] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:47.151348 15825 consensus_queue.cc:237] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.154458 15857 tablet.cc:1724] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:47.164222 15489 raft_consensus.cc:2468] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.172086 15858 raft_consensus.cc:993] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515: : Instructing follower 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.172675 15832 raft_consensus.cc:1081] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Signalling peer 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.174369 15560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a250d82d44f4434e9637048652513344"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:29:47.175086 15560 raft_consensus.cc:493] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:47.175554 15560 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.183379 15560 raft_consensus.cc:515] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.181787 15315 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807: soft_deleted_table [id=32a3434c3d5344b78819b978f0ea1b36] alter complete (version 1)
I20260709 12:29:47.186522 15560 leader_election.cc:290] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:47.186918 15415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:47.187578 15415 raft_consensus.cc:3055] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:47.187912 15415 raft_consensus.cc:740] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:47.188124 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a250d82d44f4434e9637048652513344" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:47.188692 15415 consensus_queue.cc:260] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.192693 15489 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.193374 15415 raft_consensus.cc:3060] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.200959 15415 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.202140 15529 leader_election.cc:304] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, d7e060117e744a7b9bdf0d57d44e0515; no voters: 
I20260709 12:29:47.202901 15834 raft_consensus.cc:2804] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:47.203281 15834 raft_consensus.cc:697] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:47.204214 15489 raft_consensus.cc:2468] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.204002 15314 catalog_manager.cc:5697] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 2 to 3, leader changed from c6310cdf9ace453397b99a4a62539dee (127.7.23.66) to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 3 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.204190 15834 consensus_queue.cc:237] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.206058 15314 catalog_manager.cc:5697] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 2 to 3, leader changed from c6310cdf9ace453397b99a4a62539dee (127.7.23.66) to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 3 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.220405 15314 catalog_manager.cc:5697] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 2 to 3, leader changed from d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65) to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 3 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.442401 15858 raft_consensus.cc:993] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: : Instructing follower 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.442843 15832 raft_consensus.cc:1081] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Signalling peer 0bd3802eadb547e7836afff55866543c to start an election
I20260709 12:29:47.444401 15560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738"
dest_uuid: "0bd3802eadb547e7836afff55866543c"
 from {username='slave'} at 127.0.0.1:52658
I20260709 12:29:47.444981 15560 raft_consensus.cc:493] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:47.445288 15560 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.451400 15560 raft_consensus.cc:515] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.453486 15560 leader_election.cc:290] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Requested vote from peers d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341), c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959)
I20260709 12:29:47.454402 15489 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c6310cdf9ace453397b99a4a62539dee"
I20260709 12:29:47.454010 15415 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5279a7d0ab0462d93b6dee96809b738" candidate_uuid: "0bd3802eadb547e7836afff55866543c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d7e060117e744a7b9bdf0d57d44e0515"
I20260709 12:29:47.455339 15489 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.455466 15415 raft_consensus.cc:3055] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:47.455883 15415 raft_consensus.cc:740] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d7e060117e744a7b9bdf0d57d44e0515, State: Running, Role: LEADER
I20260709 12:29:47.456648 15415 consensus_queue.cc:260] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.457852 15415 raft_consensus.cc:3060] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:47.462014 15489 raft_consensus.cc:2468] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.463150 15529 leader_election.cc:304] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bd3802eadb547e7836afff55866543c, c6310cdf9ace453397b99a4a62539dee; no voters: 
I20260709 12:29:47.463794 15834 raft_consensus.cc:2804] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:47.464262 15834 raft_consensus.cc:697] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Becoming Leader. State: Replica: 0bd3802eadb547e7836afff55866543c, State: Running, Role: LEADER
I20260709 12:29:47.464465 15415 raft_consensus.cc:2468] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bd3802eadb547e7836afff55866543c in term 3.
I20260709 12:29:47.465109 15834 consensus_queue.cc:237] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } }
I20260709 12:29:47.472167 15314 catalog_manager.cc:5697] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c reported cstate change: term changed from 2 to 3, leader changed from d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65) to 0bd3802eadb547e7836afff55866543c (127.7.23.67). New cstate: current_term: 3 leader_uuid: "0bd3802eadb547e7836afff55866543c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bd3802eadb547e7836afff55866543c" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 44305 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:47.604681 15489 raft_consensus.cc:1275] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:47.605773 15834 consensus_queue.cc:1048] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:47.614871 15415 raft_consensus.cc:1275] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:47.616242 15694 consensus_queue.cc:1048] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:47.651356 15489 raft_consensus.cc:1275] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:47.652621 15694 consensus_queue.cc:1048] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:47.654662 15489 raft_consensus.cc:1275] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:47.655946 15694 consensus_queue.cc:1048] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:47.663273 15415 raft_consensus.cc:1275] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:47.664788 15694 consensus_queue.cc:1048] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:47.673431 15415 raft_consensus.cc:1275] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:47.675905 15879 consensus_queue.cc:1048] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:29:47.967648 15415 raft_consensus.cc:1275] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:47.968876 15834 consensus_queue.cc:1048] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7e060117e744a7b9bdf0d57d44e0515" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 45341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:29:47.976025 15489 raft_consensus.cc:1275] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Refusing update from remote peer 0bd3802eadb547e7836afff55866543c: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:29:47.978267 15834 consensus_queue.cc:1048] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6310cdf9ace453397b99a4a62539dee" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:29:48.040438  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:48.045948  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:48.046443  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:48.051949  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:48.052326  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:49.053305  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:49.058480  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:49.059015  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:49.066236  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:49.066743  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:50.067740  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:50.073242  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:50.073671  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:50.079296  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:50.079720  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:51.080757  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:51.086758  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:51.087267  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:51.091920  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:51.092315  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:52.093497  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:52.100018  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:52.100558  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:52.106695  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:52.107023  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:53.107975  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:53.112813  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:53.113235  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:53.118816  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:53.119315  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:54.120318  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:54.125694  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:54.126114  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:54.132228  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:54.132750  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:55.133750  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:55.138888  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:55.139315  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:55.143874  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:55.144229  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:56.145294  7261 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:56.150313  7261 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:56.150759  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:56.156100  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:56.156558  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:57.209471  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
W20260709 12:29:57.219156 15529 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:29:57.223461 15529 consensus_peers.cc:597] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c -> Peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Couldn't send request to peer d7e060117e744a7b9bdf0d57d44e0515. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:57.245338  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:57.246214  7261 tablet_replica.cc:333] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.247355  7261 raft_consensus.cc:2243] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.248224  7261 raft_consensus.cc:2272] T f31dc3dc5b624fba9bf43327b0f2cd1d P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.251245  7261 tablet_replica.cc:333] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.251880  7261 raft_consensus.cc:2243] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.252427  7261 raft_consensus.cc:2272] T 76842d4b90e14bb085c47646177513f4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.254662  7261 tablet_replica.cc:333] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.255172  7261 raft_consensus.cc:2243] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.255697  7261 raft_consensus.cc:2272] T a231c2ac83644d198ade3545003bedbc P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.257794  7261 tablet_replica.cc:333] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.258337  7261 raft_consensus.cc:2243] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.259174  7261 raft_consensus.cc:2272] T e5671682d39e47caad2d6adf8b3bb8db P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.261519  7261 tablet_replica.cc:333] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.262059  7261 raft_consensus.cc:2243] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.262876  7261 raft_consensus.cc:2272] T a6ca69999a1e4f6ebafb68dc538a9bf4 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.265168  7261 tablet_replica.cc:333] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.265774  7261 raft_consensus.cc:2243] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.266589  7261 raft_consensus.cc:2272] T 3ddcf9951827478a8bc51ec367f63d8b P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.268849  7261 tablet_replica.cc:333] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.269368  7261 raft_consensus.cc:2243] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.269810  7261 raft_consensus.cc:2272] T f284b6ceea344b45978e915931b91dde P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.271947  7261 tablet_replica.cc:333] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.272477  7261 raft_consensus.cc:2243] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.273270  7261 raft_consensus.cc:2272] T 7595b00bc4e74320afdcecb624f4a639 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.275543  7261 tablet_replica.cc:333] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.276018  7261 raft_consensus.cc:2243] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.276444  7261 raft_consensus.cc:2272] T f5279a7d0ab0462d93b6dee96809b738 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.279206  7261 tablet_replica.cc:333] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.279982  7261 raft_consensus.cc:2243] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.280565  7261 raft_consensus.cc:2272] T a67715e06a8841a68e714e8adefb28f6 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.283084  7261 tablet_replica.cc:333] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.283753  7261 raft_consensus.cc:2243] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.284440  7261 raft_consensus.cc:2272] T 219f58d7a2774e1b9edfdda4d155077e P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:57.285045 15529 consensus_peers.cc:597] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c -> Peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Couldn't send request to peer d7e060117e744a7b9bdf0d57d44e0515. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:57.286936  7261 tablet_replica.cc:333] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.287508  7261 raft_consensus.cc:2243] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.287926  7261 raft_consensus.cc:2272] T 24d229db978a479aa1d08ea2cac32472 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.290067  7261 tablet_replica.cc:333] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.290566  7261 raft_consensus.cc:2243] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.291371  7261 raft_consensus.cc:2272] T 3f70bcce05244c868552ef137e24212e P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.293659  7261 tablet_replica.cc:333] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.294171  7261 raft_consensus.cc:2243] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.294589  7261 raft_consensus.cc:2272] T a250d82d44f4434e9637048652513344 P d7e060117e744a7b9bdf0d57d44e0515 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.296846  7261 tablet_replica.cc:333] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.297327  7261 raft_consensus.cc:2243] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.297737  7261 raft_consensus.cc:2272] T 72835d3d5e534023b9a249e58945fa10 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.299793  7261 tablet_replica.cc:333] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.300237  7261 raft_consensus.cc:2243] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.300639  7261 raft_consensus.cc:2272] T 542ae07572714719aed2f722a6e04917 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.302613  7261 tablet_replica.cc:333] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.303073  7261 raft_consensus.cc:2243] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.303534  7261 raft_consensus.cc:2272] T 26b914f4a599465ba279e49020319e43 P d7e060117e744a7b9bdf0d57d44e0515 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.305737  7261 tablet_replica.cc:333] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515: stopping tablet replica
I20260709 12:29:57.306162  7261 raft_consensus.cc:2243] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.306962  7261 raft_consensus.cc:2272] T a7e7c9a5dd144e1eaf2d91ad050183b2 P d7e060117e744a7b9bdf0d57d44e0515 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:57.343083 15529 consensus_peers.cc:597] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c -> Peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Couldn't send request to peer d7e060117e744a7b9bdf0d57d44e0515. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:45341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:57.354846  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
W20260709 12:29:57.362895 15455 consensus_peers.cc:597] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee -> Peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Couldn't send request to peer d7e060117e744a7b9bdf0d57d44e0515. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:45341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:57.374904 15455 consensus_peers.cc:597] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee -> Peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Couldn't send request to peer d7e060117e744a7b9bdf0d57d44e0515. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:45341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:57.375447 15455 consensus_peers.cc:597] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee -> Peer d7e060117e744a7b9bdf0d57d44e0515 (127.7.23.65:45341): Couldn't send request to peer d7e060117e744a7b9bdf0d57d44e0515. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:45341: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:57.401145  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
W20260709 12:29:57.408835 15529 consensus_peers.cc:597] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c -> Peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Couldn't send request to peer c6310cdf9ace453397b99a4a62539dee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:57.421526 15529 consensus_peers.cc:597] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c -> Peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Couldn't send request to peer c6310cdf9ace453397b99a4a62539dee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:57.427876  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:57.428659  7261 tablet_replica.cc:333] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.429360  7261 raft_consensus.cc:2243] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.429986  7261 raft_consensus.cc:2272] T f31dc3dc5b624fba9bf43327b0f2cd1d P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.432216  7261 tablet_replica.cc:333] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.432824  7261 raft_consensus.cc:2243] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.433662  7261 raft_consensus.cc:2272] T 76842d4b90e14bb085c47646177513f4 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.435653  7261 tablet_replica.cc:333] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.436190  7261 raft_consensus.cc:2243] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.436961  7261 raft_consensus.cc:2272] T a231c2ac83644d198ade3545003bedbc P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.439025  7261 tablet_replica.cc:333] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.439616  7261 raft_consensus.cc:2243] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.440097  7261 raft_consensus.cc:2272] T a6ca69999a1e4f6ebafb68dc538a9bf4 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.442162  7261 tablet_replica.cc:333] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.442667  7261 raft_consensus.cc:2243] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.443097  7261 raft_consensus.cc:2272] T f5279a7d0ab0462d93b6dee96809b738 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.445225  7261 tablet_replica.cc:333] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.445794  7261 raft_consensus.cc:2243] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.446600  7261 raft_consensus.cc:2272] T f284b6ceea344b45978e915931b91dde P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.448644  7261 tablet_replica.cc:333] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.449141  7261 raft_consensus.cc:2243] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.449617  7261 raft_consensus.cc:2272] T 7595b00bc4e74320afdcecb624f4a639 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.452119  7261 tablet_replica.cc:333] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.452656  7261 raft_consensus.cc:2243] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.453049  7261 raft_consensus.cc:2272] T 3ddcf9951827478a8bc51ec367f63d8b P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.455054  7261 tablet_replica.cc:333] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.455585  7261 raft_consensus.cc:2243] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.456005  7261 raft_consensus.cc:2272] T 3f70bcce05244c868552ef137e24212e P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.457875  7261 tablet_replica.cc:333] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.458380  7261 raft_consensus.cc:2243] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.458834  7261 raft_consensus.cc:2272] T a250d82d44f4434e9637048652513344 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.460867  7261 tablet_replica.cc:333] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.461354  7261 raft_consensus.cc:2243] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.461793  7261 raft_consensus.cc:2272] T 542ae07572714719aed2f722a6e04917 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.463781  7261 tablet_replica.cc:333] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.464233  7261 raft_consensus.cc:2243] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.465034  7261 raft_consensus.cc:2272] T 26b914f4a599465ba279e49020319e43 P c6310cdf9ace453397b99a4a62539dee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.466989  7261 tablet_replica.cc:333] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.467518  7261 raft_consensus.cc:2243] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.467970  7261 raft_consensus.cc:2272] T a7e7c9a5dd144e1eaf2d91ad050183b2 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.469969  7261 tablet_replica.cc:333] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.470461  7261 raft_consensus.cc:2243] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.471517  7261 raft_consensus.cc:2272] T 72835d3d5e534023b9a249e58945fa10 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.474166  7261 tablet_replica.cc:333] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
W20260709 12:29:57.474640 15529 consensus_peers.cc:597] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c -> Peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Couldn't send request to peer c6310cdf9ace453397b99a4a62539dee. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:57.474764  7261 raft_consensus.cc:2243] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.475346  7261 raft_consensus.cc:2272] T e5671682d39e47caad2d6adf8b3bb8db P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.477422  7261 tablet_replica.cc:333] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.477906  7261 raft_consensus.cc:2243] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.478338  7261 raft_consensus.cc:2272] T 219f58d7a2774e1b9edfdda4d155077e P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.480396  7261 tablet_replica.cc:333] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.480839  7261 raft_consensus.cc:2243] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.481652  7261 raft_consensus.cc:2272] T 24d229db978a479aa1d08ea2cac32472 P c6310cdf9ace453397b99a4a62539dee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.483686  7261 tablet_replica.cc:333] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee: stopping tablet replica
I20260709 12:29:57.484174  7261 raft_consensus.cc:2243] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.484587  7261 raft_consensus.cc:2272] T a67715e06a8841a68e714e8adefb28f6 P c6310cdf9ace453397b99a4a62539dee [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:57.520138 15529 consensus_peers.cc:597] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c -> Peer c6310cdf9ace453397b99a4a62539dee (127.7.23.66:42959): Couldn't send request to peer c6310cdf9ace453397b99a4a62539dee. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:42959: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:57.524223  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
I20260709 12:29:57.561223  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
I20260709 12:29:57.591790  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:57.592489  7261 tablet_replica.cc:333] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.593278  7261 raft_consensus.cc:2243] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.594187  7261 raft_consensus.cc:2272] T f31dc3dc5b624fba9bf43327b0f2cd1d P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.596598  7261 tablet_replica.cc:333] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.597177  7261 raft_consensus.cc:2243] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.597666  7261 raft_consensus.cc:2272] T 76842d4b90e14bb085c47646177513f4 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.599823  7261 tablet_replica.cc:333] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.600384  7261 raft_consensus.cc:2243] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.600829  7261 raft_consensus.cc:2272] T a231c2ac83644d198ade3545003bedbc P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.602823  7261 tablet_replica.cc:333] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.603330  7261 raft_consensus.cc:2243] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.603829  7261 raft_consensus.cc:2272] T a6ca69999a1e4f6ebafb68dc538a9bf4 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.605794  7261 tablet_replica.cc:333] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.606335  7261 raft_consensus.cc:2243] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.606802  7261 raft_consensus.cc:2272] T e5671682d39e47caad2d6adf8b3bb8db P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.608649  7261 tablet_replica.cc:333] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.609197  7261 raft_consensus.cc:2243] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.609635  7261 raft_consensus.cc:2272] T 3ddcf9951827478a8bc51ec367f63d8b P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.611685  7261 tablet_replica.cc:333] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.612214  7261 raft_consensus.cc:2243] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.612664  7261 raft_consensus.cc:2272] T 7595b00bc4e74320afdcecb624f4a639 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.614552  7261 tablet_replica.cc:333] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.615047  7261 raft_consensus.cc:2243] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.615831  7261 raft_consensus.cc:2272] T f5279a7d0ab0462d93b6dee96809b738 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.617784  7261 tablet_replica.cc:333] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.618275  7261 raft_consensus.cc:2243] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.618716  7261 raft_consensus.cc:2272] T f284b6ceea344b45978e915931b91dde P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.620608  7261 tablet_replica.cc:333] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.621069  7261 raft_consensus.cc:2243] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.621856  7261 raft_consensus.cc:2272] T 219f58d7a2774e1b9edfdda4d155077e P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.623720  7261 tablet_replica.cc:333] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.624192  7261 raft_consensus.cc:2243] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.624626  7261 raft_consensus.cc:2272] T 24d229db978a479aa1d08ea2cac32472 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.626509  7261 tablet_replica.cc:333] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.626973  7261 raft_consensus.cc:2243] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.627781  7261 raft_consensus.cc:2272] T a67715e06a8841a68e714e8adefb28f6 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.629675  7261 tablet_replica.cc:333] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.630162  7261 raft_consensus.cc:2243] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.630587  7261 raft_consensus.cc:2272] T 72835d3d5e534023b9a249e58945fa10 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.632453  7261 tablet_replica.cc:333] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.632958  7261 raft_consensus.cc:2243] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.633389  7261 raft_consensus.cc:2272] T 26b914f4a599465ba279e49020319e43 P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.635289  7261 tablet_replica.cc:333] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.635814  7261 raft_consensus.cc:2243] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.636257  7261 raft_consensus.cc:2272] T a7e7c9a5dd144e1eaf2d91ad050183b2 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.638209  7261 tablet_replica.cc:333] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.638680  7261 raft_consensus.cc:2243] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.639482  7261 raft_consensus.cc:2272] T 542ae07572714719aed2f722a6e04917 P 0bd3802eadb547e7836afff55866543c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.641312  7261 tablet_replica.cc:333] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.641760  7261 raft_consensus.cc:2243] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.642508  7261 raft_consensus.cc:2272] T a250d82d44f4434e9637048652513344 P 0bd3802eadb547e7836afff55866543c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.644456  7261 tablet_replica.cc:333] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c: stopping tablet replica
I20260709 12:29:57.644860  7261 raft_consensus.cc:2243] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:57.645252  7261 raft_consensus.cc:2272] T 3f70bcce05244c868552ef137e24212e P 0bd3802eadb547e7836afff55866543c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.684561  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
I20260709 12:29:57.718041  7261 master.cc:562] Master@127.7.23.126:40029 shutting down...
I20260709 12:29:57.737351  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:57.737915  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:57.738214  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P 95d3e4cc06fd4f50b87426d1e49f4807: stopping tablet replica
I20260709 12:29:57.757898  7261 master.cc:584] Master@127.7.23.126:40029 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20370 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:29:57.807523  7261 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.23.126:37615
I20260709 12:29:57.808595  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:57.813716 15908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.814205 15909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:57.814960 15911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:57.815384  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:57.816293  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:57.816469  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:57.816634  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600197816617 us; error 0 us; skew 500 ppm
I20260709 12:29:57.817132  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:57.819304  7261 webserver.cc:533] Webserver started at http://127.7.23.126:45671/ using document root <none> and password file <none>
I20260709 12:29:57.819796  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:57.819967  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:57.820226  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:57.821378  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/master-0-root/instance:
uuid: "0ca7b742d4bb453788cb1a35b9086398"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-ps85"
I20260709 12:29:57.825515  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:57.828792 15916 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:57.829489  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:57.829739  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/master-0-root
uuid: "0ca7b742d4bb453788cb1a35b9086398"
format_stamp: "Formatted at 2026-07-09 12:29:57 on dist-test-slave-ps85"
I20260709 12:29:57.829980  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:57.850804  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:57.852097  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:57.888784  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.126:37615
I20260709 12:29:57.888881 15967 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.126:37615 every 8 connection(s)
I20260709 12:29:57.892587 15968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:57.903877 15968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398: Bootstrap starting.
I20260709 12:29:57.908522 15968 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:57.912557 15968 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398: No bootstrap required, opened a new log
I20260709 12:29:57.914978 15968 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7b742d4bb453788cb1a35b9086398" member_type: VOTER }
I20260709 12:29:57.915395 15968 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:57.915630 15968 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca7b742d4bb453788cb1a35b9086398, State: Initialized, Role: FOLLOWER
I20260709 12:29:57.916191 15968 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7b742d4bb453788cb1a35b9086398" member_type: VOTER }
I20260709 12:29:57.916649 15968 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:57.916854 15968 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:57.917127 15968 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:57.921830 15968 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7b742d4bb453788cb1a35b9086398" member_type: VOTER }
I20260709 12:29:57.922302 15968 leader_election.cc:304] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ca7b742d4bb453788cb1a35b9086398; no voters: 
I20260709 12:29:57.923388 15968 leader_election.cc:290] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:57.923803 15971 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:57.925082 15971 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 1 LEADER]: Becoming Leader. State: Replica: 0ca7b742d4bb453788cb1a35b9086398, State: Running, Role: LEADER
I20260709 12:29:57.925688 15971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7b742d4bb453788cb1a35b9086398" member_type: VOTER }
I20260709 12:29:57.926237 15968 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:57.929106 15972 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ca7b742d4bb453788cb1a35b9086398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7b742d4bb453788cb1a35b9086398" member_type: VOTER } }
I20260709 12:29:57.930735 15973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ca7b742d4bb453788cb1a35b9086398. Latest consensus state: current_term: 1 leader_uuid: "0ca7b742d4bb453788cb1a35b9086398" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7b742d4bb453788cb1a35b9086398" member_type: VOTER } }
I20260709 12:29:57.931494 15972 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:57.932288 15973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:57.933736 15978 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:57.938409 15978 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:57.940891  7261 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:57.947198 15978 catalog_manager.cc:1383] Generated new cluster ID: 509a04003397498ebebc5b727f5ccd98
I20260709 12:29:57.947510 15978 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:57.963274 15978 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:57.964613 15978 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:57.978420 15978 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398: Generated new TSK 0
I20260709 12:29:57.979025 15978 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:58.006928  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:58.012679 15989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:58.013576 15990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:58.015722  7261 server_base.cc:1061] running on GCE node
W20260709 12:29:58.016062 15992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:58.016903  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:58.017112  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:58.017266  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600198017248 us; error 0 us; skew 500 ppm
I20260709 12:29:58.017788  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:58.019945  7261 webserver.cc:533] Webserver started at http://127.7.23.65:40035/ using document root <none> and password file <none>
I20260709 12:29:58.020393  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:58.020565  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:58.020802  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:58.021869  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-0-root/instance:
uuid: "016723a5747a4889963be3d058762626"
format_stamp: "Formatted at 2026-07-09 12:29:58 on dist-test-slave-ps85"
I20260709 12:29:58.025974  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:29:58.029054 15997 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.029709  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:29:58.029961  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-0-root
uuid: "016723a5747a4889963be3d058762626"
format_stamp: "Formatted at 2026-07-09 12:29:58 on dist-test-slave-ps85"
I20260709 12:29:58.030226  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:58.051561  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:58.052698  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:58.054262  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:58.056437  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:58.056631  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.056836  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:58.057003  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.096091  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.65:40287
I20260709 12:29:58.096177 16059 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.65:40287 every 8 connection(s)
I20260709 12:29:58.100858  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:58.107288 16064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:58.109576 16065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:58.112231 16067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:58.112983 16060 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37615
I20260709 12:29:58.113150  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:58.113380 16060 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:58.114171 16060 heartbeater.cc:507] Master 127.7.23.126:37615 requested a full tablet report, sending...
I20260709 12:29:58.114564  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:58.114786  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:58.114970  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600198114951 us; error 0 us; skew 500 ppm
I20260709 12:29:58.115697  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:58.116277 15933 ts_manager.cc:194] Registered new tserver with Master: 016723a5747a4889963be3d058762626 (127.7.23.65:40287)
I20260709 12:29:58.118081  7261 webserver.cc:533] Webserver started at http://127.7.23.66:45129/ using document root <none> and password file <none>
I20260709 12:29:58.118399 15933 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44312
I20260709 12:29:58.118639  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:58.118912  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:58.119168  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:58.120384  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-1-root/instance:
uuid: "fa5bbc0be95d48069a791d991068b073"
format_stamp: "Formatted at 2026-07-09 12:29:58 on dist-test-slave-ps85"
I20260709 12:29:58.124704  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:29:58.128048 16072 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.128769  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:58.129076  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-1-root
uuid: "fa5bbc0be95d48069a791d991068b073"
format_stamp: "Formatted at 2026-07-09 12:29:58 on dist-test-slave-ps85"
I20260709 12:29:58.129359  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:58.147029  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:58.148331  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:58.149737  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:58.151993  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:58.152181  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.152427  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:58.152575  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.190456  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.66:41537
I20260709 12:29:58.190567 16134 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.66:41537 every 8 connection(s)
I20260709 12:29:58.195063  7261 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:58.202366 16139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:58.203291 16138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:58.206126 16135 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37615
I20260709 12:29:58.206563 16135 heartbeater.cc:461] Registering TS with master...
W20260709 12:29:58.206581 16141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:58.207324  7261 server_base.cc:1061] running on GCE node
I20260709 12:29:58.207620 16135 heartbeater.cc:507] Master 127.7.23.126:37615 requested a full tablet report, sending...
I20260709 12:29:58.208241  7261 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:58.208504  7261 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:58.208707  7261 hybrid_clock.cc:648] HybridClock initialized: now 1783600198208688 us; error 0 us; skew 500 ppm
I20260709 12:29:58.209444  7261 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:58.209831 15933 ts_manager.cc:194] Registered new tserver with Master: fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:29:58.211758 15933 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44326
I20260709 12:29:58.212153  7261 webserver.cc:533] Webserver started at http://127.7.23.67:34313/ using document root <none> and password file <none>
I20260709 12:29:58.212805  7261 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:58.213007  7261 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:58.213261  7261 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:58.214360  7261 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-2-root/instance:
uuid: "f675c2d870874f87ade6aeb6d783ab6d"
format_stamp: "Formatted at 2026-07-09 12:29:58 on dist-test-slave-ps85"
I20260709 12:29:58.218617  7261 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:58.221879 16146 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.222625  7261 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:29:58.222930  7261 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-2-root
uuid: "f675c2d870874f87ade6aeb6d783ab6d"
format_stamp: "Formatted at 2026-07-09 12:29:58 on dist-test-slave-ps85"
I20260709 12:29:58.223229  7261 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskbNv0ah/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599893953746-7261-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:58.242048  7261 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:58.243263  7261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:58.244678  7261 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:58.246814  7261 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:58.247035  7261 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.247249  7261 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:58.247419  7261 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:58.285593  7261 rpc_server.cc:307] RPC server started. Bound to: 127.7.23.67:32823
I20260709 12:29:58.285694 16208 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.7.23.67:32823 every 8 connection(s)
I20260709 12:29:58.298585 16209 heartbeater.cc:344] Connected to a master server at 127.7.23.126:37615
I20260709 12:29:58.299034 16209 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:58.299762 16209 heartbeater.cc:507] Master 127.7.23.126:37615 requested a full tablet report, sending...
I20260709 12:29:58.301524 15933 ts_manager.cc:194] Registered new tserver with Master: f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.302114  7261 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013501346s
I20260709 12:29:58.303206 15933 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44330
I20260709 12:29:58.325696 15933 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44334:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:58.328588 15933 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:58.390291 16025 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0846708b324515bbf6b0c33d46b196 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:58.390937 16024 tablet_service.cc:1511] Processing CreateTablet for tablet a3f18035f6cf431e8e829f38806e152c (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:58.392359 16024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f18035f6cf431e8e829f38806e152c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.393877 16025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0846708b324515bbf6b0c33d46b196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.396483 16023 tablet_service.cc:1511] Processing CreateTablet for tablet 9187f458751d43f099461bb0804b4b0e (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:58.397910 16023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187f458751d43f099461bb0804b4b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.404584 16099 tablet_service.cc:1511] Processing CreateTablet for tablet a3f18035f6cf431e8e829f38806e152c (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:58.405968 16099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f18035f6cf431e8e829f38806e152c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.411947 16022 tablet_service.cc:1511] Processing CreateTablet for tablet 67d0f4da57224a8795453bafc9e67f03 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:58.412591 16098 tablet_service.cc:1511] Processing CreateTablet for tablet 9187f458751d43f099461bb0804b4b0e (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:58.413345 16022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d0f4da57224a8795453bafc9e67f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.413918 16098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187f458751d43f099461bb0804b4b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.402875 16100 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0846708b324515bbf6b0c33d46b196 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:58.415369 16100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0846708b324515bbf6b0c33d46b196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.416589 16097 tablet_service.cc:1511] Processing CreateTablet for tablet 67d0f4da57224a8795453bafc9e67f03 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:58.417899 16097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d0f4da57224a8795453bafc9e67f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.420815 16021 tablet_service.cc:1511] Processing CreateTablet for tablet a4205851f6214b4abeab557d9a3de52c (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:58.422147 16021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4205851f6214b4abeab557d9a3de52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.422704 16096 tablet_service.cc:1511] Processing CreateTablet for tablet a4205851f6214b4abeab557d9a3de52c (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:58.424013 16096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4205851f6214b4abeab557d9a3de52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.430966 16174 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0846708b324515bbf6b0c33d46b196 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:58.432374 16174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0846708b324515bbf6b0c33d46b196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.436506 16173 tablet_service.cc:1511] Processing CreateTablet for tablet a3f18035f6cf431e8e829f38806e152c (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:58.437832 16173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3f18035f6cf431e8e829f38806e152c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.440454 16172 tablet_service.cc:1511] Processing CreateTablet for tablet 9187f458751d43f099461bb0804b4b0e (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:58.441809 16172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187f458751d43f099461bb0804b4b0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.443354 16170 tablet_service.cc:1511] Processing CreateTablet for tablet a4205851f6214b4abeab557d9a3de52c (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:58.444654 16170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4205851f6214b4abeab557d9a3de52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.444520 16171 tablet_service.cc:1511] Processing CreateTablet for tablet 67d0f4da57224a8795453bafc9e67f03 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:58.456946 16171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67d0f4da57224a8795453bafc9e67f03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.459117 16020 tablet_service.cc:1511] Processing CreateTablet for tablet 4cad5cf4c28f42ad8b44aef23d7aee43 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:58.460594 16020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cad5cf4c28f42ad8b44aef23d7aee43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.465348 16095 tablet_service.cc:1511] Processing CreateTablet for tablet 4cad5cf4c28f42ad8b44aef23d7aee43 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:58.466773 16095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cad5cf4c28f42ad8b44aef23d7aee43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.470757 16169 tablet_service.cc:1511] Processing CreateTablet for tablet 4cad5cf4c28f42ad8b44aef23d7aee43 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:58.472244 16169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4cad5cf4c28f42ad8b44aef23d7aee43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.480798 16022 tablet_service.cc:1511] Processing CreateTablet for tablet 7e393cbd9bac4f63b1fa4d7cf01ece7f (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:58.481894 16094 tablet_service.cc:1511] Processing CreateTablet for tablet 7e393cbd9bac4f63b1fa4d7cf01ece7f (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:58.483337 16094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e393cbd9bac4f63b1fa4d7cf01ece7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.486533 16022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e393cbd9bac4f63b1fa4d7cf01ece7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.502907 16168 tablet_service.cc:1511] Processing CreateTablet for tablet 7e393cbd9bac4f63b1fa4d7cf01ece7f (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:58.504418 16168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e393cbd9bac4f63b1fa4d7cf01ece7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.511252 16022 tablet_service.cc:1511] Processing CreateTablet for tablet 21875f466e174761b5b419bd47761f4d (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:58.515578 16093 tablet_service.cc:1511] Processing CreateTablet for tablet 21875f466e174761b5b419bd47761f4d (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:58.517617 16093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21875f466e174761b5b419bd47761f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.522064 16022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21875f466e174761b5b419bd47761f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.533742 16223 tablet_bootstrap.cc:492] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:58.534912 16224 tablet_bootstrap.cc:492] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.535390 16168 tablet_service.cc:1511] Processing CreateTablet for tablet 84d596c2ecb14b1d9c7b8bcaf329d213 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:58.540104 16168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d596c2ecb14b1d9c7b8bcaf329d213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.543995 16020 tablet_service.cc:1511] Processing CreateTablet for tablet 84d596c2ecb14b1d9c7b8bcaf329d213 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:58.545395 16020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d596c2ecb14b1d9c7b8bcaf329d213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.548133 16170 tablet_service.cc:1511] Processing CreateTablet for tablet 21875f466e174761b5b419bd47761f4d (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:58.549437 16170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21875f466e174761b5b419bd47761f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.545727 16223 tablet_bootstrap.cc:654] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.536482 16225 tablet_bootstrap.cc:492] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.558447 16225 tablet_bootstrap.cc:654] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.546628 16097 tablet_service.cc:1511] Processing CreateTablet for tablet 84d596c2ecb14b1d9c7b8bcaf329d213 (DEFAULT_TABLE table=test-workload [id=b3a28ba3ea184acb828451e29219cf70]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:58.560305 16097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84d596c2ecb14b1d9c7b8bcaf329d213. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:58.547529 16224 tablet_bootstrap.cc:654] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.594372 16225 tablet_bootstrap.cc:492] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:58.595381 16225 ts_tablet_manager.cc:1403] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.020s
I20260709 12:29:58.599059 16225 raft_consensus.cc:359] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.600020 16225 raft_consensus.cc:385] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.600080 16223 tablet_bootstrap.cc:492] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:58.600401 16225 raft_consensus.cc:740] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.600788 16223 ts_tablet_manager.cc:1403] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.009s
I20260709 12:29:58.601056 16224 tablet_bootstrap.cc:492] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.601629 16224 ts_tablet_manager.cc:1403] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.012s
I20260709 12:29:58.601269 16225 consensus_queue.cc:260] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.604082 16223 raft_consensus.cc:359] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.604924 16223 raft_consensus.cc:385] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.604737 16224 raft_consensus.cc:359] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.605373 16223 raft_consensus.cc:740] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.605721 16224 raft_consensus.cc:385] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.606127 16224 raft_consensus.cc:740] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.606598 16223 consensus_queue.cc:260] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.607093 16224 consensus_queue.cc:260] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.613014 16209 heartbeater.cc:499] Master 127.7.23.126:37615 was elected leader, sending a full tablet report...
I20260709 12:29:58.613116 16223 ts_tablet_manager.cc:1434] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:29:58.613817 16060 heartbeater.cc:499] Master 127.7.23.126:37615 was elected leader, sending a full tablet report...
I20260709 12:29:58.615680 16135 heartbeater.cc:499] Master 127.7.23.126:37615 was elected leader, sending a full tablet report...
I20260709 12:29:58.616194 16223 tablet_bootstrap.cc:492] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:58.620683 16224 ts_tablet_manager.cc:1434] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.004s
I20260709 12:29:58.621870 16224 tablet_bootstrap.cc:492] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.622767 16223 tablet_bootstrap.cc:654] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.613839 16225 ts_tablet_manager.cc:1434] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.012s
I20260709 12:29:58.627724 16225 tablet_bootstrap.cc:492] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.628979 16224 tablet_bootstrap.cc:654] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.634498 16225 tablet_bootstrap.cc:654] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.663923 16230 raft_consensus.cc:493] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.664628 16230 raft_consensus.cc:515] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.670477 16230 leader_election.cc:290] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.706248 16225 tablet_bootstrap.cc:492] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:58.706950 16225 ts_tablet_manager.cc:1403] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.079s	user 0.035s	sys 0.039s
I20260709 12:29:58.707088 16224 tablet_bootstrap.cc:492] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.706808 16223 tablet_bootstrap.cc:492] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:58.707756 16224 ts_tablet_manager.cc:1403] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.086s	user 0.034s	sys 0.049s
I20260709 12:29:58.708243 16223 ts_tablet_manager.cc:1403] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.092s	user 0.030s	sys 0.055s
I20260709 12:29:58.710276 16225 raft_consensus.cc:359] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.711115 16225 raft_consensus.cc:385] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.711536 16225 raft_consensus.cc:740] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.710743 16224 raft_consensus.cc:359] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.712459 16224 raft_consensus.cc:385] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.712821 16224 raft_consensus.cc:740] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.711192 16223 raft_consensus.cc:359] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.713047 16225 consensus_queue.cc:260] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.713649 16224 consensus_queue.cc:260] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.714061 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:29:58.713689 16223 raft_consensus.cc:385] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.716044 16223 raft_consensus.cc:740] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.716784 16223 consensus_queue.cc:260] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.715626 16225 ts_tablet_manager.cc:1434] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:29:58.718382 16225 tablet_bootstrap.cc:492] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.717212 16224 ts_tablet_manager.cc:1434] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:29:58.718859 16223 ts_tablet_manager.cc:1434] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:29:58.719463 16224 tablet_bootstrap.cc:492] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.719849 16223 tablet_bootstrap.cc:492] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626: Bootstrap starting.
W20260709 12:29:58.720307 16001 leader_election.cc:343] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.723654 16231 raft_consensus.cc:493] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.724164 16231 raft_consensus.cc:515] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.726539 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:58.727016 16223 tablet_bootstrap.cc:654] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.728263 16225 tablet_bootstrap.cc:654] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:58.733059 16001 leader_election.cc:343] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.733613 16001 leader_election.cc:304] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 016723a5747a4889963be3d058762626; no voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073
I20260709 12:29:58.735091 16224 tablet_bootstrap.cc:654] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.735592 16230 raft_consensus.cc:2749] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:58.735858 16231 leader_election.cc:290] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.753961 16224 tablet_bootstrap.cc:492] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.754654 16224 ts_tablet_manager.cc:1403] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.035s	user 0.007s	sys 0.007s
I20260709 12:29:58.758910 16225 tablet_bootstrap.cc:492] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:58.759233 16224 raft_consensus.cc:359] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.760215 16224 raft_consensus.cc:385] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.759513 16225 ts_tablet_manager.cc:1403] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.010s
I20260709 12:29:58.760548 16224 raft_consensus.cc:740] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.760426 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:29:58.761693 16224 consensus_queue.cc:260] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
W20260709 12:29:58.762619 16075 leader_election.cc:343] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.764092 16224 ts_tablet_manager.cc:1434] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:29:58.763772 16225 raft_consensus.cc:359] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.762619 16223 tablet_bootstrap.cc:492] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:58.765333 16224 tablet_bootstrap.cc:492] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.765169 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:58.765211 16223 ts_tablet_manager.cc:1403] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.030s
I20260709 12:29:58.766220 16184 raft_consensus.cc:2468] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:58.767709 16076 leader_election.cc:304] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 016723a5747a4889963be3d058762626
I20260709 12:29:58.768942 16231 raft_consensus.cc:2804] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.769308 16231 raft_consensus.cc:493] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.769145 16223 raft_consensus.cc:359] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.769795 16231 raft_consensus.cc:3060] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.770006 16223 raft_consensus.cc:385] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.770419 16223 raft_consensus.cc:740] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.771159 16223 consensus_queue.cc:260] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.772431 16224 tablet_bootstrap.cc:654] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.764637 16225 raft_consensus.cc:385] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.775426 16225 raft_consensus.cc:740] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.775727 16223 ts_tablet_manager.cc:1434] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:29:58.776252 16225 consensus_queue.cc:260] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.776850 16223 tablet_bootstrap.cc:492] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:58.778470 16225 ts_tablet_manager.cc:1434] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:29:58.779526 16225 tablet_bootstrap.cc:492] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.780162 16231 raft_consensus.cc:515] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.783421 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:58.784051 16223 tablet_bootstrap.cc:654] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.783968 16184 raft_consensus.cc:3060] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.785125 16231 leader_election.cc:290] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.785602 16225 tablet_bootstrap.cc:654] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.783914 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
W20260709 12:29:58.788007 16075 leader_election.cc:343] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.795243 16224 tablet_bootstrap.cc:492] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.796011 16224 ts_tablet_manager.cc:1403] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.004s
I20260709 12:29:58.799113 16224 raft_consensus.cc:359] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.799835 16224 raft_consensus.cc:385] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.800127 16224 raft_consensus.cc:740] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.800916 16224 consensus_queue.cc:260] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.802047 16184 raft_consensus.cc:2468] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:58.803367 16076 leader_election.cc:304] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 016723a5747a4889963be3d058762626
I20260709 12:29:58.804993 16224 ts_tablet_manager.cc:1434] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:58.805474 16231 raft_consensus.cc:2804] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:58.806113 16224 tablet_bootstrap.cc:492] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.806658 16231 raft_consensus.cc:697] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:58.807610 16231 consensus_queue.cc:237] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.813122 16224 tablet_bootstrap.cc:654] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.825152 16224 tablet_bootstrap.cc:492] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.825721 16224 ts_tablet_manager.cc:1403] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.014s
I20260709 12:29:58.827394 15931 catalog_manager.cc:5697] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.828768 16224 raft_consensus.cc:359] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.829571 16224 raft_consensus.cc:385] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.829895 16224 raft_consensus.cc:740] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.830785 16224 consensus_queue.cc:260] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.833348 16224 ts_tablet_manager.cc:1434] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 12:29:58.834334 16225 tablet_bootstrap.cc:492] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:58.834895 16225 ts_tablet_manager.cc:1403] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.056s	user 0.034s	sys 0.018s
I20260709 12:29:58.834353 16224 tablet_bootstrap.cc:492] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.837121 16223 tablet_bootstrap.cc:492] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:58.837664 16223 ts_tablet_manager.cc:1403] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.039s
I20260709 12:29:58.840541 16223 raft_consensus.cc:359] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.840869 16225 raft_consensus.cc:359] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.841300 16223 raft_consensus.cc:385] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.841679 16225 raft_consensus.cc:385] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.841774 16223 raft_consensus.cc:740] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.841898 16224 tablet_bootstrap.cc:654] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.842121 16225 raft_consensus.cc:740] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.842648 16223 consensus_queue.cc:260] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.843282 16225 consensus_queue.cc:260] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.844913 16223 ts_tablet_manager.cc:1434] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:29:58.845898 16223 tablet_bootstrap.cc:492] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:58.847759 16225 ts_tablet_manager.cc:1434] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:29:58.848850 16225 tablet_bootstrap.cc:492] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.854200 16223 tablet_bootstrap.cc:654] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.854830 16225 tablet_bootstrap.cc:654] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.863479 16225 tablet_bootstrap.cc:492] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:58.864133 16225 ts_tablet_manager.cc:1403] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.001s
I20260709 12:29:58.867304 16225 raft_consensus.cc:359] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.868023 16225 raft_consensus.cc:385] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.868315 16225 raft_consensus.cc:740] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.868710 16224 tablet_bootstrap.cc:492] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.868727 16223 tablet_bootstrap.cc:492] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:58.869308 16224 ts_tablet_manager.cc:1403] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.002s
I20260709 12:29:58.869400 16223 ts_tablet_manager.cc:1403] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 12:29:58.869053 16225 consensus_queue.cc:260] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.869925 16231 raft_consensus.cc:493] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.870486 16231 raft_consensus.cc:515] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.872645 16231 leader_election.cc:290] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.872893 16225 ts_tablet_manager.cc:1434] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:29:58.872352 16224 raft_consensus.cc:359] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.873927 16225 tablet_bootstrap.cc:492] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.874086 16224 raft_consensus.cc:385] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.874599 16224 raft_consensus.cc:740] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.875275 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:29:58.875540 16224 consensus_queue.cc:260] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.876540 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
W20260709 12:29:58.876863 16075 leader_election.cc:343] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:58.873919 16223 raft_consensus.cc:359] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.878084 16223 raft_consensus.cc:385] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.878419 16223 raft_consensus.cc:740] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.879271 16223 consensus_queue.cc:260] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.880609 16224 ts_tablet_manager.cc:1434] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:29:58.880901 16225 tablet_bootstrap.cc:654] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.881660 16224 tablet_bootstrap.cc:492] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.883816 16223 ts_tablet_manager.cc:1434] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:29:58.884860 16223 tablet_bootstrap.cc:492] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:58.888705 16224 tablet_bootstrap.cc:654] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.890962 16223 tablet_bootstrap.cc:654] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.899930 16223 tablet_bootstrap.cc:492] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:58.900477 16223 ts_tablet_manager.cc:1403] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.001s
I20260709 12:29:58.904587 16223 raft_consensus.cc:359] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.905524 16223 raft_consensus.cc:385] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.905871 16223 raft_consensus.cc:740] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.906297 16224 tablet_bootstrap.cc:492] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.906708 16184 raft_consensus.cc:2468] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:58.907003 16224 ts_tablet_manager.cc:1403] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.010s
I20260709 12:29:58.907963 16076 leader_election.cc:304] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 016723a5747a4889963be3d058762626
I20260709 12:29:58.906723 16223 consensus_queue.cc:260] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.909096 16231 raft_consensus.cc:2804] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.909454 16231 raft_consensus.cc:493] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.909772 16231 raft_consensus.cc:3060] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.910111 16225 tablet_bootstrap.cc:492] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:58.910638 16225 ts_tablet_manager.cc:1403] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.015s
I20260709 12:29:58.911031 16224 raft_consensus.cc:359] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.911778 16224 raft_consensus.cc:385] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.912051 16224 raft_consensus.cc:740] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.912729 16224 consensus_queue.cc:260] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.913579 16225 raft_consensus.cc:359] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.915365 16224 ts_tablet_manager.cc:1434] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:58.916247 16223 ts_tablet_manager.cc:1434] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:29:58.916592 16224 tablet_bootstrap.cc:492] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.917291 16223 tablet_bootstrap.cc:492] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:58.917289 16231 raft_consensus.cc:515] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.920274 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:58.920835 16035 raft_consensus.cc:3060] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.917376 16225 raft_consensus.cc:385] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.922851 16225 raft_consensus.cc:740] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.923843 16224 tablet_bootstrap.cc:654] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.923629 16225 consensus_queue.cc:260] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.926059 16225 ts_tablet_manager.cc:1434] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 12:29:58.927117 16225 tablet_bootstrap.cc:492] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.931905 16035 raft_consensus.cc:2468] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:58.934525 16075 leader_election.cc:304] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:58.934880 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:58.935532 16231 leader_election.cc:290] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.932547 16223 tablet_bootstrap.cc:654] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.935695 16245 raft_consensus.cc:2804] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:29:58.937911 15981 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:58.935499 16184 raft_consensus.cc:3060] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.935527 16225 tablet_bootstrap.cc:654] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.945747 16245 raft_consensus.cc:697] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:58.946648 16245 consensus_queue.cc:237] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.939386 16224 tablet_bootstrap.cc:492] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:58.951880 16224 ts_tablet_manager.cc:1403] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.000s
I20260709 12:29:58.952603 16184 raft_consensus.cc:2468] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:58.954686 16224 raft_consensus.cc:359] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.955425 16224 raft_consensus.cc:385] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.955693 16224 raft_consensus.cc:740] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.956391 16224 consensus_queue.cc:260] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.956812 16223 tablet_bootstrap.cc:492] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:58.957350 16223 ts_tablet_manager.cc:1403] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.007s
I20260709 12:29:58.957732 16225 tablet_bootstrap.cc:492] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:58.957935 16224 ts_tablet_manager.cc:1434] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:29:58.958283 16225 ts_tablet_manager.cc:1403] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.005s
I20260709 12:29:58.958439 16230 raft_consensus.cc:493] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.958897 16224 tablet_bootstrap.cc:492] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:29:58.958992 16230 raft_consensus.cc:515] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.960465 16223 raft_consensus.cc:359] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.961169 16223 raft_consensus.cc:385] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.961300 16230 leader_election.cc:290] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.961472 16223 raft_consensus.cc:740] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.961265 16225 raft_consensus.cc:359] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.962571 16225 raft_consensus.cc:385] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:58.962230 16223 consensus_queue.cc:260] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.963400 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:29:58.964386 16223 ts_tablet_manager.cc:1434] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:29:58.964778 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:58.965409 16223 tablet_bootstrap.cc:492] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:58.965581 16184 raft_consensus.cc:2393] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 016723a5747a4889963be3d058762626 in current term 1: Already voted for candidate fa5bbc0be95d48069a791d991068b073 in this term.
I20260709 12:29:58.966704 16231 raft_consensus.cc:493] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.962857 16225 raft_consensus.cc:740] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:58.978247 16231 raft_consensus.cc:515] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.979344 16225 consensus_queue.cc:260] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.980458 16231 leader_election.cc:290] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:58.981714 16225 ts_tablet_manager.cc:1434] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:29:58.981052 15932 catalog_manager.cc:5697] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:58.982362 16001 leader_election.cc:304] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 016723a5747a4889963be3d058762626; no voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073
I20260709 12:29:58.982764 16225 tablet_bootstrap.cc:492] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:58.970142 16224 tablet_bootstrap.cc:654] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.986006 16223 tablet_bootstrap.cc:654] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.988412 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4205851f6214b4abeab557d9a3de52c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:29:58.989140 16035 raft_consensus.cc:2468] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:58.989400 16225 tablet_bootstrap.cc:654] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:58.991080 16229 raft_consensus.cc:493] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:58.991698 16229 raft_consensus.cc:515] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:58.995759 16075 leader_election.cc:304] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:58.996997 16231 raft_consensus.cc:2804] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:58.997463 16231 raft_consensus.cc:493] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:58.998237 16231 raft_consensus.cc:3060] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:58.991005 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4205851f6214b4abeab557d9a3de52c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:58.998909 16184 raft_consensus.cc:2468] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:58.983814 16230 raft_consensus.cc:3060] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.006274 16229 leader_election.cc:290] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:29:59.012162 16230 raft_consensus.cc:2749] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:59.017282 16231 raft_consensus.cc:515] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.018661 16230 raft_consensus.cc:493] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:59.020364 16231 leader_election.cc:290] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.020699 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4205851f6214b4abeab557d9a3de52c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:59.021456 16035 raft_consensus.cc:3060] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.020857 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4205851f6214b4abeab557d9a3de52c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.024775 16184 raft_consensus.cc:3060] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.024683 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:29:59.025511 16224 tablet_bootstrap.cc:492] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:29:59.025511 16034 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 0.
I20260709 12:29:59.026216 16224 ts_tablet_manager.cc:1403] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.068s	user 0.016s	sys 0.029s
I20260709 12:29:59.027009 16149 leader_election.cc:304] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:29:59.028021 16229 raft_consensus.cc:2804] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:59.028384 16229 raft_consensus.cc:493] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:59.028746 16229 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.029269 16224 raft_consensus.cc:359] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.030022 16224 raft_consensus.cc:385] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:59.030328 16224 raft_consensus.cc:740] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:29:59.028551 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:29:59.030997 16223 tablet_bootstrap.cc:492] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:59.031348 16224 consensus_queue.cc:260] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.031512 16223 ts_tablet_manager.cc:1403] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.066s	user 0.018s	sys 0.003s
I20260709 12:29:59.033921 16224 ts_tablet_manager.cc:1434] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:59.034773 16223 raft_consensus.cc:359] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.035444 16223 raft_consensus.cc:385] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:59.035705 16223 raft_consensus.cc:740] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:59.019246 16230 raft_consensus.cc:515] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.036358 16223 consensus_queue.cc:260] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.039139 16223 ts_tablet_manager.cc:1434] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:29:59.039037 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d0f4da57224a8795453bafc9e67f03" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:29:59.039722 16109 raft_consensus.cc:2468] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
I20260709 12:29:59.040246 16223 tablet_bootstrap.cc:492] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:29:59.043186 16001 leader_election.cc:304] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.043807 16035 raft_consensus.cc:2468] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:59.044306 16263 raft_consensus.cc:2804] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:59.044775 16263 raft_consensus.cc:493] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:59.044979 16075 leader_election.cc:304] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.045183 16263 raft_consensus.cc:3060] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.045903 16231 raft_consensus.cc:2804] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:59.046022 16223 tablet_bootstrap.cc:654] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:59.046433 16231 raft_consensus.cc:697] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:59.047264 16231 consensus_queue.cc:237] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.051622 16230 leader_election.cc:290] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.052356 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d0f4da57224a8795453bafc9e67f03" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:59.052772 16184 raft_consensus.cc:2468] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:59.053040 16183 raft_consensus.cc:2468] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
I20260709 12:29:59.053275 16263 raft_consensus.cc:515] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.054270 16110 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 0.
I20260709 12:29:59.055887 16263 leader_election.cc:290] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.056550 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d0f4da57224a8795453bafc9e67f03" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.057001 16183 raft_consensus.cc:3060] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.056813 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67d0f4da57224a8795453bafc9e67f03" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.057507 16110 raft_consensus.cc:3060] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.059275 16225 tablet_bootstrap.cc:492] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:59.059804 16225 ts_tablet_manager.cc:1403] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.077s	user 0.006s	sys 0.012s
I20260709 12:29:59.062498 16225 raft_consensus.cc:359] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.063125 16225 raft_consensus.cc:385] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:59.063395 16225 raft_consensus.cc:740] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:59.064177 16225 consensus_queue.cc:260] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.064517 16110 raft_consensus.cc:2468] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:29:59.065703 16001 leader_election.cc:304] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.066602 16263 raft_consensus.cc:2804] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:59.067076 16263 raft_consensus.cc:697] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:29:59.067910 16263 consensus_queue.cc:237] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.068404 15932 catalog_manager.cc:5697] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.069533 16229 raft_consensus.cc:515] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.062582 16183 raft_consensus.cc:2468] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:29:59.073171 16229 leader_election.cc:290] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:29:59.076902 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:59.077543 16035 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.078876 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.079818 16110 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.084010 16035 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 1.
I20260709 12:29:59.085167 16149 leader_election.cc:304] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:29:59.086373 16225 ts_tablet_manager.cc:1434] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.007s
I20260709 12:29:59.089558 16225 tablet_bootstrap.cc:492] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:29:59.090569 16110 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 1.
I20260709 12:29:59.091975 16263 raft_consensus.cc:493] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:59.092515 16263 raft_consensus.cc:515] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.094714 16223 tablet_bootstrap.cc:492] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:29:59.095238 16223 ts_tablet_manager.cc:1403] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.005s
I20260709 12:29:59.096459 16225 tablet_bootstrap.cc:654] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:59.096648 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:59.097295 16183 raft_consensus.cc:2468] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
I20260709 12:29:59.098125 16223 raft_consensus.cc:359] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.098879 16223 raft_consensus.cc:385] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:59.098817 16001 leader_election.cc:304] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:29:59.099251 16229 raft_consensus.cc:493] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:59.099426 16263 leader_election.cc:290] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.100004 16230 raft_consensus.cc:2804] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:59.099820 16229 raft_consensus.cc:515] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.100428 16223 raft_consensus.cc:740] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:29:59.100436 16230 raft_consensus.cc:493] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:59.100975 16230 raft_consensus.cc:3060] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.101322 16223 consensus_queue.cc:260] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.102981 16223 ts_tablet_manager.cc:1434] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 12:29:59.103436 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:29:59.103871 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:29:59.104080 16109 raft_consensus.cc:2468] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 0.
I20260709 12:29:59.104503 16035 raft_consensus.cc:2468] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 0.
I20260709 12:29:59.105482 16150 leader_election.cc:304] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.097558 15932 catalog_manager.cc:5697] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.106256 16225 tablet_bootstrap.cc:492] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:29:59.106741 16225 ts_tablet_manager.cc:1403] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.004s
I20260709 12:29:59.101933 16229 leader_election.cc:290] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:29:59.108338 16229 raft_consensus.cc:2804] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:59.108670 16229 raft_consensus.cc:493] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:59.108994 16229 raft_consensus.cc:3060] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.109463 16225 raft_consensus.cc:359] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.110107 16225 raft_consensus.cc:385] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:59.111253 16225 raft_consensus.cc:740] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:29:59.110143 16230 raft_consensus.cc:515] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.112008 16225 consensus_queue.cc:260] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.113315 16230 leader_election.cc:290] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.114014 16225 ts_tablet_manager.cc:1434] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:59.115018 16109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.115669 16109 raft_consensus.cc:3060] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.116612 16266 raft_consensus.cc:2804] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:59.119041 16229 raft_consensus.cc:515] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.121865 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:59.122421 16035 raft_consensus.cc:3060] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.123116 16109 raft_consensus.cc:2468] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:29:59.124368 16001 leader_election.cc:304] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.125311 16230 raft_consensus.cc:2804] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:59.125976 16230 raft_consensus.cc:697] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:29:59.126948 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.127583 16183 raft_consensus.cc:3060] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.129468 16035 raft_consensus.cc:2468] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 1.
I20260709 12:29:59.129671 16230 consensus_queue.cc:237] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.131836 16149 leader_election.cc:304] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:29:59.132745 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.133158 16269 raft_consensus.cc:2804] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:59.133410 16108 raft_consensus.cc:3060] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.133952 16269 raft_consensus.cc:697] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Becoming Leader. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:29:59.134560 16183 raft_consensus.cc:2468] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:29:59.135044 16269 consensus_queue.cc:237] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.136766 16229 leader_election.cc:290] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:29:59.138053 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:29:59.138681 16110 raft_consensus.cc:2376] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 016723a5747a4889963be3d058762626 in term 1. Re-sending same reply.
I20260709 12:29:59.140547 16108 raft_consensus.cc:2468] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 1.
I20260709 12:29:59.141185 16266 raft_consensus.cc:697] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Becoming Leader. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:29:59.142041 16266 consensus_queue.cc:237] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.148991 15932 catalog_manager.cc:5697] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.152436 15933 catalog_manager.cc:5697] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d reported cstate change: term changed from 0 to 1, leader changed from <none> to f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:59.164837 15933 catalog_manager.cc:5697] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d reported cstate change: term changed from 0 to 1, leader changed from <none> to f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:59.264086 16231 consensus_queue.cc:1048] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.275602 16231 raft_consensus.cc:493] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:59.276093 16231 raft_consensus.cc:515] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.277371 16276 consensus_queue.cc:1048] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:59.278625 16231 leader_election.cc:290] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.279498 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21875f466e174761b5b419bd47761f4d" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:29:59.279711 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21875f466e174761b5b419bd47761f4d" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:59.280272 16035 raft_consensus.cc:2468] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:59.280424 16183 raft_consensus.cc:2468] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:59.281665 16075 leader_election.cc:304] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.282734 16276 raft_consensus.cc:2804] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:59.283026 16276 raft_consensus.cc:493] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:59.283283 16276 raft_consensus.cc:3060] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.289710 16276 raft_consensus.cc:515] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.290977 16245 raft_consensus.cc:493] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:59.291432 16276 leader_election.cc:290] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.291561 16245 raft_consensus.cc:515] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.292181 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21875f466e174761b5b419bd47761f4d" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:59.292834 16035 raft_consensus.cc:3060] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.293529 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21875f466e174761b5b419bd47761f4d" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.294219 16184 raft_consensus.cc:3060] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.297715 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:29:59.297879 16245 leader_election.cc:290] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.298398 16034 raft_consensus.cc:2468] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:59.298833 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:29:59.299513 16183 raft_consensus.cc:2468] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:29:59.299778 16075 leader_election.cc:304] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.300743 16245 raft_consensus.cc:2804] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:59.301092 16245 raft_consensus.cc:493] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:59.301345 16245 raft_consensus.cc:3060] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.302433 16184 raft_consensus.cc:2468] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:59.303584 16076 leader_election.cc:304] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.303845 16035 raft_consensus.cc:2468] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:59.304474 16276 raft_consensus.cc:2804] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:59.304965 16276 raft_consensus.cc:697] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:59.305716 16276 consensus_queue.cc:237] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.307063 16245 raft_consensus.cc:515] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.309207 16245 leader_election.cc:290] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.309587 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:59.309777 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.310402 16035 raft_consensus.cc:3060] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.310469 16184 raft_consensus.cc:3060] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:59.313266 15932 catalog_manager.cc:5697] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.317751 16035 raft_consensus.cc:2468] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:59.317751 16184 raft_consensus.cc:2468] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:29:59.319118 16076 leader_election.cc:304] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.320152 16245 raft_consensus.cc:2804] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:59.320528 16245 raft_consensus.cc:697] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:59.321244 16245 consensus_queue.cc:237] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.328370 15932 catalog_manager.cc:5697] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.343551 16245 consensus_queue.cc:1048] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.348127 16245 consensus_queue.cc:1048] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.448859 16276 consensus_queue.cc:1048] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.460052 16231 consensus_queue.cc:1048] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.487198 16184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196"
dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
mode: GRACEFUL
new_leader_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:59428
I20260709 12:29:59.487784 16184 raft_consensus.cc:606] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Received request to transfer leadership to TS 016723a5747a4889963be3d058762626
I20260709 12:29:59.499651 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c"
dest_uuid: "fa5bbc0be95d48069a791d991068b073"
mode: GRACEFUL
new_leader_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:40696
I20260709 12:29:59.500157 16110 raft_consensus.cc:606] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Received request to transfer leadership to TS 016723a5747a4889963be3d058762626
I20260709 12:29:59.504992 16184 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e"
dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
mode: GRACEFUL
new_leader_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:59428
I20260709 12:29:59.505501 16184 raft_consensus.cc:606] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Received request to transfer leadership to TS 016723a5747a4889963be3d058762626
I20260709 12:29:59.517272 16230 consensus_queue.cc:1048] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.522765 16035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43"
dest_uuid: "016723a5747a4889963be3d058762626"
mode: GRACEFUL
new_leader_uuid: "fa5bbc0be95d48069a791d991068b073"
 from {username='slave'} at 127.0.0.1:46290
I20260709 12:29:59.523391 16035 raft_consensus.cc:606] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Received request to transfer leadership to TS fa5bbc0be95d48069a791d991068b073
I20260709 12:29:59.528210 16230 consensus_queue.cc:1048] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.533233 16263 consensus_queue.cc:1048] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.544485 16108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213"
dest_uuid: "fa5bbc0be95d48069a791d991068b073"
mode: GRACEFUL
new_leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:40696
I20260709 12:29:59.545121 16108 raft_consensus.cc:606] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Received request to transfer leadership to TS f675c2d870874f87ade6aeb6d783ab6d
I20260709 12:29:59.549131 16263 consensus_queue.cc:1048] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.556790 16230 raft_consensus.cc:993] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626: : Instructing follower fa5bbc0be95d48069a791d991068b073 to start an election
I20260709 12:29:59.557200 16263 raft_consensus.cc:1081] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Signalling peer fa5bbc0be95d48069a791d991068b073 to start an election
I20260709 12:29:59.559079 16110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43"
dest_uuid: "fa5bbc0be95d48069a791d991068b073"
 from {username='slave'} at 127.0.0.1:40686
I20260709 12:29:59.559777 16110 raft_consensus.cc:493] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.560200 16110 raft_consensus.cc:3060] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.567665 16110 raft_consensus.cc:515] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.569710 16110 leader_election.cc:290] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 2 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.570237 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:59.570843 16035 raft_consensus.cc:3055] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.571098 16035 raft_consensus.cc:740] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:29:59.571789 16035 consensus_queue.cc:260] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.572163 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4cad5cf4c28f42ad8b44aef23d7aee43" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.572788 16184 raft_consensus.cc:3060] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.573068 16035 raft_consensus.cc:3060] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.578035 16184 raft_consensus.cc:2468] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 2.
I20260709 12:29:59.578945 16035 raft_consensus.cc:2468] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 2.
I20260709 12:29:59.578996 16076 leader_election.cc:304] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.579836 16231 raft_consensus.cc:2804] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.580211 16231 raft_consensus.cc:697] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 2 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:59.580883 16231 consensus_queue.cc:237] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.586673 15930 catalog_manager.cc:5697] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 1 to 2, leader changed from 016723a5747a4889963be3d058762626 (127.7.23.65) to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.645030 16269 consensus_queue.cc:1048] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.651955 16294 raft_consensus.cc:993] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d: : Instructing follower 016723a5747a4889963be3d058762626 to start an election
I20260709 12:29:59.652634 16269 raft_consensus.cc:1081] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Signalling peer 016723a5747a4889963be3d058762626 to start an election
I20260709 12:29:59.654523 16034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e"
dest_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:46276
I20260709 12:29:59.655082 16034 raft_consensus.cc:493] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.655469 16034 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.658500 16295 consensus_queue.cc:1048] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.662475 16034 raft_consensus.cc:515] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.666846 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.667531 16110 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.668097 16034 leader_election.cc:290] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.668322 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.669054 16184 raft_consensus.cc:3055] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.669376 16184 raft_consensus.cc:740] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:29:59.670172 16184 consensus_queue.cc:260] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.672076 16184 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.676043 16110 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:29:59.677162 16184 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:29:59.677865 16001 leader_election.cc:304] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:29:59.678683 16263 raft_consensus.cc:2804] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.679137 16263 raft_consensus.cc:697] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:29:59.679795 16263 consensus_queue.cc:237] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.685921 15931 catalog_manager.cc:5697] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 1 to 2, leader changed from f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67) to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.707844 16245 raft_consensus.cc:993] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073: : Instructing follower 016723a5747a4889963be3d058762626 to start an election
I20260709 12:29:59.708290 16231 raft_consensus.cc:1081] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Signalling peer 016723a5747a4889963be3d058762626 to start an election
I20260709 12:29:59.710494 16034 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c"
dest_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:29:59.711019 16034 raft_consensus.cc:493] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.711298 16034 raft_consensus.cc:3060] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.712365 16231 consensus_queue.cc:1048] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.716951 16034 raft_consensus.cc:515] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.721313 16034 leader_election.cc:290] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.722657 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.723289 16184 raft_consensus.cc:3060] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.723357 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3f18035f6cf431e8e829f38806e152c" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.724323 16110 raft_consensus.cc:3055] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.724629 16110 raft_consensus.cc:740] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:59.725399 16110 consensus_queue.cc:260] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.726512 16110 raft_consensus.cc:3060] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.723073 16276 consensus_queue.cc:1048] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:29:59.732322 16184 raft_consensus.cc:2468] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:29:59.733623 16001 leader_election.cc:304] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:29:59.734476 16263 raft_consensus.cc:2804] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.734861 16263 raft_consensus.cc:697] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:29:59.735671 16263 consensus_queue.cc:237] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.736326 16295 consensus_queue.cc:1048] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.739054 16110 raft_consensus.cc:2468] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:29:59.742717 16295 consensus_queue.cc:1048] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.751283 15930 catalog_manager.cc:5697] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 1 to 2, leader changed from fa5bbc0be95d48069a791d991068b073 (127.7.23.66) to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.753027 16269 raft_consensus.cc:993] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d: : Instructing follower 016723a5747a4889963be3d058762626 to start an election
I20260709 12:29:59.753546 16269 raft_consensus.cc:1081] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Signalling peer 016723a5747a4889963be3d058762626 to start an election
I20260709 12:29:59.755380 16035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196"
dest_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:46276
I20260709 12:29:59.756016 16035 raft_consensus.cc:493] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.756366 16035 raft_consensus.cc:3060] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.764037 16035 raft_consensus.cc:515] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.765254 16276 consensus_queue.cc:1048] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.767212 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.767867 16108 raft_consensus.cc:3060] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.768481 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0846708b324515bbf6b0c33d46b196" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:29:59.769095 16184 raft_consensus.cc:3055] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.769397 16184 raft_consensus.cc:740] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:29:59.770253 16184 consensus_queue.cc:260] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.771574 16184 raft_consensus.cc:3060] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.775728 16035 leader_election.cc:290] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:29:59.778621 16184 raft_consensus.cc:2468] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:29:59.775293 16108 raft_consensus.cc:2468] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:29:59.779862 16001 leader_election.cc:304] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:29:59.780649 16263 raft_consensus.cc:2804] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.781119 16263 raft_consensus.cc:697] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:29:59.781909 16263 consensus_queue.cc:237] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.785413 16276 consensus_queue.cc:1048] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:59.789528 15930 catalog_manager.cc:5697] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 1 to 2, leader changed from f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67) to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:59.793206 16245 raft_consensus.cc:993] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073: : Instructing follower f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:29:59.793743 16276 raft_consensus.cc:1081] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Signalling peer f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:29:59.795393 16184 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213"
dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:59424
I20260709 12:29:59.795974 16184 raft_consensus.cc:493] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:59.797097 16184 raft_consensus.cc:3060] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.803609 16184 raft_consensus.cc:515] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.805481 16184 leader_election.cc:290] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:29:59.806565 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:29:59.807122 16108 raft_consensus.cc:3055] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:59.807358 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84d596c2ecb14b1d9c7b8bcaf329d213" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:29:59.807540 16108 raft_consensus.cc:740] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:29:59.807968 16034 raft_consensus.cc:3060] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.808457 16108 consensus_queue.cc:260] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.809832 16108 raft_consensus.cc:3060] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:59.813304 16034 raft_consensus.cc:2468] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 2.
I20260709 12:29:59.814370 16149 leader_election.cc:304] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:29:59.815038 16108 raft_consensus.cc:2468] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 2.
I20260709 12:29:59.815129 16295 raft_consensus.cc:2804] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:59.815639 16295 raft_consensus.cc:697] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 2 LEADER]: Becoming Leader. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:29:59.816439 16295 consensus_queue.cc:237] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:29:59.822117 15930 catalog_manager.cc:5697] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d reported cstate change: term changed from 1 to 2, leader changed from fa5bbc0be95d48069a791d991068b073 (127.7.23.66) to f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:00.042307 16184 raft_consensus.cc:1275] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer fa5bbc0be95d48069a791d991068b073: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.043473 16276 consensus_queue.cc:1048] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.051128 16034 raft_consensus.cc:1275] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Refusing update from remote peer fa5bbc0be95d48069a791d991068b073: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.052629 16245 consensus_queue.cc:1048] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.110287 16184 raft_consensus.cc:1275] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.111385 16263 consensus_queue.cc:1048] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.118526 16108 raft_consensus.cc:1275] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.122457 16289 consensus_queue.cc:1048] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.207564 16110 raft_consensus.cc:1275] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.208801 16289 consensus_queue.cc:1048] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.211932 16184 raft_consensus.cc:1275] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.213145 16289 consensus_queue.cc:1048] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.217170 16183 raft_consensus.cc:1275] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.219274 16263 consensus_queue.cc:1048] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.227684 16110 raft_consensus.cc:1275] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.229193 16304 consensus_queue.cc:1048] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.376296 16034 raft_consensus.cc:1275] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.377475 16269 consensus_queue.cc:1048] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:00.385258 16110 raft_consensus.cc:1275] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:00.387312 16295 consensus_queue.cc:1048] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:02.585731 15931 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44346:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:30:02.588447 15931 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:30:02.638408 16020 tablet_service.cc:1511] Processing CreateTablet for tablet eb5da7f6be4a49e981d95ea8897d2ec7 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:02.639667 16097 tablet_service.cc:1511] Processing CreateTablet for tablet eb5da7f6be4a49e981d95ea8897d2ec7 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:02.640373 16020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5da7f6be4a49e981d95ea8897d2ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.641392 16097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5da7f6be4a49e981d95ea8897d2ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.643327 16170 tablet_service.cc:1511] Processing CreateTablet for tablet eb5da7f6be4a49e981d95ea8897d2ec7 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:30:02.644837 16170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb5da7f6be4a49e981d95ea8897d2ec7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.647807 16093 tablet_service.cc:1511] Processing CreateTablet for tablet 5567d4f855bb42639c4ae48ad36593ab (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:02.649242 16093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5567d4f855bb42639c4ae48ad36593ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.649502 16095 tablet_service.cc:1511] Processing CreateTablet for tablet 271e0b74281143c0b8dcc7c8e4a09cbb (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:02.650889 16095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271e0b74281143c0b8dcc7c8e4a09cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.656123 16100 tablet_service.cc:1511] Processing CreateTablet for tablet e5e0c9a83b2643cda992a95726dc80f7 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:02.657581 16100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e0c9a83b2643cda992a95726dc80f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.660277 16099 tablet_service.cc:1511] Processing CreateTablet for tablet 510681244a494d739604a2ee44540187 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:02.661748 16099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 510681244a494d739604a2ee44540187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.661900 16022 tablet_service.cc:1511] Processing CreateTablet for tablet 5567d4f855bb42639c4ae48ad36593ab (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:02.663335 16022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5567d4f855bb42639c4ae48ad36593ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.663600 16168 tablet_service.cc:1511] Processing CreateTablet for tablet 5567d4f855bb42639c4ae48ad36593ab (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:30:02.664608 16172 tablet_service.cc:1511] Processing CreateTablet for tablet e5e0c9a83b2643cda992a95726dc80f7 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:02.666961 16096 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2cd14ffd8347188bddd077c3c752a6 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:02.668345 16096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2cd14ffd8347188bddd077c3c752a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.669605 16024 tablet_service.cc:1511] Processing CreateTablet for tablet 510681244a494d739604a2ee44540187 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:02.670926 16024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 510681244a494d739604a2ee44540187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.670696 16098 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1a7ef3025449f1a5cb6f79ef966ca8 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:02.672567 16169 tablet_service.cc:1511] Processing CreateTablet for tablet 271e0b74281143c0b8dcc7c8e4a09cbb (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:02.676180 16094 tablet_service.cc:1511] Processing CreateTablet for tablet d6e425a7e8c144fe9a5ca4f10da1106c (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:02.677579 16094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e425a7e8c144fe9a5ca4f10da1106c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.681679 16092 tablet_service.cc:1511] Processing CreateTablet for tablet baec55282a1d49848fdc90cada401fc6 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:02.682039 16174 tablet_service.cc:1511] Processing CreateTablet for tablet 510681244a494d739604a2ee44540187 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:30:02.683048 16092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baec55282a1d49848fdc90cada401fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.684587 16171 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2cd14ffd8347188bddd077c3c752a6 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:02.684850 16167 tablet_service.cc:1511] Processing CreateTablet for tablet d6e425a7e8c144fe9a5ca4f10da1106c (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:02.686964 16173 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1a7ef3025449f1a5cb6f79ef966ca8 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:02.690768 16019 tablet_service.cc:1511] Processing CreateTablet for tablet 0e1a7ef3025449f1a5cb6f79ef966ca8 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:30:02.666394 16025 tablet_service.cc:1511] Processing CreateTablet for tablet 271e0b74281143c0b8dcc7c8e4a09cbb (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:30:02.693324 16018 tablet_service.cc:1511] Processing CreateTablet for tablet d6e425a7e8c144fe9a5ca4f10da1106c (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:30:02.668221 16023 tablet_service.cc:1511] Processing CreateTablet for tablet e5e0c9a83b2643cda992a95726dc80f7 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:30:02.691120 16021 tablet_service.cc:1511] Processing CreateTablet for tablet 0a2cd14ffd8347188bddd077c3c752a6 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:30:02.696866 16017 tablet_service.cc:1511] Processing CreateTablet for tablet baec55282a1d49848fdc90cada401fc6 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:02.664999 16168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5567d4f855bb42639c4ae48ad36593ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.692852 16019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1a7ef3025449f1a5cb6f79ef966ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.686964 16166 tablet_service.cc:1511] Processing CreateTablet for tablet baec55282a1d49848fdc90cada401fc6 (DEFAULT_TABLE table=soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:30:02.704843 16174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 510681244a494d739604a2ee44540187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.696895 16098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1a7ef3025449f1a5cb6f79ef966ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.705544 16173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e1a7ef3025449f1a5cb6f79ef966ca8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.706187 16166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baec55282a1d49848fdc90cada401fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.707296 16172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e0c9a83b2643cda992a95726dc80f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.709606 16169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271e0b74281143c0b8dcc7c8e4a09cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.711714 16171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2cd14ffd8347188bddd077c3c752a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.714406 16167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e425a7e8c144fe9a5ca4f10da1106c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.705345 16021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a2cd14ffd8347188bddd077c3c752a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.718225 16025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 271e0b74281143c0b8dcc7c8e4a09cbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.719784 16017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baec55282a1d49848fdc90cada401fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.720563 16023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e0c9a83b2643cda992a95726dc80f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.721256 16018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6e425a7e8c144fe9a5ca4f10da1106c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:30:02.776757 16319 tablet_bootstrap.cc:492] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:02.811913 16320 tablet_bootstrap.cc:492] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:02.822432 16319 tablet_bootstrap.cc:654] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.826372 16320 tablet_bootstrap.cc:654] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.866158 16321 tablet_bootstrap.cc:492] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:02.869098 16320 tablet_bootstrap.cc:492] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:02.871829 16320 ts_tablet_manager.cc:1403] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.004s
I20260709 12:30:02.874572 16320 raft_consensus.cc:359] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.875226 16320 raft_consensus.cc:385] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.875487 16320 raft_consensus.cc:740] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.876129 16321 tablet_bootstrap.cc:654] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.876222 16320 consensus_queue.cc:260] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.877727 16319 tablet_bootstrap.cc:492] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:02.878230 16319 ts_tablet_manager.cc:1403] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.102s	user 0.002s	sys 0.012s
I20260709 12:30:02.879051 16320 ts_tablet_manager.cc:1434] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:02.880129 16320 tablet_bootstrap.cc:492] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:02.881276 16319 raft_consensus.cc:359] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.882019 16319 raft_consensus.cc:385] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.882301 16319 raft_consensus.cc:740] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.883055 16319 consensus_queue.cc:260] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.886919 16320 tablet_bootstrap.cc:654] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.887296 16306 raft_consensus.cc:493] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:02.887656 16319 ts_tablet_manager.cc:1434] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.003s
I20260709 12:30:02.887833 16306 raft_consensus.cc:515] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.888753 16319 tablet_bootstrap.cc:492] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:02.890251 16306 leader_election.cc:290] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:02.892705 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:02.894336 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:02.896133 16319 tablet_bootstrap.cc:654] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
W20260709 12:30:02.896411 16001 leader_election.cc:343] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:02.897161 16001 leader_election.cc:343] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:02.897541 16001 leader_election.cc:304] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 016723a5747a4889963be3d058762626; no voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:02.900101 16306 raft_consensus.cc:2749] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:02.903319 16321 tablet_bootstrap.cc:492] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
W20260709 12:30:02.905303 16061 tablet.cc:2406] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:30:02.905715 16321 ts_tablet_manager.cc:1403] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.008s
I20260709 12:30:02.908408 16321 raft_consensus.cc:359] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.908838 16320 tablet_bootstrap.cc:492] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:02.909127 16321 raft_consensus.cc:385] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.909349 16320 ts_tablet_manager.cc:1403] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.008s
I20260709 12:30:02.909372 16319 tablet_bootstrap.cc:492] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:02.909459 16321 raft_consensus.cc:740] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.910127 16319 ts_tablet_manager.cc:1403] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.010s
I20260709 12:30:02.910427 16321 consensus_queue.cc:260] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.912073 16320 raft_consensus.cc:359] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.912799 16320 raft_consensus.cc:385] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.912966 16321 ts_tablet_manager.cc:1434] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:30:02.913097 16320 raft_consensus.cc:740] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.913116 16319 raft_consensus.cc:359] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.914052 16319 raft_consensus.cc:385] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.914108 16321 tablet_bootstrap.cc:492] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:02.914393 16319 raft_consensus.cc:740] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.914222 16320 consensus_queue.cc:260] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.915340 16319 consensus_queue.cc:260] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.917953 16319 ts_tablet_manager.cc:1434] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:30:02.918936 16319 tablet_bootstrap.cc:492] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:02.919920 16320 ts_tablet_manager.cc:1434] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 12:30:02.920892 16320 tablet_bootstrap.cc:492] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:02.924326 16321 tablet_bootstrap.cc:654] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.925288 16319 tablet_bootstrap.cc:654] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.927009 16320 tablet_bootstrap.cc:654] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.938834 16320 tablet_bootstrap.cc:492] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:02.939311 16320 ts_tablet_manager.cc:1403] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:30:02.942199 16320 raft_consensus.cc:359] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.942893 16320 raft_consensus.cc:385] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.943163 16320 raft_consensus.cc:740] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.943814 16320 consensus_queue.cc:260] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.946408 16320 ts_tablet_manager.cc:1434] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:30:02.947129 16320 tablet_bootstrap.cc:492] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:02.947942 16319 tablet_bootstrap.cc:492] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:02.948500 16319 ts_tablet_manager.cc:1403] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.012s
I20260709 12:30:02.949723 16321 tablet_bootstrap.cc:492] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:02.950237 16321 ts_tablet_manager.cc:1403] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.014s
I20260709 12:30:02.951515 16319 raft_consensus.cc:359] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.952242 16319 raft_consensus.cc:385] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.952518 16319 raft_consensus.cc:740] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.953459 16320 tablet_bootstrap.cc:654] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.953238 16321 raft_consensus.cc:359] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.953336 16319 consensus_queue.cc:260] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.954133 16321 raft_consensus.cc:385] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.954447 16321 raft_consensus.cc:740] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.955235 16321 consensus_queue.cc:260] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.957580 16321 ts_tablet_manager.cc:1434] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:02.958524 16321 tablet_bootstrap.cc:492] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:02.958776 16319 ts_tablet_manager.cc:1434] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:30:02.959800 16319 tablet_bootstrap.cc:492] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:02.963658 16308 raft_consensus.cc:493] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:02.964181 16308 raft_consensus.cc:515] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.965009 16320 tablet_bootstrap.cc:492] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:02.965008 16321 tablet_bootstrap.cc:654] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.965991 16319 tablet_bootstrap.cc:654] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.967270 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:02.967659 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:02.967972 16034 raft_consensus.cc:2468] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:30:02.969492 16075 leader_election.cc:304] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
W20260709 12:30:02.970667 16076 leader_election.cc:343] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:02.973035 16308 leader_election.cc:290] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:02.974481 16308 raft_consensus.cc:2804] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:02.974809 16308 raft_consensus.cc:493] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:02.975113 16308 raft_consensus.cc:3060] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:02.977145 16321 tablet_bootstrap.cc:492] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:02.977716 16321 ts_tablet_manager.cc:1403] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:30:02.965797 16320 ts_tablet_manager.cc:1403] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 12:30:02.979154 16295 raft_consensus.cc:493] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:02.979687 16295 raft_consensus.cc:515] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.982193 16320 raft_consensus.cc:359] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.982810 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:02.983523 16295 leader_election.cc:290] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:02.984632 16149 leader_election.cc:343] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:02.984755 15981 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:30:02.982892 16320 raft_consensus.cc:385] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.986907 16320 raft_consensus.cc:740] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.980963 16321 raft_consensus.cc:359] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.988837 16321 raft_consensus.cc:385] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:02.989199 16321 raft_consensus.cc:740] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:02.988691 16320 consensus_queue.cc:260] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.990216 16321 consensus_queue.cc:260] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.990840 16306 raft_consensus.cc:493] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:02.991526 16320 ts_tablet_manager.cc:1434] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:30:02.991329 16306 raft_consensus.cc:515] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:02.992553 16321 ts_tablet_manager.cc:1434] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 12:30:02.993494 16306 leader_election.cc:290] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:02.993625 16321 tablet_bootstrap.cc:492] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:02.995363 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:02.995572 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:02.992578 16320 tablet_bootstrap.cc:492] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:02.996306 16108 raft_consensus.cc:2468] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
W20260709 12:30:02.997143 16001 leader_election.cc:343] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:02.997911 16001 leader_election.cc:304] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: f675c2d870874f87ade6aeb6d783ab6d
I20260709 12:30:02.998729 16306 raft_consensus.cc:2804] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:02.999094 16306 raft_consensus.cc:493] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:02.999471 16306 raft_consensus.cc:3060] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.000478 16321 tablet_bootstrap.cc:654] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.003576 16320 tablet_bootstrap.cc:654] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:02.995364 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
W20260709 12:30:03.005206 16150 leader_election.cc:343] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.005640 16150 leader_election.cc:304] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:03.006842 16295 raft_consensus.cc:2749] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.007910 16306 raft_consensus.cc:515] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.010849 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:03.011439 16110 raft_consensus.cc:3060] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.011946 16321 tablet_bootstrap.cc:492] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:03.012488 16321 ts_tablet_manager.cc:1403] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.005s
I20260709 12:30:03.015172 16320 tablet_bootstrap.cc:492] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:03.015738 16320 ts_tablet_manager.cc:1403] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.009s
I20260709 12:30:03.015425 16321 raft_consensus.cc:359] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.016185 16321 raft_consensus.cc:385] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.016491 16321 raft_consensus.cc:740] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.017241 16321 consensus_queue.cc:260] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.018862 16320 raft_consensus.cc:359] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.019487 16321 ts_tablet_manager.cc:1434] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:30:03.019675 16320 raft_consensus.cc:385] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.020197 16320 raft_consensus.cc:740] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.020825 16321 tablet_bootstrap.cc:492] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:03.019061 16110 raft_consensus.cc:2468] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:30:03.020839 16320 consensus_queue.cc:260] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.022691 16001 leader_election.cc:304] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.023599 16320 ts_tablet_manager.cc:1434] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:30:03.020823 16319 tablet_bootstrap.cc:492] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:03.028021 16319 ts_tablet_manager.cc:1403] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.012s
I20260709 12:30:03.028708 16320 tablet_bootstrap.cc:492] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:03.029639 16337 raft_consensus.cc:2804] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.031600 16319 raft_consensus.cc:359] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.032013 16321 tablet_bootstrap.cc:654] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.032312 16319 raft_consensus.cc:385] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.032639 16319 raft_consensus.cc:740] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.034771 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
W20260709 12:30:03.036146 16001 leader_election.cc:343] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.036713 16306 leader_election.cc:290] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.037652 16320 tablet_bootstrap.cc:654] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.037832 16319 consensus_queue.cc:260] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.041885 16319 ts_tablet_manager.cc:1434] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:30:03.041950 16337 raft_consensus.cc:697] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:03.045373 16320 tablet_bootstrap.cc:492] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:03.045935 16319 tablet_bootstrap.cc:492] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:03.045982 16320 ts_tablet_manager.cc:1403] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.004s
I20260709 12:30:03.046115 16337 consensus_queue.cc:237] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.049466 16320 raft_consensus.cc:359] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.050189 16320 raft_consensus.cc:385] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.050474 16320 raft_consensus.cc:740] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.051249 16320 consensus_queue.cc:260] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.053490 16320 ts_tablet_manager.cc:1434] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:30:03.053774 16319 tablet_bootstrap.cc:654] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.054455 16320 tablet_bootstrap.cc:492] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:03.055576 16308 raft_consensus.cc:515] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.062417 16320 tablet_bootstrap.cc:654] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.066385 16321 tablet_bootstrap.cc:492] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:03.066998 16321 ts_tablet_manager.cc:1403] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.011s
I20260709 12:30:03.067345 16332 raft_consensus.cc:493] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.068146 16334 raft_consensus.cc:493] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.068717 16334 raft_consensus.cc:515] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.067967 16332 raft_consensus.cc:515] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.071979 16308 leader_election.cc:290] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.072468 16308 raft_consensus.cc:493] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.072618 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.072901 16308 raft_consensus.cc:515] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.073635 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.074364 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.074898 16308 leader_election.cc:290] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.074960 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.075922 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:03.076747 16033 raft_consensus.cc:3060] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.079790 16332 leader_election.cc:290] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
W20260709 12:30:03.080901 16076 leader_election.cc:343] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.083393 16182 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.084128 16182 raft_consensus.cc:2468] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:30:03.084180 16035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.085536 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
W20260709 12:30:03.086724 16075 leader_election.cc:343] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:30:03.087466 16075 leader_election.cc:343] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.087889 16075 leader_election.cc:304] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa5bbc0be95d48069a791d991068b073; no voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d
I20260709 12:30:03.085574 16076 leader_election.cc:304] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.095337 16308 raft_consensus.cc:2749] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.095960 16334 leader_election.cc:290] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.096215 16308 raft_consensus.cc:2804] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.096781 16308 raft_consensus.cc:493] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.097209 16308 raft_consensus.cc:3060] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.100692 16319 tablet_bootstrap.cc:492] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:03.101267 16319 ts_tablet_manager.cc:1403] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.056s	user 0.033s	sys 0.019s
I20260709 12:30:03.104266 16319 raft_consensus.cc:359] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.105082 16319 raft_consensus.cc:385] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.105366 16319 raft_consensus.cc:740] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
W20260709 12:30:03.095693 16076 leader_election.cc:343] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.106168 16319 consensus_queue.cc:260] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.107476 16308 raft_consensus.cc:515] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
W20260709 12:30:03.104300 16075 leader_election.cc:343] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.110638 16308 leader_election.cc:290] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.110774 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.111442 16184 raft_consensus.cc:3060] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.113183 16319 ts_tablet_manager.cc:1434] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:30:03.114320 16319 tablet_bootstrap.cc:492] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:03.116918 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
W20260709 12:30:03.119392 16075 leader_election.cc:343] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.121325 16319 tablet_bootstrap.cc:654] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.121986 16184 raft_consensus.cc:2468] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:30:03.123324 16076 leader_election.cc:304] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 016723a5747a4889963be3d058762626
I20260709 12:30:03.127668 16332 raft_consensus.cc:2804] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.127347 15933 catalog_manager.cc:5697] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.128371 16332 raft_consensus.cc:697] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:03.129230 16332 consensus_queue.cc:237] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.133736 16033 raft_consensus.cc:2468] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:30:03.137125 16321 raft_consensus.cc:359] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.137905 16321 raft_consensus.cc:385] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.138196 16321 raft_consensus.cc:740] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.141916 16320 tablet_bootstrap.cc:492] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:03.141625 16321 consensus_queue.cc:260] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.142649 16183 raft_consensus.cc:2468] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:30:03.144076 16321 ts_tablet_manager.cc:1434] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.002s
I20260709 12:30:03.147770 16076 leader_election.cc:304] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 016723a5747a4889963be3d058762626
I20260709 12:30:03.149154 16321 tablet_bootstrap.cc:492] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:03.149667 16343 raft_consensus.cc:2804] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.150099 16343 raft_consensus.cc:493] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.150406 16343 raft_consensus.cc:3060] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.150907 16320 ts_tablet_manager.cc:1403] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.097s	user 0.023s	sys 0.015s
I20260709 12:30:03.156431 16320 raft_consensus.cc:359] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.156950 16319 tablet_bootstrap.cc:492] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:03.157497 16319 ts_tablet_manager.cc:1403] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.012s
I20260709 12:30:03.160406 16319 raft_consensus.cc:359] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.161114 16319 raft_consensus.cc:385] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.161399 16319 raft_consensus.cc:740] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.162117 16319 consensus_queue.cc:260] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.163853 16319 ts_tablet_manager.cc:1434] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:30:03.162391 16075 leader_election.cc:304] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: f675c2d870874f87ade6aeb6d783ab6d
I20260709 12:30:03.164841 16319 tablet_bootstrap.cc:492] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:03.165200 16334 raft_consensus.cc:2804] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.165766 16334 raft_consensus.cc:697] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:03.166656 16334 consensus_queue.cc:237] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.164549 16321 tablet_bootstrap.cc:654] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.170436 16343 raft_consensus.cc:515] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.171900 16319 tablet_bootstrap.cc:654] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.173193 16320 raft_consensus.cc:385] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.173314 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
W20260709 12:30:03.174983 16075 leader_election.cc:343] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.173564 16320 raft_consensus.cc:740] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.176961 16320 consensus_queue.cc:260] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.179816 16320 ts_tablet_manager.cc:1434] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:30:03.180900 16320 tablet_bootstrap.cc:492] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:03.187739 16332 raft_consensus.cc:493] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.188226 16332 raft_consensus.cc:515] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.188351 15933 catalog_manager.cc:5697] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.189699 16321 tablet_bootstrap.cc:492] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:03.190418 16332 leader_election.cc:290] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.191241 16343 leader_election.cc:290] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.191144 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2cd14ffd8347188bddd077c3c752a6" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.192135 16321 ts_tablet_manager.cc:1403] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.003s
I20260709 12:30:03.192257 16033 raft_consensus.cc:2468] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:30:03.192662 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.193250 16183 raft_consensus.cc:3060] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.193569 16075 leader_election.cc:304] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.194600 16332 raft_consensus.cc:2804] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.194969 16332 raft_consensus.cc:493] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.195304 16332 raft_consensus.cc:3060] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.191442 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2cd14ffd8347188bddd077c3c752a6" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.196849 16184 raft_consensus.cc:2468] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:30:03.198515 16321 raft_consensus.cc:359] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.199295 16321 raft_consensus.cc:385] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.200152 16295 raft_consensus.cc:493] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.200735 16321 raft_consensus.cc:740] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.200340 16320 tablet_bootstrap.cc:654] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.200891 16295 raft_consensus.cc:515] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.201942 16321 consensus_queue.cc:260] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.203186 16295 leader_election.cc:290] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:03.204808 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e0c9a83b2643cda992a95726dc80f7" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.205427 16183 raft_consensus.cc:2468] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:30:03.205703 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e0c9a83b2643cda992a95726dc80f7" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.206604 16076 leader_election.cc:304] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 016723a5747a4889963be3d058762626
W20260709 12:30:03.207320 16150 leader_election.cc:343] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.208099 16343 raft_consensus.cc:2804] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.208640 16343 raft_consensus.cc:697] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:03.209532 16343 consensus_queue.cc:237] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
W20260709 12:30:03.212796 16149 leader_election.cc:343] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.212867 16321 ts_tablet_manager.cc:1434] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.005s
I20260709 12:30:03.213385 16149 leader_election.cc:304] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:03.213387 16319 tablet_bootstrap.cc:492] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:03.214615 16319 ts_tablet_manager.cc:1403] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.016s
I20260709 12:30:03.215620 16295 raft_consensus.cc:2749] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.216120 16320 tablet_bootstrap.cc:492] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:03.216708 16320 ts_tablet_manager.cc:1403] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.003s
I20260709 12:30:03.216823 16321 tablet_bootstrap.cc:492] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:03.217520 16319 raft_consensus.cc:359] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.218245 16319 raft_consensus.cc:385] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.218544 16319 raft_consensus.cc:740] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.219549 16320 raft_consensus.cc:359] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.220361 16320 raft_consensus.cc:385] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.220625 16320 raft_consensus.cc:740] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.220611 16319 consensus_queue.cc:260] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.221637 16320 consensus_queue.cc:260] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.203163 16332 raft_consensus.cc:515] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.223217 16319 ts_tablet_manager.cc:1434] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:30:03.223982 16320 ts_tablet_manager.cc:1434] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:30:03.238560 16319 tablet_bootstrap.cc:492] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:03.238718 16321 tablet_bootstrap.cc:654] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.239322 16332 leader_election.cc:290] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.240479 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2cd14ffd8347188bddd077c3c752a6" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:03.241109 16033 raft_consensus.cc:3060] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.241891 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a2cd14ffd8347188bddd077c3c752a6" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.242488 16183 raft_consensus.cc:3060] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.246647 16319 tablet_bootstrap.cc:654] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.248543 16033 raft_consensus.cc:2468] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:30:03.249495 16306 raft_consensus.cc:493] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.249953 16075 leader_election.cc:304] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.250383 16183 raft_consensus.cc:2468] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:30:03.250828 16332 raft_consensus.cc:2804] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.249969 16306 raft_consensus.cc:515] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.251164 16320 tablet_bootstrap.cc:492] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073: Bootstrap starting.
I20260709 12:30:03.251366 16332 raft_consensus.cc:697] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:03.252252 16332 consensus_queue.cc:237] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.255575 16184 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e425a7e8c144fe9a5ca4f10da1106c" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
W20260709 12:30:03.256815 16001 leader_election.cc:343] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.256997 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e425a7e8c144fe9a5ca4f10da1106c" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.257767 16320 tablet_bootstrap.cc:654] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.252806 16306 leader_election.cc:290] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.266745 16319 tablet_bootstrap.cc:492] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
W20260709 12:30:03.267002 16001 leader_election.cc:343] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:30:03.267189 16319 ts_tablet_manager.cc:1403] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.010s
I20260709 12:30:03.267510 16001 leader_election.cc:304] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 016723a5747a4889963be3d058762626; no voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:03.268244 16320 tablet_bootstrap.cc:492] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073: No bootstrap required, opened a new log
I20260709 12:30:03.268684 16320 ts_tablet_manager.cc:1403] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.002s
I20260709 12:30:03.270128 16319 raft_consensus.cc:359] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.270824 16319 raft_consensus.cc:385] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.271085 16319 raft_consensus.cc:740] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.271219 16320 raft_consensus.cc:359] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.271901 16320 raft_consensus.cc:385] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.272208 16320 raft_consensus.cc:740] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.271984 16319 consensus_queue.cc:260] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.273147 16320 consensus_queue.cc:260] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.275444 16320 ts_tablet_manager.cc:1434] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:30:03.271960 16306 raft_consensus.cc:2749] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.277036 16319 ts_tablet_manager.cc:1434] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:30:03.277951 16319 tablet_bootstrap.cc:492] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626: Bootstrap starting.
I20260709 12:30:03.280303 15931 catalog_manager.cc:5697] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.282001 16319 tablet_bootstrap.cc:654] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.282958 15931 catalog_manager.cc:5697] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.284343 15931 catalog_manager.cc:5697] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.285120 16321 tablet_bootstrap.cc:492] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:03.285568 16321 ts_tablet_manager.cc:1403] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.009s
I20260709 12:30:03.287087 16319 tablet_bootstrap.cc:492] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626: No bootstrap required, opened a new log
I20260709 12:30:03.287578 16319 ts_tablet_manager.cc:1403] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626: Time spent bootstrapping tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:30:03.288466 16321 raft_consensus.cc:359] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.289177 16321 raft_consensus.cc:385] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.289461 16321 raft_consensus.cc:740] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.290242 16319 raft_consensus.cc:359] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.290198 16321 consensus_queue.cc:260] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.290959 16319 raft_consensus.cc:385] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.291229 16319 raft_consensus.cc:740] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.292073 16319 consensus_queue.cc:260] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.292635 16321 ts_tablet_manager.cc:1434] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:30:03.293643 16321 tablet_bootstrap.cc:492] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:03.294106 16319 ts_tablet_manager.cc:1434] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:30:03.299616 16321 tablet_bootstrap.cc:654] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.309151 16321 tablet_bootstrap.cc:492] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:03.309657 16321 ts_tablet_manager.cc:1403] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.016s	user 0.001s	sys 0.012s
I20260709 12:30:03.312280 16321 raft_consensus.cc:359] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.312877 16321 raft_consensus.cc:385] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.313104 16306 raft_consensus.cc:493] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.313117 16321 raft_consensus.cc:740] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.313778 16306 raft_consensus.cc:515] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.314108 16321 consensus_queue.cc:260] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.315919 16306 leader_election.cc:290] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.316309 16321 ts_tablet_manager.cc:1434] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:30:03.316583 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "510681244a494d739604a2ee44540187" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.317133 16321 tablet_bootstrap.cc:492] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: Bootstrap starting.
I20260709 12:30:03.317233 16110 raft_consensus.cc:2468] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
I20260709 12:30:03.318778 16001 leader_election.cc:304] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.319757 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "510681244a494d739604a2ee44540187" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.320412 16183 raft_consensus.cc:2468] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
I20260709 12:30:03.321144 16306 raft_consensus.cc:2804] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.321518 16306 raft_consensus.cc:493] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.321834 16306 raft_consensus.cc:3060] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.322976 16321 tablet_bootstrap.cc:654] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: Neither blocks nor log segments found. Creating new log.
I20260709 12:30:03.328079 16321 tablet_bootstrap.cc:492] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: No bootstrap required, opened a new log
I20260709 12:30:03.328559 16321 ts_tablet_manager.cc:1403] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:30:03.328858 16306 raft_consensus.cc:515] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.331151 16321 raft_consensus.cc:359] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.331970 16321 raft_consensus.cc:385] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:30:03.332245 16321 raft_consensus.cc:740] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Initialized, Role: FOLLOWER
I20260709 12:30:03.332753 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "510681244a494d739604a2ee44540187" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:03.332928 16321 consensus_queue.cc:260] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.333374 16110 raft_consensus.cc:3060] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.334985 16321 ts_tablet_manager.cc:1434] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:30:03.339049 16110 raft_consensus.cc:2468] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:30:03.339752 16306 leader_election.cc:290] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.340353 16001 leader_election.cc:304] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.341013 16306 raft_consensus.cc:2804] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.341634 16306 raft_consensus.cc:697] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:03.341665 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "510681244a494d739604a2ee44540187" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.342305 16183 raft_consensus.cc:3060] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.342315 16306 consensus_queue.cc:237] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.350194 16183 raft_consensus.cc:2468] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:30:03.352756 15931 catalog_manager.cc:5697] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.417397 16306 raft_consensus.cc:493] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.417973 16306 raft_consensus.cc:515] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.420240 16306 leader_election.cc:290] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.420959 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.421320 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e1a7ef3025449f1a5cb6f79ef966ca8" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.422050 16183 raft_consensus.cc:2393] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 016723a5747a4889963be3d058762626 in current term 1: Already voted for candidate fa5bbc0be95d48069a791d991068b073 in this term.
I20260709 12:30:03.422962 16001 leader_election.cc:304] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 016723a5747a4889963be3d058762626; no voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:03.423697 16306 raft_consensus.cc:3060] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.429487 16306 raft_consensus.cc:2749] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.430568 16343 raft_consensus.cc:493] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.431157 16343 raft_consensus.cc:515] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.433084 16343 leader_election.cc:290] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.433807 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e425a7e8c144fe9a5ca4f10da1106c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.434141 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e425a7e8c144fe9a5ca4f10da1106c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.434530 16033 raft_consensus.cc:2468] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:30:03.434813 16183 raft_consensus.cc:2468] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 0.
I20260709 12:30:03.435650 16075 leader_election.cc:304] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.436434 16343 raft_consensus.cc:2804] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.436794 16343 raft_consensus.cc:493] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.437121 16343 raft_consensus.cc:3060] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.442029 16343 raft_consensus.cc:515] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.443662 16343 leader_election.cc:290] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.444309 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e425a7e8c144fe9a5ca4f10da1106c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:03.444576 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6e425a7e8c144fe9a5ca4f10da1106c" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.444876 16033 raft_consensus.cc:3060] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.445248 16183 raft_consensus.cc:3060] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.448334 16295 raft_consensus.cc:493] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.448899 16295 raft_consensus.cc:515] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.450364 16033 raft_consensus.cc:2468] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:30:03.451062 16295 leader_election.cc:290] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:03.451515 16183 raft_consensus.cc:2468] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 1.
I20260709 12:30:03.452160 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.452226 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.452176 16075 leader_election.cc:304] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.452890 16033 raft_consensus.cc:2468] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 0.
I20260709 12:30:03.453024 16110 raft_consensus.cc:2468] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 0.
I20260709 12:30:03.453680 16343 raft_consensus.cc:2804] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.453728 16295 raft_consensus.cc:493] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.454164 16149 leader_election.cc:304] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:30:03.454360 16343 raft_consensus.cc:697] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:03.454430 16295 raft_consensus.cc:515] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.455394 16343 consensus_queue.cc:237] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.455940 16360 raft_consensus.cc:2804] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.456350 16360 raft_consensus.cc:493] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.456666 16360 raft_consensus.cc:3060] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.457732 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.458043 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626" is_pre_election: true
I20260709 12:30:03.458940 16033 raft_consensus.cc:2393] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f675c2d870874f87ade6aeb6d783ab6d in current term 1: Already voted for candidate fa5bbc0be95d48069a791d991068b073 in this term.
I20260709 12:30:03.459360 16295 leader_election.cc:290] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:03.460112 16149 leader_election.cc:304] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:03.461265 16295 raft_consensus.cc:3060] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.463832 16306 consensus_queue.cc:1048] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:30:03.464192 16360 raft_consensus.cc:515] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.467257 16360 leader_election.cc:290] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:03.467643 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:03.468182 16033 raft_consensus.cc:3060] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.468009 16108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:03.468693 16108 raft_consensus.cc:3060] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.476768 15931 catalog_manager.cc:5697] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 0 to 1, leader changed from <none> to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 1 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.477946 16295 raft_consensus.cc:2749] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.475265 16108 raft_consensus.cc:2468] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 1.
I20260709 12:30:03.481300 16150 leader_election.cc:304] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.481879 16033 raft_consensus.cc:2468] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 1.
I20260709 12:30:03.482158 16295 raft_consensus.cc:2804] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.482681 16295 raft_consensus.cc:697] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Becoming Leader. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:30:03.483546 16295 consensus_queue.cc:237] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.493273 16183 raft_consensus.cc:3060] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.500921 15930 catalog_manager.cc:5697] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d reported cstate change: term changed from 0 to 1, leader changed from <none> to f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67). New cstate: current_term: 1 leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:03.502086 16306 consensus_queue.cc:1048] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.507278 16306 raft_consensus.cc:493] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.507807 16306 raft_consensus.cc:515] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.509950 16306 leader_election.cc:290] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.511008 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e0c9a83b2643cda992a95726dc80f7" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.511178 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e0c9a83b2643cda992a95726dc80f7" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.511806 16183 raft_consensus.cc:2468] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
I20260709 12:30:03.511840 16110 raft_consensus.cc:2468] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 0.
I20260709 12:30:03.512889 16001 leader_election.cc:304] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:30:03.513476 16306 raft_consensus.cc:2804] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:30:03.513824 16306 raft_consensus.cc:493] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:30:03.514138 16306 raft_consensus.cc:3060] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.519790 16306 raft_consensus.cc:515] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.521564 16306 leader_election.cc:290] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.522228 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e0c9a83b2643cda992a95726dc80f7" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:03.522572 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5e0c9a83b2643cda992a95726dc80f7" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.522902 16110 raft_consensus.cc:3060] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.523164 16183 raft_consensus.cc:3060] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.530099 16110 raft_consensus.cc:2468] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:30:03.530099 16183 raft_consensus.cc:2468] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 1.
I20260709 12:30:03.531225 16001 leader_election.cc:304] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.531948 16306 raft_consensus.cc:2804] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:30:03.532338 16306 raft_consensus.cc:697] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:03.533087 16306 consensus_queue.cc:237] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.539925 15930 catalog_manager.cc:5697] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 0 to 1, leader changed from <none> to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 1 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.547628 16343 consensus_queue.cc:1048] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.557323 16332 consensus_queue.cc:1048] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.617661 16306 raft_consensus.cc:493] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:30:03.618125 16306 raft_consensus.cc:515] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.619797 16306 leader_election.cc:290] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.620682 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa5bbc0be95d48069a791d991068b073" is_pre_election: true
I20260709 12:30:03.620872 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d" is_pre_election: true
I20260709 12:30:03.621601 16183 raft_consensus.cc:2393] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 016723a5747a4889963be3d058762626 in current term 1: Already voted for candidate fa5bbc0be95d48069a791d991068b073 in this term.
I20260709 12:30:03.622460 16001 leader_election.cc:304] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 016723a5747a4889963be3d058762626; no voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:03.623107 16306 raft_consensus.cc:3060] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:30:03.628762 16306 raft_consensus.cc:2749] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:30:03.637998 16183 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7"
dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
mode: GRACEFUL
new_leader_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:59428
I20260709 12:30:03.638710 16183 raft_consensus.cc:606] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Received request to transfer leadership to TS 016723a5747a4889963be3d058762626
I20260709 12:30:03.643573 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab"
dest_uuid: "fa5bbc0be95d48069a791d991068b073"
mode: GRACEFUL
new_leader_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:40696
I20260709 12:30:03.644003 16110 raft_consensus.cc:606] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Received request to transfer leadership to TS 016723a5747a4889963be3d058762626
I20260709 12:30:03.648437 16110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb"
dest_uuid: "fa5bbc0be95d48069a791d991068b073"
mode: GRACEFUL
new_leader_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:40696
I20260709 12:30:03.648869 16110 raft_consensus.cc:606] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Received request to transfer leadership to TS 016723a5747a4889963be3d058762626
I20260709 12:30:03.655354 16033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "510681244a494d739604a2ee44540187"
dest_uuid: "016723a5747a4889963be3d058762626"
mode: GRACEFUL
new_leader_uuid: "fa5bbc0be95d48069a791d991068b073"
 from {username='slave'} at 127.0.0.1:46290
I20260709 12:30:03.655869 16033 raft_consensus.cc:606] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Received request to transfer leadership to TS fa5bbc0be95d48069a791d991068b073
I20260709 12:30:03.666766 16033 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6"
dest_uuid: "016723a5747a4889963be3d058762626"
mode: GRACEFUL
new_leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:46290
I20260709 12:30:03.667235 16033 raft_consensus.cc:606] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Received request to transfer leadership to TS f675c2d870874f87ade6aeb6d783ab6d
I20260709 12:30:03.680037 16332 consensus_queue.cc:1048] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.690047 16343 consensus_queue.cc:1048] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.715528 16343 consensus_queue.cc:1048] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.727339 16334 consensus_queue.cc:1048] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.727752 16332 consensus_queue.cc:1048] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.740731 16334 consensus_queue.cc:1048] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.748644 16376 raft_consensus.cc:993] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: : Instructing follower 016723a5747a4889963be3d058762626 to start an election
I20260709 12:30:03.749127 16334 raft_consensus.cc:1081] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Signalling peer 016723a5747a4889963be3d058762626 to start an election
I20260709 12:30:03.750691 16033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb"
dest_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:30:03.751356 16033 raft_consensus.cc:493] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:03.751737 16033 raft_consensus.cc:3060] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.757170 16033 raft_consensus.cc:515] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.758756 16033 leader_election.cc:290] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.759649 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:03.760035 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "271e0b74281143c0b8dcc7c8e4a09cbb" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.760335 16110 raft_consensus.cc:3055] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:03.760653 16183 raft_consensus.cc:3060] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.760686 16110 raft_consensus.cc:740] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:03.761555 16110 consensus_queue.cc:260] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.762738 16110 raft_consensus.cc:3060] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.767859 16183 raft_consensus.cc:2468] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:30:03.768989 16001 leader_election.cc:304] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:30:03.769030 16110 raft_consensus.cc:2468] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:30:03.769723 16306 raft_consensus.cc:2804] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:03.770110 16306 raft_consensus.cc:697] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:03.770838 16306 consensus_queue.cc:237] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.777251 16306 consensus_queue.cc:1048] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.778088 15930 catalog_manager.cc:5697] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 1 to 2, leader changed from fa5bbc0be95d48069a791d991068b073 (127.7.23.66) to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.795481 16338 consensus_queue.cc:1048] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.802059 16337 raft_consensus.cc:993] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: : Instructing follower fa5bbc0be95d48069a791d991068b073 to start an election
I20260709 12:30:03.802488 16338 raft_consensus.cc:1081] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Signalling peer fa5bbc0be95d48069a791d991068b073 to start an election
I20260709 12:30:03.804095 16110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "510681244a494d739604a2ee44540187"
dest_uuid: "fa5bbc0be95d48069a791d991068b073"
 from {username='slave'} at 127.0.0.1:40686
I20260709 12:30:03.804597 16110 raft_consensus.cc:493] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:03.804924 16110 raft_consensus.cc:3060] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.809468 16110 raft_consensus.cc:515] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.810818 16110 leader_election.cc:290] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 2 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.811849 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "510681244a494d739604a2ee44540187" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:03.811959 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "510681244a494d739604a2ee44540187" candidate_uuid: "fa5bbc0be95d48069a791d991068b073" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.812585 16033 raft_consensus.cc:3055] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:03.812688 16183 raft_consensus.cc:3060] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.812877 16033 raft_consensus.cc:740] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:03.813654 16033 consensus_queue.cc:260] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.814607 16033 raft_consensus.cc:3060] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.818802 16183 raft_consensus.cc:2468] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 2.
I20260709 12:30:03.819790 16076 leader_election.cc:304] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.819895 16033 raft_consensus.cc:2468] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa5bbc0be95d48069a791d991068b073 in term 2.
I20260709 12:30:03.820480 16334 raft_consensus.cc:2804] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:03.820904 16334 raft_consensus.cc:697] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 2 LEADER]: Becoming Leader. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:03.821652 16334 consensus_queue.cc:237] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.828243 15930 catalog_manager.cc:5697] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 reported cstate change: term changed from 1 to 2, leader changed from 016723a5747a4889963be3d058762626 (127.7.23.65) to fa5bbc0be95d48069a791d991068b073 (127.7.23.66). New cstate: current_term: 2 leader_uuid: "fa5bbc0be95d48069a791d991068b073" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:03.875203 16334 consensus_queue.cc:1048] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.884778 16376 consensus_queue.cc:1048] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.909133 16337 raft_consensus.cc:993] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: : Instructing follower f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:30:03.909636 16338 raft_consensus.cc:1081] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Signalling peer f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:30:03.911207 16183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6"
dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:59414
I20260709 12:30:03.911770 16183 raft_consensus.cc:493] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:03.912104 16183 raft_consensus.cc:3060] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.916785 16183 raft_consensus.cc:515] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.918242 16183 leader_election.cc:290] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:03.919019 16033 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:03.919353 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baec55282a1d49848fdc90cada401fc6" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:03.919755 16033 raft_consensus.cc:3055] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:03.919950 16110 raft_consensus.cc:3060] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.920122 16033 raft_consensus.cc:740] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:03.920982 16033 consensus_queue.cc:260] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.922192 16033 raft_consensus.cc:3060] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.926616 16110 raft_consensus.cc:2468] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 2.
I20260709 12:30:03.927891 16150 leader_election.cc:304] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.928689 16295 raft_consensus.cc:2804] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:03.929162 16295 raft_consensus.cc:697] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 2 LEADER]: Becoming Leader. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:30:03.929690 16033 raft_consensus.cc:2468] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 2.
I20260709 12:30:03.929956 16295 consensus_queue.cc:237] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.937413 15930 catalog_manager.cc:5697] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d reported cstate change: term changed from 1 to 2, leader changed from 016723a5747a4889963be3d058762626 (127.7.23.65) to f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:03.951691 16295 consensus_queue.cc:1048] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.958765 16295 raft_consensus.cc:993] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: : Instructing follower 016723a5747a4889963be3d058762626 to start an election
I20260709 12:30:03.961306 16295 raft_consensus.cc:1081] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Signalling peer 016723a5747a4889963be3d058762626 to start an election
I20260709 12:30:03.963467 16033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7"
dest_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:46276
I20260709 12:30:03.964077 16033 raft_consensus.cc:493] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:03.964471 16033 raft_consensus.cc:3060] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.965170 16295 consensus_queue.cc:1048] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:03.971748 16033 raft_consensus.cc:515] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.973912 16033 leader_election.cc:290] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:03.974452 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:03.974931 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb5da7f6be4a49e981d95ea8897d2ec7" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:03.975390 16110 raft_consensus.cc:3060] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.975529 16183 raft_consensus.cc:3055] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:03.975926 16183 raft_consensus.cc:740] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:30:03.976754 16183 consensus_queue.cc:260] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.977905 16183 raft_consensus.cc:3060] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:03.983024 16110 raft_consensus.cc:2468] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:30:03.984277 16001 leader_election.cc:304] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:03.984388 16183 raft_consensus.cc:2468] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:30:03.985132 16338 raft_consensus.cc:2804] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:03.985682 16338 raft_consensus.cc:697] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:03.986487 16338 consensus_queue.cc:237] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:03.993539 15930 catalog_manager.cc:5697] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 1 to 2, leader changed from f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67) to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.034811 16376 raft_consensus.cc:993] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: : Instructing follower 016723a5747a4889963be3d058762626 to start an election
I20260709 12:30:04.035346 16343 raft_consensus.cc:1081] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Signalling peer 016723a5747a4889963be3d058762626 to start an election
I20260709 12:30:04.037173 16033 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab"
dest_uuid: "016723a5747a4889963be3d058762626"
 from {username='slave'} at 127.0.0.1:46270
I20260709 12:30:04.037750 16033 raft_consensus.cc:493] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:04.038111 16033 raft_consensus.cc:3060] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.044167 16033 raft_consensus.cc:515] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:04.045632 16033 leader_election.cc:290] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Requested vote from peers fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537), f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67:32823)
I20260709 12:30:04.046373 16110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:04.046607 16183 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5567d4f855bb42639c4ae48ad36593ab" candidate_uuid: "016723a5747a4889963be3d058762626" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
I20260709 12:30:04.047034 16110 raft_consensus.cc:3055] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:04.047106 16183 raft_consensus.cc:3060] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.047384 16110 raft_consensus.cc:740] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:04.048158 16110 consensus_queue.cc:260] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:04.049265 16110 raft_consensus.cc:3060] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:04.053633 16183 raft_consensus.cc:2468] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:30:04.054818 16001 leader_election.cc:304] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:30:04.055485 16110 raft_consensus.cc:2468] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 016723a5747a4889963be3d058762626 in term 2.
I20260709 12:30:04.055584 16338 raft_consensus.cc:2804] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:04.056133 16338 raft_consensus.cc:697] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Becoming Leader. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:04.056025 16337 consensus_queue.cc:1048] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:04.056916 16338 consensus_queue.cc:237] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:04.064311 15930 catalog_manager.cc:5697] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 reported cstate change: term changed from 1 to 2, leader changed from fa5bbc0be95d48069a791d991068b073 (127.7.23.66) to 016723a5747a4889963be3d058762626 (127.7.23.65). New cstate: current_term: 2 leader_uuid: "016723a5747a4889963be3d058762626" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: UNKNOWN } } }
I20260709 12:30:04.072840 16306 consensus_queue.cc:1048] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:30:04.156107 16183 raft_consensus.cc:1275] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.157290 16306 consensus_queue.cc:1048] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.165470 16108 raft_consensus.cc:1275] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.167595 16338 consensus_queue.cc:1048] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.300864 16183 raft_consensus.cc:1275] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer fa5bbc0be95d48069a791d991068b073: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.302018 16332 consensus_queue.cc:1048] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.308954 16033 raft_consensus.cc:1275] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Refusing update from remote peer fa5bbc0be95d48069a791d991068b073: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.310544 16376 consensus_queue.cc:1048] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.322446 16108 raft_consensus.cc:1275] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.324074 16295 consensus_queue.cc:1048] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.331254 16033 raft_consensus.cc:1275] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.332860 16383 consensus_queue.cc:1048] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.445603 16108 raft_consensus.cc:1275] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.446957 16337 consensus_queue.cc:1048] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.454723 16183 raft_consensus.cc:1275] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.456151 16306 consensus_queue.cc:1048] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.458985 16108 raft_consensus.cc:1275] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.461179 16338 consensus_queue.cc:1048] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:04.473865 16183 raft_consensus.cc:1275] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Refusing update from remote peer 016723a5747a4889963be3d058762626: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:04.475126 16338 consensus_queue.cc:1048] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:06.670157 15930 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44346:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:30:06.689651 15930 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:44346:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:30:06.710846  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:30:06.967808 16428 log.cc:927] Time spent T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:30:06.961004 16435 tablet.cc:1724] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:06.977610 16442 tablet.cc:1724] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:06.977416 16440 tablet.cc:1724] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:06.990388 16108 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f"
dest_uuid: "fa5bbc0be95d48069a791d991068b073"
mode: GRACEFUL
new_leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:51984
I20260709 12:30:06.961004 16436 tablet.cc:1724] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.003337 16108 raft_consensus.cc:606] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Received request to transfer leadership to TS f675c2d870874f87ade6aeb6d783ab6d
W20260709 12:30:07.007913 16426 log.cc:927] Time spent T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:30:06.999986 16437 tablet.cc:1724] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:07.018651 16431 log.cc:927] Time spent T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 12:30:07.045413 16439 raft_consensus.cc:993] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073: : Instructing follower f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:30:07.004920 16447 tablet.cc:1724] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:30:07.008451 16075 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.23.65:40287, user_credentials={real_user=slave}} blocked reactor thread for 48666us
I20260709 12:30:07.075795 16456 tablet.cc:1724] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.067093 16439 raft_consensus.cc:1081] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Signalling peer f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:30:07.065692 16448 tablet.cc:1724] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.101471 16452 tablet.cc:1724] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.107105 16436 tablet.cc:1724] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.114259 16442 tablet.cc:1724] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.118836 16183 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f"
dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:59424
I20260709 12:30:07.117357 16447 tablet.cc:1724] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.131526 16183 raft_consensus.cc:493] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:07.134938 16183 raft_consensus.cc:3060] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.151695 16183 raft_consensus.cc:515] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:07.157866 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:07.158602 16034 raft_consensus.cc:3060] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.157819 16183 leader_election.cc:290] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:07.169344 16032 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e"
dest_uuid: "016723a5747a4889963be3d058762626"
mode: GRACEFUL
new_leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:37620
I20260709 12:30:07.170034 16032 raft_consensus.cc:606] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Received request to transfer leadership to TS f675c2d870874f87ade6aeb6d783ab6d
I20260709 12:30:07.172096 16440 tablet.cc:1724] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.173624  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:30:07.174338  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:07.157735 16435 tablet.cc:1724] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.187426 16456 tablet.cc:1724] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.164983 16448 tablet.cc:1724] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.135581 16460 tablet.cc:1724] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.199934 16462 tablet.cc:1724] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.205917 16034 raft_consensus.cc:2468] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 2.
I20260709 12:30:07.209156 16447 tablet.cc:1724] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.212858 16149 leader_election.cc:304] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 016723a5747a4889963be3d058762626, f675c2d870874f87ade6aeb6d783ab6d; no voters: 
I20260709 12:30:07.207037 16436 tablet.cc:1724] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.214865 16437 tablet.cc:1724] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.227209 16461 tablet.cc:1724] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.228686 16447 tablet.cc:1724] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.241201 16387 raft_consensus.cc:2804] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:30:07.241689 16387 raft_consensus.cc:697] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 2 LEADER]: Becoming Leader. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:30:07.242472 16387 consensus_queue.cc:237] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:07.245836 16462 tablet.cc:1724] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.248906 16442 tablet.cc:1724] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.250331 16106 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e393cbd9bac4f63b1fa4d7cf01ece7f" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:07.251032 16106 raft_consensus.cc:3055] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:30:07.251493 16106 raft_consensus.cc:740] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa5bbc0be95d48069a791d991068b073, State: Running, Role: LEADER
I20260709 12:30:07.252334 16106 consensus_queue.cc:260] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:07.253690 16106 raft_consensus.cc:3060] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:30:07.250800 16440 tablet.cc:1724] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.260860 16448 tablet.cc:1724] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:30:07.271700 16106 raft_consensus.cc:2468] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 2.
I20260709 12:30:07.291755 15930 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398: soft_deleted_table [id=73954d608fda43b0a1d3ea6d8bee37e9] alter complete (version 1)
I20260709 12:30:07.300913 15930 catalog_manager.cc:5697] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d reported cstate change: term changed from 1 to 2, leader changed from fa5bbc0be95d48069a791d991068b073 (127.7.23.66) to f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67). New cstate: current_term: 2 leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:07.609041 16457 raft_consensus.cc:993] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626: : Instructing follower f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:30:07.609553 16455 raft_consensus.cc:1081] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Signalling peer f675c2d870874f87ade6aeb6d783ab6d to start an election
I20260709 12:30:07.610996 16181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e"
dest_uuid: "f675c2d870874f87ade6aeb6d783ab6d"
 from {username='slave'} at 127.0.0.1:59414
I20260709 12:30:07.611464 16181 raft_consensus.cc:493] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:30:07.611770 16181 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:07.617844 16181 raft_consensus.cc:515] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:07.619592 16181 leader_election.cc:290] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 election: Requested vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:07.620275 16034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "016723a5747a4889963be3d058762626"
I20260709 12:30:07.620744 16107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187f458751d43f099461bb0804b4b0e" candidate_uuid: "f675c2d870874f87ade6aeb6d783ab6d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "fa5bbc0be95d48069a791d991068b073"
I20260709 12:30:07.620859 16034 raft_consensus.cc:3055] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:30:07.621284 16034 raft_consensus.cc:740] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 016723a5747a4889963be3d058762626, State: Running, Role: LEADER
I20260709 12:30:07.621297 16107 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:07.621981 16034 consensus_queue.cc:260] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:07.622922 16034 raft_consensus.cc:3060] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:30:07.627053 16107 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 3.
I20260709 12:30:07.627902 16035 raft_consensus.cc:1275] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.628348 16150 leader_election.cc:304] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d, fa5bbc0be95d48069a791d991068b073; no voters: 
I20260709 12:30:07.628664 16034 raft_consensus.cc:2468] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f675c2d870874f87ade6aeb6d783ab6d in term 3.
I20260709 12:30:07.629230 16387 raft_consensus.cc:2804] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:30:07.629736 16387 raft_consensus.cc:697] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 3 LEADER]: Becoming Leader. State: Replica: f675c2d870874f87ade6aeb6d783ab6d, State: Running, Role: LEADER
I20260709 12:30:07.629652 16458 consensus_queue.cc:1048] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:30:07.630741 16387 consensus_queue.cc:237] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:07.642283 16107 raft_consensus.cc:1275] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:30:07.643700 16387 consensus_queue.cc:1048] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:30:07.644559 15930 catalog_manager.cc:5697] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d reported cstate change: term changed from 2 to 3, leader changed from 016723a5747a4889963be3d058762626 (127.7.23.65) to f675c2d870874f87ade6aeb6d783ab6d (127.7.23.67). New cstate: current_term: 3 leader_uuid: "f675c2d870874f87ade6aeb6d783ab6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } health_report { overall_health: HEALTHY } } }
I20260709 12:30:08.015826 16107 raft_consensus.cc:1275] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 3 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:08.016904 16387 consensus_queue.cc:1048] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:30:08.040982 16035 raft_consensus.cc:1275] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 3 FOLLOWER]: Refusing update from remote peer f675c2d870874f87ade6aeb6d783ab6d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:30:08.045298 16459 consensus_queue.cc:1048] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:30:08.175341  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:08.181349  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:08.181876  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:09.182763  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:09.187809  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:09.188251  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:10.189108  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:10.195047  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:10.195574  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:11.196507  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:11.201562  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:11.201999  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:12.203184  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:12.208856  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:12.209300  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:13.210276  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:13.215265  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:13.215755  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:14.216673  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:14.221614  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:14.222061  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:15.223174  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:15.230156  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:15.230572  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:30:17.078354  7261 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:30:17.083364  7261 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:30:17.083729  7261 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:30:17.304759 16131 debug-util.cc:398] Leaking SignalData structure 0x7b08003b1d20 after lost signal to thread 7264
W20260709 12:30:17.306041 16131 debug-util.cc:398] Leaking SignalData structure 0x7b08001b2c60 after lost signal to thread 15967
W20260709 12:30:17.307087 16131 debug-util.cc:398] Leaking SignalData structure 0x7b080011aa00 after lost signal to thread 16059
W20260709 12:30:17.308068 16131 debug-util.cc:398] Leaking SignalData structure 0x7b08003d22c0 after lost signal to thread 16134
W20260709 12:30:17.308980 16131 debug-util.cc:398] Leaking SignalData structure 0x7b08002232a0 after lost signal to thread 16208
I20260709 12:30:18.148111  7261 tablet_server.cc:179] TabletServer@127.7.23.65:0 shutting down...
I20260709 12:30:18.185914  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:18.186710  7261 tablet_replica.cc:333] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.187698  7261 raft_consensus.cc:2243] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.188650  7261 raft_consensus.cc:2272] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.191583  7261 tablet_replica.cc:333] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.192590  7261 raft_consensus.cc:2243] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.194041  7261 raft_consensus.cc:2272] T 271e0b74281143c0b8dcc7c8e4a09cbb P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.197096  7261 tablet_replica.cc:333] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.197774  7261 raft_consensus.cc:2243] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.198763  7261 raft_consensus.cc:2272] T e5e0c9a83b2643cda992a95726dc80f7 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.201582  7261 tablet_replica.cc:333] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.202250  7261 raft_consensus.cc:2243] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.202922  7261 raft_consensus.cc:2272] T d6e425a7e8c144fe9a5ca4f10da1106c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.205618  7261 tablet_replica.cc:333] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.206189  7261 raft_consensus.cc:2243] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.206826  7261 raft_consensus.cc:2272] T 0a2cd14ffd8347188bddd077c3c752a6 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.209573  7261 tablet_replica.cc:333] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.210237  7261 raft_consensus.cc:2243] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.210758  7261 raft_consensus.cc:2272] T 84d596c2ecb14b1d9c7b8bcaf329d213 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.213320  7261 tablet_replica.cc:333] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.213968  7261 raft_consensus.cc:2243] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.214766  7261 raft_consensus.cc:2272] T 510681244a494d739604a2ee44540187 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.218163  7261 tablet_replica.cc:333] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.218726  7261 raft_consensus.cc:2243] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.219208  7261 raft_consensus.cc:2272] T 21875f466e174761b5b419bd47761f4d P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.222036 16075 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
I20260709 12:30:18.222587  7261 tablet_replica.cc:333] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.223368  7261 raft_consensus.cc:2243] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.224313  7261 raft_consensus.cc:2272] T baec55282a1d49848fdc90cada401fc6 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.225917 16075 consensus_peers.cc:597] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.227499  7261 tablet_replica.cc:333] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.228477  7261 raft_consensus.cc:2243] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.229701  7261 raft_consensus.cc:2272] T a3f18035f6cf431e8e829f38806e152c P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.231494 16075 consensus_peers.cc:597] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.232805  7261 tablet_replica.cc:333] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.233451  7261 raft_consensus.cc:2243] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.234346  7261 raft_consensus.cc:2272] T 5567d4f855bb42639c4ae48ad36593ab P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.236936  7261 tablet_replica.cc:333] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.237608  7261 raft_consensus.cc:2243] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.238835  7261 raft_consensus.cc:2272] T 8a0846708b324515bbf6b0c33d46b196 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.241142 16075 consensus_peers.cc:597] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.242026  7261 tablet_replica.cc:333] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.242650  7261 raft_consensus.cc:2243] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.243183  7261 raft_consensus.cc:2272] T 4cad5cf4c28f42ad8b44aef23d7aee43 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.245630  7261 tablet_replica.cc:333] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.246318  7261 raft_consensus.cc:2243] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.247510  7261 raft_consensus.cc:2272] T 67d0f4da57224a8795453bafc9e67f03 P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.250501  7261 tablet_replica.cc:333] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.251041  7261 raft_consensus.cc:2243] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.251586  7261 raft_consensus.cc:2272] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.254629  7261 tablet_replica.cc:333] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.255309  7261 raft_consensus.cc:2243] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.255975  7261 raft_consensus.cc:2272] T a4205851f6214b4abeab557d9a3de52c P 016723a5747a4889963be3d058762626 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.258527  7261 tablet_replica.cc:333] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.259119  7261 raft_consensus.cc:2243] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.260125  7261 raft_consensus.cc:2272] T eb5da7f6be4a49e981d95ea8897d2ec7 P 016723a5747a4889963be3d058762626 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.262724  7261 tablet_replica.cc:333] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626: stopping tablet replica
I20260709 12:30:18.263250  7261 raft_consensus.cc:2243] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.263722  7261 raft_consensus.cc:2272] T 9187f458751d43f099461bb0804b4b0e P 016723a5747a4889963be3d058762626 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.290946 16075 consensus_peers.cc:597] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.304080  7261 tablet_server.cc:196] TabletServer@127.7.23.65:0 shutdown complete.
W20260709 12:30:18.344614 16149 consensus_peers.cc:597] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.356279 16149 consensus_peers.cc:597] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.369349  7261 tablet_server.cc:179] TabletServer@127.7.23.66:0 shutting down...
W20260709 12:30:18.405176 16149 consensus_peers.cc:597] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.405808  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:18.406519  7261 tablet_replica.cc:333] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.407387  7261 raft_consensus.cc:2243] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.408435  7261 raft_consensus.cc:2272] T d6e425a7e8c144fe9a5ca4f10da1106c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.410949  7261 tablet_replica.cc:333] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.411731  7261 raft_consensus.cc:2243] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.412644  7261 raft_consensus.cc:2272] T 510681244a494d739604a2ee44540187 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.415098  7261 tablet_replica.cc:333] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.415745  7261 raft_consensus.cc:2243] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.416534  7261 raft_consensus.cc:2272] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.418879  7261 tablet_replica.cc:333] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.419438  7261 raft_consensus.cc:2243] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.420271  7261 raft_consensus.cc:2272] T 0a2cd14ffd8347188bddd077c3c752a6 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.422904  7261 tablet_replica.cc:333] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.423727  7261 raft_consensus.cc:2243] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.424501  7261 raft_consensus.cc:2272] T e5e0c9a83b2643cda992a95726dc80f7 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.427749 16149 consensus_peers.cc:597] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d -> Peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Couldn't send request to peer 016723a5747a4889963be3d058762626. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:18.427870  7261 tablet_replica.cc:333] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.428859  7261 raft_consensus.cc:2243] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.429613  7261 raft_consensus.cc:2272] T 271e0b74281143c0b8dcc7c8e4a09cbb P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.432564  7261 tablet_replica.cc:333] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.433434  7261 raft_consensus.cc:2243] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.434134  7261 raft_consensus.cc:2272] T 9187f458751d43f099461bb0804b4b0e P fa5bbc0be95d48069a791d991068b073 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.437141  7261 tablet_replica.cc:333] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.437815  7261 raft_consensus.cc:2243] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.438490  7261 raft_consensus.cc:2272] T eb5da7f6be4a49e981d95ea8897d2ec7 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.441581  7261 tablet_replica.cc:333] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.442350  7261 raft_consensus.cc:2243] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.442988  7261 raft_consensus.cc:2272] T 84d596c2ecb14b1d9c7b8bcaf329d213 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.445935  7261 tablet_replica.cc:333] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.446627  7261 raft_consensus.cc:2243] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.447700  7261 raft_consensus.cc:2272] T 21875f466e174761b5b419bd47761f4d P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.450644  7261 tablet_replica.cc:333] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.451399  7261 raft_consensus.cc:2243] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.452019  7261 raft_consensus.cc:2272] T baec55282a1d49848fdc90cada401fc6 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.454885  7261 tablet_replica.cc:333] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.455664  7261 raft_consensus.cc:2243] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.456301  7261 raft_consensus.cc:2272] T a3f18035f6cf431e8e829f38806e152c P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.459441  7261 tablet_replica.cc:333] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.460144  7261 raft_consensus.cc:2243] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.460825  7261 raft_consensus.cc:2272] T 5567d4f855bb42639c4ae48ad36593ab P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.463802  7261 tablet_replica.cc:333] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.464507  7261 raft_consensus.cc:2243] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.465204  7261 raft_consensus.cc:2272] T 8a0846708b324515bbf6b0c33d46b196 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.468108  7261 tablet_replica.cc:333] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.468811  7261 raft_consensus.cc:2243] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.469907  7261 raft_consensus.cc:2272] T 4cad5cf4c28f42ad8b44aef23d7aee43 P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.473026  7261 tablet_replica.cc:333] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.473691  7261 raft_consensus.cc:2243] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.474251  7261 raft_consensus.cc:2272] T 67d0f4da57224a8795453bafc9e67f03 P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.477128  7261 tablet_replica.cc:333] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.477764  7261 raft_consensus.cc:2243] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:18.478367  7261 raft_consensus.cc:2272] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P fa5bbc0be95d48069a791d991068b073 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:18.481006  7261 tablet_replica.cc:333] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073: stopping tablet replica
I20260709 12:30:18.481523  7261 raft_consensus.cc:2243] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:18.482475  7261 raft_consensus.cc:2272] T a4205851f6214b4abeab557d9a3de52c P fa5bbc0be95d48069a791d991068b073 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:30:18.526496 16150 consensus_peers.cc:597] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d -> Peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Couldn't send request to peer fa5bbc0be95d48069a791d991068b073. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.547456 16150 consensus_peers.cc:597] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d -> Peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Couldn't send request to peer fa5bbc0be95d48069a791d991068b073. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.797482 16150 consensus_peers.cc:597] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d -> Peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Couldn't send request to peer fa5bbc0be95d48069a791d991068b073. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:30:18.839661 16150 consensus_peers.cc:597] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d -> Peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Couldn't send request to peer fa5bbc0be95d48069a791d991068b073. Status: Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:30:19.217809 16513 raft_consensus.cc:493] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 016723a5747a4889963be3d058762626)
I20260709 12:30:19.218526 16513 raft_consensus.cc:515] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.221139 16513 leader_election.cc:290] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.225555 16149 leader_election.cc:336] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.227169 16150 leader_election.cc:336] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.227522 16150 leader_election.cc:304] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.228107 16513 raft_consensus.cc:2749] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:19.275830 16513 raft_consensus.cc:493] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 016723a5747a4889963be3d058762626)
I20260709 12:30:19.276439 16513 raft_consensus.cc:515] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.278688 16513 leader_election.cc:290] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.282243 16149 leader_election.cc:336] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.282811 16150 leader_election.cc:336] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.283147 16150 leader_election.cc:304] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.283706 16513 raft_consensus.cc:2749] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:19.307885 16513 raft_consensus.cc:493] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa5bbc0be95d48069a791d991068b073)
I20260709 12:30:19.308499 16513 raft_consensus.cc:515] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.310119 16513 leader_election.cc:290] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.314062 16149 leader_election.cc:336] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.314469 16150 leader_election.cc:336] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.314882 16150 leader_election.cc:304] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.315558 16513 raft_consensus.cc:2749] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:19.349054 16513 raft_consensus.cc:493] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa5bbc0be95d48069a791d991068b073)
I20260709 12:30:19.349520 16513 raft_consensus.cc:515] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.351205 16513 leader_election.cc:290] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.355085 16149 leader_election.cc:336] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.355580 16150 leader_election.cc:336] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.355899 16150 leader_election.cc:304] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.356455 16513 raft_consensus.cc:2749] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:19.378077 16513 raft_consensus.cc:493] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 016723a5747a4889963be3d058762626)
I20260709 12:30:19.378705 16513 raft_consensus.cc:515] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.381018 16513 leader_election.cc:290] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.384922 16149 leader_election.cc:336] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.385404 16150 leader_election.cc:336] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.385723 16150 leader_election.cc:304] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.386278 16513 raft_consensus.cc:2749] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:19.438190 16513 raft_consensus.cc:493] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 016723a5747a4889963be3d058762626)
I20260709 12:30:19.438660 16513 raft_consensus.cc:515] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.440549 16513 leader_election.cc:290] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.444214 16149 leader_election.cc:336] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.444757 16150 leader_election.cc:336] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.445161 16150 leader_election.cc:304] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.445772 16513 raft_consensus.cc:493] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa5bbc0be95d48069a791d991068b073)
I20260709 12:30:19.445930 16512 raft_consensus.cc:2749] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:19.446425 16513 raft_consensus.cc:515] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.448199 16513 leader_election.cc:290] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.452046 16149 leader_election.cc:336] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.452497 16150 leader_election.cc:336] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.452852 16150 leader_election.cc:304] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.453367 16513 raft_consensus.cc:2749] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:19.457943 16513 raft_consensus.cc:493] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 016723a5747a4889963be3d058762626)
I20260709 12:30:19.458454 16513 raft_consensus.cc:515] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.460599 16513 leader_election.cc:290] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.464068 16149 leader_election.cc:336] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.464569 16150 leader_election.cc:336] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.464974 16150 leader_election.cc:304] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.465626 16513 raft_consensus.cc:2749] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:30:19.524216  7261 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16131)
I20260709 12:30:19.588169 16513 raft_consensus.cc:493] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa5bbc0be95d48069a791d991068b073)
I20260709 12:30:19.588773 16513 raft_consensus.cc:515] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.590610 16513 leader_election.cc:290] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.594746 16150 leader_election.cc:336] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
W20260709 12:30:19.595227 16149 leader_election.cc:336] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
I20260709 12:30:19.595629 16149 leader_election.cc:304] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.596347 16512 raft_consensus.cc:2749] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:19.615909 16512 raft_consensus.cc:493] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 016723a5747a4889963be3d058762626)
I20260709 12:30:19.616362 16512 raft_consensus.cc:515] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.617223 16513 raft_consensus.cc:493] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 016723a5747a4889963be3d058762626)
I20260709 12:30:19.617835 16513 raft_consensus.cc:515] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.618639 16512 leader_election.cc:290] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
I20260709 12:30:19.619933 16513 leader_election.cc:290] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.622983 16149 leader_election.cc:336] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.623500 16149 leader_election.cc:336] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.623836 16150 leader_election.cc:336] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.624320 16150 leader_election.cc:304] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.624998 16513 raft_consensus.cc:2749] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:30:19.625169 16150 leader_election.cc:336] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.625610 16150 leader_election.cc:304] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.626225 16513 raft_consensus.cc:2749] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:19.749496 16513 raft_consensus.cc:493] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa5bbc0be95d48069a791d991068b073)
I20260709 12:30:19.750047 16513 raft_consensus.cc:515] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.751992 16513 leader_election.cc:290] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.755359 16149 leader_election.cc:336] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.756654 16150 leader_election.cc:336] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.757054 16150 leader_election.cc:304] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.757680 16513 raft_consensus.cc:2749] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:19.874696 16513 raft_consensus.cc:493] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa5bbc0be95d48069a791d991068b073)
I20260709 12:30:19.875165 16513 raft_consensus.cc:515] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.877031 16513 leader_election.cc:290] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.880990 16149 leader_election.cc:336] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
W20260709 12:30:19.881521 16150 leader_election.cc:336] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
I20260709 12:30:19.881865 16150 leader_election.cc:304] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.882380 16513 raft_consensus.cc:2749] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:30:19.926149 16512 raft_consensus.cc:493] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa5bbc0be95d48069a791d991068b073)
I20260709 12:30:19.926748 16512 raft_consensus.cc:515] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "016723a5747a4889963be3d058762626" member_type: VOTER last_known_addr { host: "127.7.23.65" port: 40287 } } peers { permanent_uuid: "fa5bbc0be95d48069a791d991068b073" member_type: VOTER last_known_addr { host: "127.7.23.66" port: 41537 } } peers { permanent_uuid: "f675c2d870874f87ade6aeb6d783ab6d" member_type: VOTER last_known_addr { host: "127.7.23.67" port: 32823 } }
I20260709 12:30:19.928993 16512 leader_election.cc:290] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 016723a5747a4889963be3d058762626 (127.7.23.65:40287), fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537)
W20260709 12:30:19.934325 16150 leader_election.cc:336] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa5bbc0be95d48069a791d991068b073 (127.7.23.66:41537): Network error: Client connection negotiation failed: client connection to 127.7.23.66:41537: connect: Connection refused (error 111)
W20260709 12:30:19.934798 16149 leader_election.cc:336] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 016723a5747a4889963be3d058762626 (127.7.23.65:40287): Network error: Client connection negotiation failed: client connection to 127.7.23.65:40287: connect: Connection refused (error 111)
I20260709 12:30:19.935246 16149 leader_election.cc:304] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f675c2d870874f87ade6aeb6d783ab6d; no voters: 016723a5747a4889963be3d058762626, fa5bbc0be95d48069a791d991068b073
I20260709 12:30:19.935956 16512 raft_consensus.cc:2749] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:30:20.371752  7261 tablet_server.cc:196] TabletServer@127.7.23.66:0 shutdown complete.
I20260709 12:30:20.410270  7261 tablet_server.cc:179] TabletServer@127.7.23.67:0 shutting down...
I20260709 12:30:20.442167  7261 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:30:20.442888  7261 tablet_replica.cc:333] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.443852  7261 raft_consensus.cc:2243] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.444540  7261 raft_consensus.cc:2272] T d6e425a7e8c144fe9a5ca4f10da1106c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.446694  7261 tablet_replica.cc:333] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.447228  7261 raft_consensus.cc:2243] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.447717  7261 raft_consensus.cc:2272] T 271e0b74281143c0b8dcc7c8e4a09cbb P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.449687  7261 tablet_replica.cc:333] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.450234  7261 raft_consensus.cc:2243] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.450652  7261 raft_consensus.cc:2272] T e5e0c9a83b2643cda992a95726dc80f7 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.452647  7261 tablet_replica.cc:333] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.453156  7261 raft_consensus.cc:2243] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.453604  7261 raft_consensus.cc:2272] T 0a2cd14ffd8347188bddd077c3c752a6 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.455660  7261 tablet_replica.cc:333] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.456197  7261 raft_consensus.cc:2243] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.456673  7261 raft_consensus.cc:2272] T 0e1a7ef3025449f1a5cb6f79ef966ca8 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.458599  7261 tablet_replica.cc:333] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.459136  7261 raft_consensus.cc:2243] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.459616  7261 raft_consensus.cc:2272] T 510681244a494d739604a2ee44540187 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.461506  7261 tablet_replica.cc:333] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.462020  7261 raft_consensus.cc:2243] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.462412  7261 raft_consensus.cc:2272] T 21875f466e174761b5b419bd47761f4d P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.464459  7261 tablet_replica.cc:333] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.464974  7261 raft_consensus.cc:2243] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:20.465721  7261 raft_consensus.cc:2272] T 84d596c2ecb14b1d9c7b8bcaf329d213 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.467643  7261 tablet_replica.cc:333] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.468134  7261 raft_consensus.cc:2243] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.468600  7261 raft_consensus.cc:2272] T 5567d4f855bb42639c4ae48ad36593ab P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.470465  7261 tablet_replica.cc:333] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.470991  7261 raft_consensus.cc:2243] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:20.471787  7261 raft_consensus.cc:2272] T baec55282a1d49848fdc90cada401fc6 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.473735  7261 tablet_replica.cc:333] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.474246  7261 raft_consensus.cc:2243] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.474649  7261 raft_consensus.cc:2272] T a3f18035f6cf431e8e829f38806e152c P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.476531  7261 tablet_replica.cc:333] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.476981  7261 raft_consensus.cc:2243] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.477388  7261 raft_consensus.cc:2272] T 8a0846708b324515bbf6b0c33d46b196 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.479220  7261 tablet_replica.cc:333] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.479696  7261 raft_consensus.cc:2243] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.480116  7261 raft_consensus.cc:2272] T 4cad5cf4c28f42ad8b44aef23d7aee43 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.481909  7261 tablet_replica.cc:333] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.482410  7261 raft_consensus.cc:2243] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.482843  7261 raft_consensus.cc:2272] T 67d0f4da57224a8795453bafc9e67f03 P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.484882  7261 tablet_replica.cc:333] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.485348  7261 raft_consensus.cc:2243] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:30:20.486119  7261 raft_consensus.cc:2272] T 7e393cbd9bac4f63b1fa4d7cf01ece7f P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.488037  7261 tablet_replica.cc:333] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.488512  7261 raft_consensus.cc:2243] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.488895  7261 raft_consensus.cc:2272] T a4205851f6214b4abeab557d9a3de52c P f675c2d870874f87ade6aeb6d783ab6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.490784  7261 tablet_replica.cc:333] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.491240  7261 raft_consensus.cc:2243] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:30:20.491722  7261 raft_consensus.cc:2272] T eb5da7f6be4a49e981d95ea8897d2ec7 P f675c2d870874f87ade6aeb6d783ab6d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.493835  7261 tablet_replica.cc:333] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d: stopping tablet replica
I20260709 12:30:20.494248  7261 raft_consensus.cc:2243] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:30:20.494997  7261 raft_consensus.cc:2272] T 9187f458751d43f099461bb0804b4b0e P f675c2d870874f87ade6aeb6d783ab6d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.534163  7261 tablet_server.cc:196] TabletServer@127.7.23.67:0 shutdown complete.
I20260709 12:30:20.567934  7261 master.cc:562] Master@127.7.23.126:37615 shutting down...
I20260709 12:30:20.588392  7261 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:30:20.588958  7261 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:30:20.589237  7261 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0ca7b742d4bb453788cb1a35b9086398: stopping tablet replica
I20260709 12:30:20.609194  7261 master.cc:584] Master@127.7.23.126:37615 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22852 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43222 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (326541 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:30:20.662964  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2306 messages since previous log ~33 seconds ago
I20260709 12:30:20.663219  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2306 messages since previous log ~33 seconds ago
I20260709 12:30:20.663372  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2305 messages since previous log ~33 seconds ago
I20260709 12:30:20.663570  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:30:20.663718  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:30:20.663873  7261 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~170 seconds ago
I20260709 12:30:20.664009  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~171 seconds ago
I20260709 12:30:20.664145  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~184 seconds ago
I20260709 12:30:20.664276  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 2 messages since previous log ~190 seconds ago
I20260709 12:30:20.664469  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 69 messages since previous log ~2 seconds ago
I20260709 12:30:20.664722  7261 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~17 seconds ago
